2023-03-08T15:28:55.365 INFO:root:teuthology version: 0.0.1.dev51+ga2dfb05 2023-03-08T15:28:55.366 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2023-03-08_15:12:36-fs-wip-vshankar-testing-20230308.112059-testing-default-smithi --owner scheduled_vshankar@teuthology --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} --verbose --archive /home/teuthworker/archive/vshankar-2023-03-08_15:12:36-fs-wip-vshankar-testing-20230308.112059-testing-default-smithi/7197048 -- /home/teuthworker/archive/vshankar-2023-03-08_15:12:36-fs-wip-vshankar-testing-20230308.112059-testing-default-smithi/7197048/orig.config.yaml 2023-03-08T15:28:55.414 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-03-08T15:28:55.493 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-03-08_15:12:36-fs-wip-vshankar-testing-20230308.112059-testing-default-smithi/7197048 branch: wip-vshankar-testing-20230308.112059 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} email: vshankar@redhat.com first_in_suite: false job_id: '7197048' kernel: client: branch: testing flavor: default kdb: true sha1: 75534f74ac3dd06f86697ff862e8be2945b3c8e6 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-03-08_15:12:36-fs-wip-vshankar-testing-20230308.112059-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-vshankar-testing-20230308.112059 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a2b8f27f8eef4b6c46c66813a64c178fb019988a ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2b8f27f8eef4b6c46c66813a64c178fb019988a kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230308.112059 sha1: a2b8f27f8eef4b6c46c66813a64c178fb019988a owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 sha1: a2b8f27f8eef4b6c46c66813a64c178fb019988a sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20230308.112059 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a2b8f27f8eef4b6c46c66813a64c178fb019988a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a2b8f27f8eef4b6c46c66813a64c178fb019988a syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi123.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCRgFZlAspQVUpR3W3EeiMRNhVKmkhrJEgl8dIzt2ImDxHQcwXHOSXN61/e7Zmfr0UC5I6lyRV0V1XT3r/C5PxVeOyqLeqU2VlTZB2CitPlk0kOUfrYoR8YGbOjwhY5Xz0H02+1DKygdwQ88tl0sDGz2fVveBOw/8vairNBVFRdvQFJ2CyO1dZHEI15bJLuMX3u9ol1hpIybFoie0tqgShQH5JZOeeEqakCqpJISNV1E6Hen7ZTcoawEjberlQm7cNbrdZrJsuSNLasOF7BNUJGnMuS2MqkTl6gscWDifINPQxzMaBbkWbIUBeqyrYVU3JqlQA+WRwyDXIUsdz3GbJIGoh60fvj053J5cx5stlo4m8f4b/WcopOAVg37oQINq85vp+o4/8w/cYFQdoLNg5fANkMFROl6nPN3NuvyxCFWUOXW1E4mQ2/TDBxNqdCJDA1KkybBjRMPzZImxnntXzgVd6pi11+0Iyh40ERIKx4VB7EOKePTOks3Wg/vqOJadk= smithi175.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDyuYbLgv62G0J/d1BABWUaa+iKT6UFDexa1sjbn4BYC1qMqpwJqMPfmKnne5XcuwU3LNIPQkzA74CUJd9fdY4qhEFAxD1qKijh5dO9HDpGCWhGrZUzLDFMau13QL8H4SjxwurHPU91sVa7nC/uCR96IqPCkwfQ6fJ17+7CHETkKippRjDcYxsHdw9Puo75icqweE9OJ3hRorgO5rSW+U/sOYcKcYuuKwwWoQgnn5gWDYQTMIn0rsOVLA9DVjMrIwgJDQIZK+OaZnTASfIwxrVGSuSqHrq2oZF0VEUkjB4DAFTJtso/Gad8enZ6Fp5gSbmd914RJ83MOGph0yF8ZXo1FcnePKRMsfq18ETs/+ArQ5hKMzG9amWO0liapdwYLfq81j1QTWZhef2fBNsKfmxQUiDg18nr2UfpaM82tsrfzfl8MITYocDxKU58guKhQCoJ5hzbTVizoX6MDMJs93wDgdjbAR4GRMePR6OSb0iOoEGtXC2B19fMElaQV9fCY0= smithi182.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPYhen9IMstjvYAdoHxygvnnwgxU/+L+pQPb3t8S2yyKTXSjDa2i57XVJdwDzTrm24E5gvjsorT96T0csg4Rmg0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: a2dfb0599b24ec4a1585108a2792a4567ce0a378 timestamp: 2023-03-08_15:12:36 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.19450 2023-03-08T15:28:55.494 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a2b8f27f8eef4b6c46c66813a64c178fb019988a/qa; will attempt to use it 2023-03-08T15:28:55.494 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a2b8f27f8eef4b6c46c66813a64c178fb019988a/qa/tasks 2023-03-08T15:28:55.495 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-03-08T15:28:55.496 INFO:teuthology.task.internal:Checking packages... 2023-03-08T15:28:55.524 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a2b8f27f8eef4b6c46c66813a64c178fb019988a' 2023-03-08T15:28:55.525 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-03-08T15:28:55.525 INFO:teuthology.packaging:ref: None 2023-03-08T15:28:55.525 INFO:teuthology.packaging:tag: None 2023-03-08T15:28:55.526 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230308.112059 2023-03-08T15:28:55.526 INFO:teuthology.packaging:sha1: a2b8f27f8eef4b6c46c66813a64c178fb019988a 2023-03-08T15:28:55.526 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230308.112059 2023-03-08T15:28:55.671 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-2861.ga2b8f27f 2023-03-08T15:28:55.671 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-03-08T15:28:55.685 INFO:teuthology.task.internal:no buildpackages task found 2023-03-08T15:28:55.686 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-03-08T15:28:55.698 INFO:teuthology.task.internal:Saving configuration 2023-03-08T15:28:55.719 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-03-08T15:28:55.735 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-08T15:28:55.763 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-03-08_15:12:36-fs-wip-vshankar-testing-20230308.112059-testing-default-smithi/7197048', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-08 15:13:42.396897', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNUAmQu0iCmyaVWD3i5NfxyzL/biSrQz3i+8pABvLqJxTt1xH5S0q62rBRGVvxnIzXLwTuiJEL8Ii2zchmQWjH4='} 2023-03-08T15:28:55.789 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-03-08_15:12:36-fs-wip-vshankar-testing-20230308.112059-testing-default-smithi/7197048', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-08 15:13:42.398555', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOXZKQX7n5c2zo/QUaodaP9Qx9sGllhQB/SRCAWb/Tt/a9w2dak1qSOBRMxPcUv1y8OSGnEUBDHtnI9TNCBTuKY='} 2023-03-08T15:28:55.814 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi182.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-03-08_15:12:36-fs-wip-vshankar-testing-20230308.112059-testing-default-smithi/7197048', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-08 15:13:42.400286', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPYhen9IMstjvYAdoHxygvnnwgxU/+L+pQPb3t8S2yyKTXSjDa2i57XVJdwDzTrm24E5gvjsorT96T0csg4Rmg0='} 2023-03-08T15:28:55.815 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-03-08T15:28:55.821 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-03-08T15:28:55.822 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-03-08T15:28:55.822 INFO:teuthology.task.internal:roles: ubuntu@smithi182.front.sepia.ceph.com - ['client.0'] 2023-03-08T15:28:55.822 INFO:teuthology.run_tasks:Running task console_log... 2023-03-08T15:28:55.939 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdf6552f4c0>, signals=[15]) 2023-03-08T15:28:55.941 INFO:teuthology.run_tasks:Running task internal.connect... 2023-03-08T15:28:55.949 INFO:teuthology.task.internal:Opening connections... 2023-03-08T15:28:55.951 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2023-03-08T15:28:55.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-08T15:28:56.022 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2023-03-08T15:28:56.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-08T15:28:56.094 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi182.front.sepia.ceph.com 2023-03-08T15:28:56.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-08T15:28:56.161 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-03-08T15:28:56.170 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-03-08T15:28:56.193 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-03-08T15:28:56.201 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-03-08T15:28:56.253 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2023-03-08T15:28:56.253 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8" 2023-03-08T15:28:56.253 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2023-03-08T15:28:56.254 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2023-03-08T15:28:56.254 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8" 2023-03-08T15:28:56.254 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-03-08T15:28:56.254 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 8" 2023-03-08T15:28:56.254 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-03-08T15:28:56.254 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-03-08T15:28:56.254 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2023-03-08T15:28:56.255 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-08T15:28:56.255 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-08T15:28:56.255 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-03-08T15:28:56.256 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-03-08T15:28:56.284 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-03-08T15:28:56.304 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-03-08T15:28:56.305 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-03-08T15:28:56.363 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2023-03-08T15:28:56.364 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8" 2023-03-08T15:28:56.364 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2023-03-08T15:28:56.364 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2023-03-08T15:28:56.364 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8" 2023-03-08T15:28:56.365 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-03-08T15:28:56.365 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 8" 2023-03-08T15:28:56.366 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-03-08T15:28:56.366 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-03-08T15:28:56.366 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2023-03-08T15:28:56.366 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-08T15:28:56.367 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-08T15:28:56.368 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-03-08T15:28:56.368 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-03-08T15:28:56.391 DEBUG:teuthology.orchestra.run.smithi182:> uname -m 2023-03-08T15:28:56.416 INFO:teuthology.orchestra.run.smithi182.stdout:x86_64 2023-03-08T15:28:56.417 DEBUG:teuthology.orchestra.run.smithi182:> cat /etc/os-release 2023-03-08T15:28:56.476 INFO:teuthology.orchestra.run.smithi182.stdout:NAME="CentOS Stream" 2023-03-08T15:28:56.477 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION="8" 2023-03-08T15:28:56.477 INFO:teuthology.orchestra.run.smithi182.stdout:ID="centos" 2023-03-08T15:28:56.477 INFO:teuthology.orchestra.run.smithi182.stdout:ID_LIKE="rhel fedora" 2023-03-08T15:28:56.477 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_ID="8" 2023-03-08T15:28:56.477 INFO:teuthology.orchestra.run.smithi182.stdout:PLATFORM_ID="platform:el8" 2023-03-08T15:28:56.478 INFO:teuthology.orchestra.run.smithi182.stdout:PRETTY_NAME="CentOS Stream 8" 2023-03-08T15:28:56.478 INFO:teuthology.orchestra.run.smithi182.stdout:ANSI_COLOR="0;31" 2023-03-08T15:28:56.478 INFO:teuthology.orchestra.run.smithi182.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-03-08T15:28:56.478 INFO:teuthology.orchestra.run.smithi182.stdout:HOME_URL="https://centos.org/" 2023-03-08T15:28:56.478 INFO:teuthology.orchestra.run.smithi182.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-08T15:28:56.478 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-08T15:28:56.478 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-03-08T15:28:56.479 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server 2023-03-08T15:28:56.499 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-03-08T15:28:56.514 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-03-08T15:28:56.525 INFO:teuthology.task.internal:Checking for old test directory... 2023-03-08T15:28:56.525 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2023-03-08T15:28:56.529 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2023-03-08T15:28:56.532 DEBUG:teuthology.orchestra.run.smithi182:> test '!' -e /home/ubuntu/cephtest 2023-03-08T15:28:56.553 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-03-08T15:28:56.568 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-03-08T15:28:56.568 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2023-03-08T15:28:56.589 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2023-03-08T15:28:56.592 DEBUG:teuthology.orchestra.run.smithi182:> test -z $(ls -A /var/lib/ceph) 2023-03-08T15:28:56.619 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-03-08T15:28:56.710 INFO:teuthology.run_tasks:Running task kernel... 2023-03-08T15:28:56.728 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'} 2023-03-08T15:28:56.729 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-03-08T15:28:56.729 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-03-08T15:28:56.730 DEBUG:teuthology.orchestra.run.smithi182:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-08T15:28:56.749 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-08T15:28:56.750 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-03-08T15:28:56.999 DEBUG:teuthology.task.kernel:sha1 for client.0 is 75534f74ac3dd06f86697ff862e8be2945b3c8e6 2023-03-08T15:28:56.999 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "75534f74ac3dd06f86697ff862e8be2945b3c8e6"... 2023-03-08T15:28:56.999 DEBUG:teuthology.orchestra.run.smithi182:> uname -r 2023-03-08T15:28:57.020 INFO:teuthology.orchestra.run.smithi182.stdout:4.18.0-408.el8.x86_64 2023-03-08T15:28:57.022 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-408.el8.x86_64 vs 75534f74ac3dd06f86697ff862e8be2945b3c8e6 2023-03-08T15:28:57.022 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-03-08T15:28:57.023 DEBUG:teuthology.orchestra.run.smithi182:> sudo yum upgrade -y linux-firmware 2023-03-08T15:29:00.868 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS-8 - AppStream 27 MB/s | 28 MB 00:01 2023-03-08T15:29:06.846 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS-8 - BaseOS 29 MB/s | 27 MB 00:00 2023-03-08T15:29:11.144 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS-8 - Extras 169 kB/s | 18 kB 00:00 2023-03-08T15:29:11.917 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS-8 - PowerTools 9.0 MB/s | 5.7 MB 00:00 2023-03-08T15:29:13.179 INFO:teuthology.orchestra.run.smithi182.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-03-08T15:29:16.413 INFO:teuthology.orchestra.run.smithi182.stdout:Extra Packages for Enterprise Linux 4.4 MB/s | 14 MB 00:03 2023-03-08T15:29:19.779 INFO:teuthology.orchestra.run.smithi182.stdout:lab-extras 349 kB/s | 24 kB 00:00 2023-03-08T15:29:23.165 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies resolved. 2023-03-08T15:29:23.166 INFO:teuthology.orchestra.run.smithi182.stdout:Nothing to do. 2023-03-08T15:29:23.166 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2023-03-08T15:29:23.274 INFO:teuthology.task.kernel:Downloading kernel 75534f74ac3dd06f86697ff862e8be2945b3c8e6 on client.0... 2023-03-08T15:29:23.275 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=75534f74ac3dd06f86697ff862e8be2945b3c8e6 2023-03-08T15:29:23.423 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/75534f74ac3dd06f86697ff862e8be2945b3c8e6/centos/8/flavors/default/x86_64/ 2023-03-08T15:29:23.424 DEBUG:teuthology.orchestra.run.smithi182:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.2.0_ceph_g75534f74ac3d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/75534f74ac3dd06f86697ff862e8be2945b3c8e6/centos/8/flavors/default/x86_64/ --input-file=- 2023-03-08T15:29:23.426 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi182.front.sepia.ceph.com to complete... 2023-03-08T15:30:16.064 INFO:teuthology.orchestra.run.smithi182.stderr:2023-03-08 15:30:16 URL:https://3.chacra.ceph.com/r/kernel/testing/75534f74ac3dd06f86697ff862e8be2945b3c8e6/centos/8/flavors/default/x86_64/kernel-6.2.0_ceph_g75534f74ac3d-1.x86_64.rpm [383026056/383026056] -> "/tmp/kernel.x86_64.rpm" [1] 2023-03-08T15:30:16.065 INFO:teuthology.orchestra.run.smithi182.stderr:FINISHED --2023-03-08 15:30:16-- 2023-03-08T15:30:16.065 INFO:teuthology.orchestra.run.smithi182.stderr:Total wall clock time: 53s 2023-03-08T15:30:16.065 INFO:teuthology.orchestra.run.smithi182.stderr:Downloaded: 1 files, 365M in 52s (7.01 MB/s) 2023-03-08T15:30:16.066 INFO:teuthology.task.kernel:Installing kernel 75534f74ac3dd06f86697ff862e8be2945b3c8e6 on client.0... 2023-03-08T15:30:16.066 DEBUG:teuthology.orchestra.run.smithi182:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-03-08T15:30:17.799 INFO:teuthology.orchestra.run.smithi182.stdout:Verifying... ######################################## 2023-03-08T15:30:18.449 INFO:teuthology.orchestra.run.smithi182.stdout:Preparing... ######################################## 2023-03-08T15:30:18.584 INFO:teuthology.orchestra.run.smithi182.stdout:Updating / installing... 2023-03-08T15:30:57.188 INFO:teuthology.orchestra.run.smithi182.stdout:kernel-6.2.0_ceph_g75534f74ac3d-1 ######################################## 2023-03-08T15:31:20.631 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi182.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-03-08T15:31:20.632 DEBUG:teuthology.orchestra.run.smithi182:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-03-08T15:31:20.688 INFO:teuthology.orchestra.run.smithi182.stdout:/boot/System.map-6.2.0-ceph-g75534f74ac3d 2023-03-08T15:31:20.688 INFO:teuthology.orchestra.run.smithi182.stdout:/boot/config-6.2.0-ceph-g75534f74ac3d 2023-03-08T15:31:20.688 INFO:teuthology.orchestra.run.smithi182.stdout:/boot/vmlinuz-6.2.0-ceph-g75534f74ac3d 2023-03-08T15:31:20.688 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d 2023-03-08T15:31:20.688 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel 2023-03-08T15:31:20.689 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch 2023-03-08T15:31:20.689 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86 2023-03-08T15:31:20.689 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto 2023-03-08T15:31:20.689 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-03-08T15:31:20.689 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-03-08T15:31:20.689 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-03-08T15:31:20.689 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-03-08T15:31:20.690 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-03-08T15:31:20.690 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-03-08T15:31:20.690 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-03-08T15:31:20.690 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-03-08T15:31:20.690 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-03-08T15:31:20.690 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-03-08T15:31:20.690 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-03-08T15:31:20.691 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-03-08T15:31:20.691 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-03-08T15:31:20.691 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-03-08T15:31:20.691 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-03-08T15:31:20.691 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-03-08T15:31:20.691 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-03-08T15:31:20.691 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-03-08T15:31:20.691 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-03-08T15:31:20.692 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-03-08T15:31:20.692 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kernel 2023-03-08T15:31:20.692 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kernel/cpu 2023-03-08T15:31:20.692 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kernel/cpu/mce 2023-03-08T15:31:20.692 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-03-08T15:31:20.692 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kvm 2023-03-08T15:31:20.692 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kvm/kvm-amd.ko 2023-03-08T15:31:20.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kvm/kvm-intel.ko 2023-03-08T15:31:20.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/arch/x86/kvm/kvm.ko 2023-03-08T15:31:20.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto 2023-03-08T15:31:20.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/ansi_cprng.ko 2023-03-08T15:31:20.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/anubis.ko 2023-03-08T15:31:20.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/arc4.ko 2023-03-08T15:31:20.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/async_tx 2023-03-08T15:31:20.693 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/async_tx/async_memcpy.ko 2023-03-08T15:31:20.694 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/async_tx/async_pq.ko 2023-03-08T15:31:20.694 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-03-08T15:31:20.694 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/async_tx/async_tx.ko 2023-03-08T15:31:20.694 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/async_tx/async_xor.ko 2023-03-08T15:31:20.694 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/async_tx/raid6test.ko 2023-03-08T15:31:20.694 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/authenc.ko 2023-03-08T15:31:20.694 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/authencesn.ko 2023-03-08T15:31:20.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/blake2b_generic.ko 2023-03-08T15:31:20.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/blowfish_common.ko 2023-03-08T15:31:20.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/blowfish_generic.ko 2023-03-08T15:31:20.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/camellia_generic.ko 2023-03-08T15:31:20.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/cast5_generic.ko 2023-03-08T15:31:20.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/cast6_generic.ko 2023-03-08T15:31:20.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/cast_common.ko 2023-03-08T15:31:20.695 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/ccm.ko 2023-03-08T15:31:20.696 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/cmac.ko 2023-03-08T15:31:20.696 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/crc32_generic.ko 2023-03-08T15:31:20.696 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/crypto_engine.ko 2023-03-08T15:31:20.696 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/crypto_user.ko 2023-03-08T15:31:20.696 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/cts.ko 2023-03-08T15:31:20.696 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/des_generic.ko 2023-03-08T15:31:20.696 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/dh_generic.ko 2023-03-08T15:31:20.697 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/echainiv.ko 2023-03-08T15:31:20.697 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/essiv.ko 2023-03-08T15:31:20.697 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/fcrypt.ko 2023-03-08T15:31:20.697 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/khazad.ko 2023-03-08T15:31:20.697 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/lz4.ko 2023-03-08T15:31:20.697 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/lz4hc.ko 2023-03-08T15:31:20.697 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/md4.ko 2023-03-08T15:31:20.697 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/michael_mic.ko 2023-03-08T15:31:20.698 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/pcbc.ko 2023-03-08T15:31:20.698 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/pcrypt.ko 2023-03-08T15:31:20.698 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/rmd160.ko 2023-03-08T15:31:20.698 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/seed.ko 2023-03-08T15:31:20.699 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/serpent_generic.ko 2023-03-08T15:31:20.699 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/tcrypt.ko 2023-03-08T15:31:20.699 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/tea.ko 2023-03-08T15:31:20.699 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/twofish_common.ko 2023-03-08T15:31:20.699 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/twofish_generic.ko 2023-03-08T15:31:20.699 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/vmac.ko 2023-03-08T15:31:20.699 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/wp512.ko 2023-03-08T15:31:20.700 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/xcbc.ko 2023-03-08T15:31:20.700 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/xor.ko 2023-03-08T15:31:20.700 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/crypto/xxhash_generic.ko 2023-03-08T15:31:20.700 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers 2023-03-08T15:31:20.700 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi 2023-03-08T15:31:20.700 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/acpi_ipmi.ko 2023-03-08T15:31:20.700 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/acpi_pad.ko 2023-03-08T15:31:20.700 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/custom_method.ko 2023-03-08T15:31:20.701 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/ec_sys.ko 2023-03-08T15:31:20.701 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/platform_profile.ko 2023-03-08T15:31:20.701 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/sbs.ko 2023-03-08T15:31:20.701 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/sbshc.ko 2023-03-08T15:31:20.701 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/acpi/video.ko 2023-03-08T15:31:20.701 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata 2023-03-08T15:31:20.701 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/acard-ahci.ko 2023-03-08T15:31:20.702 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/ahci_platform.ko 2023-03-08T15:31:20.702 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/ata_generic.ko 2023-03-08T15:31:20.702 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/libahci_platform.ko 2023-03-08T15:31:20.702 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_acpi.ko 2023-03-08T15:31:20.702 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_ali.ko 2023-03-08T15:31:20.702 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_amd.ko 2023-03-08T15:31:20.702 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_artop.ko 2023-03-08T15:31:20.702 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_atiixp.ko 2023-03-08T15:31:20.703 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_atp867x.ko 2023-03-08T15:31:20.703 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_cmd640.ko 2023-03-08T15:31:20.703 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_cmd64x.ko 2023-03-08T15:31:20.703 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_cypress.ko 2023-03-08T15:31:20.703 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_efar.ko 2023-03-08T15:31:20.703 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_hpt366.ko 2023-03-08T15:31:20.703 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_hpt37x.ko 2023-03-08T15:31:20.704 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-03-08T15:31:20.704 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_hpt3x3.ko 2023-03-08T15:31:20.704 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_it8213.ko 2023-03-08T15:31:20.704 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_it821x.ko 2023-03-08T15:31:20.704 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_jmicron.ko 2023-03-08T15:31:20.704 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_marvell.ko 2023-03-08T15:31:20.704 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_mpiix.ko 2023-03-08T15:31:20.704 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_netcell.ko 2023-03-08T15:31:20.705 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_ninja32.ko 2023-03-08T15:31:20.705 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_ns87410.ko 2023-03-08T15:31:20.705 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_ns87415.ko 2023-03-08T15:31:20.705 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_oldpiix.ko 2023-03-08T15:31:20.705 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_opti.ko 2023-03-08T15:31:20.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_optidma.ko 2023-03-08T15:31:20.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_pcmcia.ko 2023-03-08T15:31:20.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_pdc2027x.ko 2023-03-08T15:31:20.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-03-08T15:31:20.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_piccolo.ko 2023-03-08T15:31:20.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_rdc.ko 2023-03-08T15:31:20.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_sch.ko 2023-03-08T15:31:20.706 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_serverworks.ko 2023-03-08T15:31:20.707 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_sil680.ko 2023-03-08T15:31:20.707 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_sis.ko 2023-03-08T15:31:20.707 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_sl82c105.ko 2023-03-08T15:31:20.707 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_triflex.ko 2023-03-08T15:31:20.707 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pata_via.ko 2023-03-08T15:31:20.707 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/pdc_adma.ko 2023-03-08T15:31:20.707 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_inic162x.ko 2023-03-08T15:31:20.708 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_mv.ko 2023-03-08T15:31:20.708 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_nv.ko 2023-03-08T15:31:20.708 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_promise.ko 2023-03-08T15:31:20.708 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_qstor.ko 2023-03-08T15:31:20.709 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_sil.ko 2023-03-08T15:31:20.709 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_sil24.ko 2023-03-08T15:31:20.709 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_sis.ko 2023-03-08T15:31:20.709 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_svw.ko 2023-03-08T15:31:20.709 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_sx4.ko 2023-03-08T15:31:20.709 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_uli.ko 2023-03-08T15:31:20.709 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_via.ko 2023-03-08T15:31:20.710 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ata/sata_vsc.ko 2023-03-08T15:31:20.710 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/auxdisplay 2023-03-08T15:31:20.710 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/auxdisplay/ks0108.ko 2023-03-08T15:31:20.710 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/base 2023-03-08T15:31:20.710 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/base/regmap 2023-03-08T15:31:20.710 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-03-08T15:31:20.710 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/bcma 2023-03-08T15:31:20.710 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/bcma/bcma.ko 2023-03-08T15:31:20.711 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block 2023-03-08T15:31:20.711 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/aoe 2023-03-08T15:31:20.711 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/aoe/aoe.ko 2023-03-08T15:31:20.711 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/brd.ko 2023-03-08T15:31:20.711 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/drbd 2023-03-08T15:31:20.711 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/drbd/drbd.ko 2023-03-08T15:31:20.711 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/floppy.ko 2023-03-08T15:31:20.711 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/loop.ko 2023-03-08T15:31:20.712 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/mtip32xx 2023-03-08T15:31:20.712 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-03-08T15:31:20.712 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/nbd.ko 2023-03-08T15:31:20.712 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/null_blk 2023-03-08T15:31:20.712 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/null_blk/null_blk.ko 2023-03-08T15:31:20.712 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/pktcdvd.ko 2023-03-08T15:31:20.712 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/rbd.ko 2023-03-08T15:31:20.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/virtio_blk.ko 2023-03-08T15:31:20.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/xen-blkback 2023-03-08T15:31:20.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-03-08T15:31:20.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/xen-blkfront.ko 2023-03-08T15:31:20.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/zram 2023-03-08T15:31:20.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/block/zram/zram.ko 2023-03-08T15:31:20.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char 2023-03-08T15:31:20.713 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/hangcheck-timer.ko 2023-03-08T15:31:20.714 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/hw_random 2023-03-08T15:31:20.714 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/hw_random/amd-rng.ko 2023-03-08T15:31:20.714 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/hw_random/intel-rng.ko 2023-03-08T15:31:20.714 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-03-08T15:31:20.714 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/hw_random/via-rng.ko 2023-03-08T15:31:20.714 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-03-08T15:31:20.714 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ipmi 2023-03-08T15:31:20.715 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-03-08T15:31:20.715 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-03-08T15:31:20.715 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-03-08T15:31:20.715 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-03-08T15:31:20.715 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-03-08T15:31:20.715 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-03-08T15:31:20.715 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/lp.ko 2023-03-08T15:31:20.715 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/mwave 2023-03-08T15:31:20.716 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/mwave/mwave.ko 2023-03-08T15:31:20.716 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/pcmcia 2023-03-08T15:31:20.716 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-03-08T15:31:20.716 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-03-08T15:31:20.716 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/ppdev.ko 2023-03-08T15:31:20.716 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tlclk.ko 2023-03-08T15:31:20.716 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tpm 2023-03-08T15:31:20.717 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tpm/tpm.ko 2023-03-08T15:31:20.717 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-03-08T15:31:20.717 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-03-08T15:31:20.717 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-03-08T15:31:20.717 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tpm/tpm_tis.ko 2023-03-08T15:31:20.717 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-03-08T15:31:20.717 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/uv_mmtimer.ko 2023-03-08T15:31:20.717 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/char/virtio_console.ko 2023-03-08T15:31:20.718 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/cpufreq 2023-03-08T15:31:20.718 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-03-08T15:31:20.718 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-03-08T15:31:20.718 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-03-08T15:31:20.718 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-03-08T15:31:20.719 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/cpufreq/powernow-k8.ko 2023-03-08T15:31:20.719 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-03-08T15:31:20.719 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto 2023-03-08T15:31:20.719 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/ccp 2023-03-08T15:31:20.719 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-03-08T15:31:20.719 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/ccp/ccp.ko 2023-03-08T15:31:20.720 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/padlock-aes.ko 2023-03-08T15:31:20.720 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/padlock-sha.ko 2023-03-08T15:31:20.721 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/qat 2023-03-08T15:31:20.721 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/qat/qat_common 2023-03-08T15:31:20.721 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-03-08T15:31:20.721 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/qat/qat_dh895xcc 2023-03-08T15:31:20.721 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-03-08T15:31:20.722 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/virtio 2023-03-08T15:31:20.722 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-03-08T15:31:20.722 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/dca 2023-03-08T15:31:20.722 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/dca/dca.ko 2023-03-08T15:31:20.722 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/devfreq 2023-03-08T15:31:20.722 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-03-08T15:31:20.722 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/dma 2023-03-08T15:31:20.723 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/dma/dw 2023-03-08T15:31:20.723 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/dma/dw/dw_dmac.ko 2023-03-08T15:31:20.723 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/dma/ioat 2023-03-08T15:31:20.723 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/dma/ioat/ioatdma.ko 2023-03-08T15:31:20.723 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac 2023-03-08T15:31:20.723 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/amd64_edac.ko 2023-03-08T15:31:20.723 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/e752x_edac.ko 2023-03-08T15:31:20.723 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/edac_mce_amd.ko 2023-03-08T15:31:20.724 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/i3000_edac.ko 2023-03-08T15:31:20.724 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/i3200_edac.ko 2023-03-08T15:31:20.724 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/i5100_edac.ko 2023-03-08T15:31:20.724 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/i5400_edac.ko 2023-03-08T15:31:20.724 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/i7300_edac.ko 2023-03-08T15:31:20.724 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/i7core_edac.ko 2023-03-08T15:31:20.724 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/i82975x_edac.ko 2023-03-08T15:31:20.725 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/ie31200_edac.ko 2023-03-08T15:31:20.725 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/sb_edac.ko 2023-03-08T15:31:20.725 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/edac/x38_edac.ko 2023-03-08T15:31:20.725 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/firmware 2023-03-08T15:31:20.725 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/firmware/edd.ko 2023-03-08T15:31:20.725 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/firmware/iscsi_ibft.ko 2023-03-08T15:31:20.725 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio 2023-03-08T15:31:20.725 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-ich.ko 2023-03-08T15:31:20.726 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/gpio/gpio-viperboard.ko 2023-03-08T15:31:20.726 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid 2023-03-08T15:31:20.726 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-appleir.ko 2023-03-08T15:31:20.726 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-aureal.ko 2023-03-08T15:31:20.726 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-axff.ko 2023-03-08T15:31:20.726 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-dr.ko 2023-03-08T15:31:20.726 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-elecom.ko 2023-03-08T15:31:20.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-elo.ko 2023-03-08T15:31:20.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-emsff.ko 2023-03-08T15:31:20.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-gaff.ko 2023-03-08T15:31:20.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-gt683r.ko 2023-03-08T15:31:20.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-gyration.ko 2023-03-08T15:31:20.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-03-08T15:31:20.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-03-08T15:31:20.727 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-holtekff.ko 2023-03-08T15:31:20.728 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-hyperv.ko 2023-03-08T15:31:20.728 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-icade.ko 2023-03-08T15:31:20.728 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-keytouch.ko 2023-03-08T15:31:20.728 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-kye.ko 2023-03-08T15:31:20.728 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-lcpower.ko 2023-03-08T15:31:20.728 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-led.ko 2023-03-08T15:31:20.728 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-lenovo.ko 2023-03-08T15:31:20.728 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-logitech-dj.ko 2023-03-08T15:31:20.729 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-03-08T15:31:20.729 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-multitouch.ko 2023-03-08T15:31:20.729 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-ortek.ko 2023-03-08T15:31:20.729 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-penmount.ko 2023-03-08T15:31:20.730 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-petalynx.ko 2023-03-08T15:31:20.730 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-picolcd.ko 2023-03-08T15:31:20.730 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-pl.ko 2023-03-08T15:31:20.730 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-plantronics.ko 2023-03-08T15:31:20.730 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-primax.ko 2023-03-08T15:31:20.730 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-rmi.ko 2023-03-08T15:31:20.730 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-03-08T15:31:20.731 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-common.ko 2023-03-08T15:31:20.731 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-isku.ko 2023-03-08T15:31:20.731 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-kone.ko 2023-03-08T15:31:20.731 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-03-08T15:31:20.731 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-03-08T15:31:20.731 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-03-08T15:31:20.731 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-lua.ko 2023-03-08T15:31:20.731 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-03-08T15:31:20.732 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-03-08T15:31:20.732 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat-savu.ko 2023-03-08T15:31:20.732 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-roccat.ko 2023-03-08T15:31:20.732 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-saitek.ko 2023-03-08T15:31:20.733 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-samsung.ko 2023-03-08T15:31:20.733 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-sensor-hub.ko 2023-03-08T15:31:20.733 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-sjoy.ko 2023-03-08T15:31:20.733 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-sony.ko 2023-03-08T15:31:20.733 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-speedlink.ko 2023-03-08T15:31:20.733 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-steelseries.ko 2023-03-08T15:31:20.733 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-sunplus.ko 2023-03-08T15:31:20.733 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-thrustmaster.ko 2023-03-08T15:31:20.734 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-tivo.ko 2023-03-08T15:31:20.734 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-tmff.ko 2023-03-08T15:31:20.734 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-topseed.ko 2023-03-08T15:31:20.734 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-twinhan.ko 2023-03-08T15:31:20.734 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-uclogic.ko 2023-03-08T15:31:20.734 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-waltop.ko 2023-03-08T15:31:20.734 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-wiimote.ko 2023-03-08T15:31:20.735 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-xinmo.ko 2023-03-08T15:31:20.735 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-zpff.ko 2023-03-08T15:31:20.735 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/hid-zydacron.ko 2023-03-08T15:31:20.735 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/uhid.ko 2023-03-08T15:31:20.735 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hid/wacom.ko 2023-03-08T15:31:20.735 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hv 2023-03-08T15:31:20.735 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hv/hv_balloon.ko 2023-03-08T15:31:20.736 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hv/hv_utils.ko 2023-03-08T15:31:20.736 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hv/hv_vmbus.ko 2023-03-08T15:31:20.736 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon 2023-03-08T15:31:20.736 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/abituguru.ko 2023-03-08T15:31:20.736 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/abituguru3.ko 2023-03-08T15:31:20.736 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-03-08T15:31:20.736 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ad7414.ko 2023-03-08T15:31:20.737 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ad7418.ko 2023-03-08T15:31:20.737 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adc128d818.ko 2023-03-08T15:31:20.737 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adm1025.ko 2023-03-08T15:31:20.737 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adm1026.ko 2023-03-08T15:31:20.737 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adm1029.ko 2023-03-08T15:31:20.738 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adm1031.ko 2023-03-08T15:31:20.739 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adm9240.ko 2023-03-08T15:31:20.739 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ads7828.ko 2023-03-08T15:31:20.739 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adt7410.ko 2023-03-08T15:31:20.739 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adt7411.ko 2023-03-08T15:31:20.739 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adt7462.ko 2023-03-08T15:31:20.739 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adt7470.ko 2023-03-08T15:31:20.740 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adt7475.ko 2023-03-08T15:31:20.740 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/adt7x10.ko 2023-03-08T15:31:20.740 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/amc6821.ko 2023-03-08T15:31:20.740 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/applesmc.ko 2023-03-08T15:31:20.740 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/asb100.ko 2023-03-08T15:31:20.740 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/asc7621.ko 2023-03-08T15:31:20.741 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/asus_atk0110.ko 2023-03-08T15:31:20.741 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/atxp1.ko 2023-03-08T15:31:20.741 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/coretemp.ko 2023-03-08T15:31:20.741 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-03-08T15:31:20.741 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/dme1737.ko 2023-03-08T15:31:20.741 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ds1621.ko 2023-03-08T15:31:20.741 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ds620.ko 2023-03-08T15:31:20.742 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/emc1403.ko 2023-03-08T15:31:20.742 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/emc6w201.ko 2023-03-08T15:31:20.742 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/f71805f.ko 2023-03-08T15:31:20.742 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/f71882fg.ko 2023-03-08T15:31:20.742 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/f75375s.ko 2023-03-08T15:31:20.742 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/fam15h_power.ko 2023-03-08T15:31:20.742 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/fschmd.ko 2023-03-08T15:31:20.743 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/g760a.ko 2023-03-08T15:31:20.743 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/g762.ko 2023-03-08T15:31:20.743 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/gl518sm.ko 2023-03-08T15:31:20.743 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/gl520sm.ko 2023-03-08T15:31:20.743 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/hwmon-vid.ko 2023-03-08T15:31:20.743 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/i5500_temp.ko 2023-03-08T15:31:20.743 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/i5k_amb.ko 2023-03-08T15:31:20.744 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ibmaem.ko 2023-03-08T15:31:20.744 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ibmpex.ko 2023-03-08T15:31:20.744 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ina209.ko 2023-03-08T15:31:20.744 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ina2xx.ko 2023-03-08T15:31:20.744 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/it87.ko 2023-03-08T15:31:20.744 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/k10temp.ko 2023-03-08T15:31:20.744 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/k8temp.ko 2023-03-08T15:31:20.744 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lineage-pem.ko 2023-03-08T15:31:20.745 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm63.ko 2023-03-08T15:31:20.745 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm73.ko 2023-03-08T15:31:20.745 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm75.ko 2023-03-08T15:31:20.745 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm77.ko 2023-03-08T15:31:20.745 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm78.ko 2023-03-08T15:31:20.745 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm80.ko 2023-03-08T15:31:20.745 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm83.ko 2023-03-08T15:31:20.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm85.ko 2023-03-08T15:31:20.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm87.ko 2023-03-08T15:31:20.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm90.ko 2023-03-08T15:31:20.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm92.ko 2023-03-08T15:31:20.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm93.ko 2023-03-08T15:31:20.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm95234.ko 2023-03-08T15:31:20.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm95241.ko 2023-03-08T15:31:20.746 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/lm95245.ko 2023-03-08T15:31:20.747 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ltc2945.ko 2023-03-08T15:31:20.747 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ltc4151.ko 2023-03-08T15:31:20.747 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ltc4215.ko 2023-03-08T15:31:20.747 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ltc4222.ko 2023-03-08T15:31:20.747 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ltc4245.ko 2023-03-08T15:31:20.747 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ltc4260.ko 2023-03-08T15:31:20.748 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/ltc4261.ko 2023-03-08T15:31:20.748 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/max16065.ko 2023-03-08T15:31:20.748 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/max1619.ko 2023-03-08T15:31:20.748 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/max1668.ko 2023-03-08T15:31:20.748 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/max197.ko 2023-03-08T15:31:20.748 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/max6639.ko 2023-03-08T15:31:20.748 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/max6650.ko 2023-03-08T15:31:20.748 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/max6697.ko 2023-03-08T15:31:20.749 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/mcp3021.ko 2023-03-08T15:31:20.749 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/nct6683.ko 2023-03-08T15:31:20.749 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/nct6775-core.ko 2023-03-08T15:31:20.749 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/nct6775.ko 2023-03-08T15:31:20.749 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/nct7802.ko 2023-03-08T15:31:20.749 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pc87360.ko 2023-03-08T15:31:20.750 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pc87427.ko 2023-03-08T15:31:20.750 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pcf8591.ko 2023-03-08T15:31:20.750 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus 2023-03-08T15:31:20.750 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-03-08T15:31:20.750 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-03-08T15:31:20.750 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-03-08T15:31:20.751 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-03-08T15:31:20.751 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-03-08T15:31:20.751 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-03-08T15:31:20.751 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-03-08T15:31:20.751 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-03-08T15:31:20.751 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-03-08T15:31:20.751 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-03-08T15:31:20.752 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-03-08T15:31:20.752 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-03-08T15:31:20.752 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/powr1220.ko 2023-03-08T15:31:20.752 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/sch5627.ko 2023-03-08T15:31:20.752 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/sch5636.ko 2023-03-08T15:31:20.752 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/sch56xx-common.ko 2023-03-08T15:31:20.752 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/sht15.ko 2023-03-08T15:31:20.753 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/sht21.ko 2023-03-08T15:31:20.753 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/shtc1.ko 2023-03-08T15:31:20.753 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/sis5595.ko 2023-03-08T15:31:20.754 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/smsc47b397.ko 2023-03-08T15:31:20.754 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/smsc47m1.ko 2023-03-08T15:31:20.754 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/smsc47m192.ko 2023-03-08T15:31:20.754 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/thmc50.ko 2023-03-08T15:31:20.754 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/tmp102.ko 2023-03-08T15:31:20.754 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/tmp103.ko 2023-03-08T15:31:20.754 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/tmp401.ko 2023-03-08T15:31:20.755 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/tmp421.ko 2023-03-08T15:31:20.755 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/via-cputemp.ko 2023-03-08T15:31:20.755 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/via686a.ko 2023-03-08T15:31:20.755 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/vt1211.ko 2023-03-08T15:31:20.755 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/vt8231.ko 2023-03-08T15:31:20.755 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83627ehf.ko 2023-03-08T15:31:20.755 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83627hf.ko 2023-03-08T15:31:20.756 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83781d.ko 2023-03-08T15:31:20.756 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83791d.ko 2023-03-08T15:31:20.756 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83792d.ko 2023-03-08T15:31:20.756 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83793.ko 2023-03-08T15:31:20.756 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83795.ko 2023-03-08T15:31:20.756 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83l785ts.ko 2023-03-08T15:31:20.756 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/hwmon/w83l786ng.ko 2023-03-08T15:31:20.757 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c 2023-03-08T15:31:20.757 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/algos 2023-03-08T15:31:20.757 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-03-08T15:31:20.757 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-03-08T15:31:20.757 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses 2023-03-08T15:31:20.757 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-03-08T15:31:20.757 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-03-08T15:31:20.758 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-03-08T15:31:20.758 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-03-08T15:31:20.758 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-03-08T15:31:20.758 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-03-08T15:31:20.758 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-03-08T15:31:20.758 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-03-08T15:31:20.758 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-03-08T15:31:20.759 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-03-08T15:31:20.759 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-03-08T15:31:20.759 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-03-08T15:31:20.759 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-03-08T15:31:20.759 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-03-08T15:31:20.759 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-03-08T15:31:20.759 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-03-08T15:31:20.760 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-03-08T15:31:20.760 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-03-08T15:31:20.760 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-03-08T15:31:20.760 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-03-08T15:31:20.760 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-via.ko 2023-03-08T15:31:20.760 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-03-08T15:31:20.760 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-03-08T15:31:20.760 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/i2c-dev.ko 2023-03-08T15:31:20.761 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/i2c-mux.ko 2023-03-08T15:31:20.761 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-03-08T15:31:20.761 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/i2c-smbus.ko 2023-03-08T15:31:20.761 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/i2c/i2c-stub.ko 2023-03-08T15:31:20.761 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband 2023-03-08T15:31:20.761 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core 2023-03-08T15:31:20.761 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core/ib_cm.ko 2023-03-08T15:31:20.761 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core/ib_core.ko 2023-03-08T15:31:20.762 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core/ib_umad.ko 2023-03-08T15:31:20.762 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-03-08T15:31:20.762 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core/iw_cm.ko 2023-03-08T15:31:20.762 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-03-08T15:31:20.762 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-03-08T15:31:20.762 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw 2023-03-08T15:31:20.762 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/cxgb4 2023-03-08T15:31:20.763 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-03-08T15:31:20.763 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/mlx4 2023-03-08T15:31:20.763 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-03-08T15:31:20.763 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/mlx5 2023-03-08T15:31:20.763 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-03-08T15:31:20.763 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/mthca 2023-03-08T15:31:20.763 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-03-08T15:31:20.763 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp 2023-03-08T15:31:20.764 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/ipoib 2023-03-08T15:31:20.764 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-03-08T15:31:20.764 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/iser 2023-03-08T15:31:20.764 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-03-08T15:31:20.764 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/isert 2023-03-08T15:31:20.764 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-03-08T15:31:20.764 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/srp 2023-03-08T15:31:20.764 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-03-08T15:31:20.765 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/srpt 2023-03-08T15:31:20.765 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-03-08T15:31:20.765 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input 2023-03-08T15:31:20.765 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/gameport 2023-03-08T15:31:20.765 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-03-08T15:31:20.765 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/gameport/fm801-gp.ko 2023-03-08T15:31:20.765 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/gameport/gameport.ko 2023-03-08T15:31:20.766 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/gameport/lightning.ko 2023-03-08T15:31:20.766 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/gameport/ns558.ko 2023-03-08T15:31:20.766 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/joydev.ko 2023-03-08T15:31:20.766 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard 2023-03-08T15:31:20.766 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-03-08T15:31:20.766 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse 2023-03-08T15:31:20.766 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/appletouch.ko 2023-03-08T15:31:20.766 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/bcm5974.ko 2023-03-08T15:31:20.767 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/cyapatp.ko 2023-03-08T15:31:20.767 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/elan_i2c.ko 2023-03-08T15:31:20.767 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/sermouse.ko 2023-03-08T15:31:20.767 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-03-08T15:31:20.767 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-03-08T15:31:20.767 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-03-08T15:31:20.767 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/rmi4 2023-03-08T15:31:20.767 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/rmi4/rmi_core.ko 2023-03-08T15:31:20.768 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/serio 2023-03-08T15:31:20.768 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/serio/altera_ps2.ko 2023-03-08T15:31:20.768 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/serio/arc_ps2.ko 2023-03-08T15:31:20.768 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-03-08T15:31:20.768 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/serio/serio_raw.ko 2023-03-08T15:31:20.768 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/input/sparse-keymap.ko 2023-03-08T15:31:20.768 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/iommu 2023-03-08T15:31:20.769 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/iommu/amd 2023-03-08T15:31:20.769 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-03-08T15:31:20.769 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds 2023-03-08T15:31:20.769 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-blinkm.ko 2023-03-08T15:31:20.769 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-lm3530.ko 2023-03-08T15:31:20.769 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-lp3944.ko 2023-03-08T15:31:20.769 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/leds-ss4200.ko 2023-03-08T15:31:20.770 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger 2023-03-08T15:31:20.770 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-03-08T15:31:20.770 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-03-08T15:31:20.770 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-03-08T15:31:20.770 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-03-08T15:31:20.770 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-03-08T15:31:20.770 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-03-08T15:31:20.771 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-03-08T15:31:20.771 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-03-08T15:31:20.771 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-03-08T15:31:20.771 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md 2023-03-08T15:31:20.771 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/bcache 2023-03-08T15:31:20.772 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/bcache/bcache.ko 2023-03-08T15:31:20.772 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-bio-prison.ko 2023-03-08T15:31:20.772 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-cache-smq.ko 2023-03-08T15:31:20.772 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-cache.ko 2023-03-08T15:31:20.772 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-crypt.ko 2023-03-08T15:31:20.772 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-delay.ko 2023-03-08T15:31:20.772 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-flakey.ko 2023-03-08T15:31:20.773 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-log-userspace.ko 2023-03-08T15:31:20.773 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-multipath.ko 2023-03-08T15:31:20.773 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-queue-length.ko 2023-03-08T15:31:20.773 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-raid.ko 2023-03-08T15:31:20.773 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-round-robin.ko 2023-03-08T15:31:20.773 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-service-time.ko 2023-03-08T15:31:20.773 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-switch.ko 2023-03-08T15:31:20.773 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-thin-pool.ko 2023-03-08T15:31:20.774 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/dm-verity.ko 2023-03-08T15:31:20.774 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/faulty.ko 2023-03-08T15:31:20.774 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/linear.ko 2023-03-08T15:31:20.774 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/multipath.ko 2023-03-08T15:31:20.774 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/persistent-data 2023-03-08T15:31:20.774 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-03-08T15:31:20.774 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/raid0.ko 2023-03-08T15:31:20.775 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/raid1.ko 2023-03-08T15:31:20.775 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/raid10.ko 2023-03-08T15:31:20.775 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/md/raid456.ko 2023-03-08T15:31:20.775 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message 2023-03-08T15:31:20.775 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion 2023-03-08T15:31:20.775 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion/mptbase.ko 2023-03-08T15:31:20.775 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion/mptctl.ko 2023-03-08T15:31:20.776 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion/mptfc.ko 2023-03-08T15:31:20.776 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion/mptlan.ko 2023-03-08T15:31:20.776 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion/mptsas.ko 2023-03-08T15:31:20.776 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion/mptscsih.ko 2023-03-08T15:31:20.776 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/message/fusion/mptspi.ko 2023-03-08T15:31:20.776 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd 2023-03-08T15:31:20.776 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/lpc_ich.ko 2023-03-08T15:31:20.776 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/lpc_sch.ko 2023-03-08T15:31:20.777 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/mfd-core.ko 2023-03-08T15:31:20.777 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/sm501.ko 2023-03-08T15:31:20.777 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/viperboard.ko 2023-03-08T15:31:20.777 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/vx855.ko 2023-03-08T15:31:20.777 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/mfd/wl1273-core.ko 2023-03-08T15:31:20.777 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc 2023-03-08T15:31:20.777 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/altera-stapl 2023-03-08T15:31:20.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-03-08T15:31:20.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/apds9802als.ko 2023-03-08T15:31:20.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/apds990x.ko 2023-03-08T15:31:20.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/bh1770glc.ko 2023-03-08T15:31:20.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/cb710 2023-03-08T15:31:20.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/cb710/cb710.ko 2023-03-08T15:31:20.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/eeprom 2023-03-08T15:31:20.778 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/eeprom/at24.ko 2023-03-08T15:31:20.779 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/eeprom/eeprom.ko 2023-03-08T15:31:20.779 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-03-08T15:31:20.779 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/eeprom/max6875.ko 2023-03-08T15:31:20.779 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/enclosure.ko 2023-03-08T15:31:20.779 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/hpilo.ko 2023-03-08T15:31:20.779 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/isl29003.ko 2023-03-08T15:31:20.779 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/isl29020.ko 2023-03-08T15:31:20.780 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/lis3lv02d 2023-03-08T15:31:20.780 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-03-08T15:31:20.780 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-03-08T15:31:20.780 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/mei 2023-03-08T15:31:20.780 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/mei/mei-me.ko 2023-03-08T15:31:20.780 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/mei/mei-txe.ko 2023-03-08T15:31:20.780 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/mei/mei.ko 2023-03-08T15:31:20.780 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/sgi-gru 2023-03-08T15:31:20.781 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/sgi-gru/gru.ko 2023-03-08T15:31:20.781 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/sgi-xp 2023-03-08T15:31:20.781 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/sgi-xp/xp.ko 2023-03-08T15:31:20.781 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-03-08T15:31:20.781 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-03-08T15:31:20.781 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/tifm_7xx1.ko 2023-03-08T15:31:20.781 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/tifm_core.ko 2023-03-08T15:31:20.781 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/tsl2550.ko 2023-03-08T15:31:20.782 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/vmw_balloon.ko 2023-03-08T15:31:20.782 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/vmw_vmci 2023-03-08T15:31:20.782 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-03-08T15:31:20.782 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net 2023-03-08T15:31:20.782 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/bonding 2023-03-08T15:31:20.782 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/bonding/bonding.ko 2023-03-08T15:31:20.782 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dsa 2023-03-08T15:31:20.783 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dsa/b53 2023-03-08T15:31:20.783 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-03-08T15:31:20.783 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-03-08T15:31:20.783 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dsa/mv88e6060.ko 2023-03-08T15:31:20.783 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dsa/mv88e6xxx 2023-03-08T15:31:20.783 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-03-08T15:31:20.783 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/dummy.ko 2023-03-08T15:31:20.783 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/eql.ko 2023-03-08T15:31:20.784 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet 2023-03-08T15:31:20.784 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/3com 2023-03-08T15:31:20.784 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-03-08T15:31:20.784 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-03-08T15:31:20.784 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-03-08T15:31:20.784 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-03-08T15:31:20.784 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/8390 2023-03-08T15:31:20.785 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/8390/8390.ko 2023-03-08T15:31:20.785 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-03-08T15:31:20.785 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-03-08T15:31:20.785 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-03-08T15:31:20.785 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/adaptec 2023-03-08T15:31:20.785 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-03-08T15:31:20.785 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/agere 2023-03-08T15:31:20.786 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-03-08T15:31:20.786 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/alteon 2023-03-08T15:31:20.786 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-03-08T15:31:20.786 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/altera 2023-03-08T15:31:20.786 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-03-08T15:31:20.786 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/amd 2023-03-08T15:31:20.786 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-03-08T15:31:20.787 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-03-08T15:31:20.787 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-03-08T15:31:20.787 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros 2023-03-08T15:31:20.787 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/alx 2023-03-08T15:31:20.787 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-03-08T15:31:20.787 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/atl1c 2023-03-08T15:31:20.788 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-03-08T15:31:20.788 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/atl1e 2023-03-08T15:31:20.788 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-03-08T15:31:20.788 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/atlx 2023-03-08T15:31:20.788 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-03-08T15:31:20.788 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-03-08T15:31:20.788 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom 2023-03-08T15:31:20.789 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-03-08T15:31:20.789 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-03-08T15:31:20.789 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-03-08T15:31:20.789 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-03-08T15:31:20.789 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-03-08T15:31:20.789 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/genet 2023-03-08T15:31:20.789 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-03-08T15:31:20.790 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-03-08T15:31:20.790 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/brocade 2023-03-08T15:31:20.790 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/brocade/bna 2023-03-08T15:31:20.790 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-03-08T15:31:20.790 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio 2023-03-08T15:31:20.790 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-03-08T15:31:20.790 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-03-08T15:31:20.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-03-08T15:31:20.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-03-08T15:31:20.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-03-08T15:31:20.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-03-08T15:31:20.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-03-08T15:31:20.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-03-08T15:31:20.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-03-08T15:31:20.791 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-03-08T15:31:20.792 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/cisco 2023-03-08T15:31:20.792 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/cisco/enic 2023-03-08T15:31:20.792 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-03-08T15:31:20.792 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec 2023-03-08T15:31:20.792 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec/tulip 2023-03-08T15:31:20.792 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-03-08T15:31:20.792 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-03-08T15:31:20.793 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-03-08T15:31:20.793 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-03-08T15:31:20.793 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-03-08T15:31:20.793 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-03-08T15:31:20.793 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dlink 2023-03-08T15:31:20.793 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-03-08T15:31:20.794 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-03-08T15:31:20.794 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/dnet.ko 2023-03-08T15:31:20.794 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/emulex 2023-03-08T15:31:20.794 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/emulex/benet 2023-03-08T15:31:20.794 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-03-08T15:31:20.794 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/ethoc.ko 2023-03-08T15:31:20.794 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel 2023-03-08T15:31:20.795 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/e100.ko 2023-03-08T15:31:20.795 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/e1000 2023-03-08T15:31:20.795 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-03-08T15:31:20.795 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/e1000e 2023-03-08T15:31:20.795 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-03-08T15:31:20.795 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/fm10k 2023-03-08T15:31:20.795 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-03-08T15:31:20.796 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/i40e 2023-03-08T15:31:20.796 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-03-08T15:31:20.796 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/iavf 2023-03-08T15:31:20.796 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-03-08T15:31:20.796 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/igb 2023-03-08T15:31:20.797 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-03-08T15:31:20.797 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/igbvf 2023-03-08T15:31:20.797 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-03-08T15:31:20.797 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/ixgb 2023-03-08T15:31:20.797 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-03-08T15:31:20.797 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/ixgbe 2023-03-08T15:31:20.798 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-03-08T15:31:20.798 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-03-08T15:31:20.798 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-03-08T15:31:20.798 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/jme.ko 2023-03-08T15:31:20.798 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/marvell 2023-03-08T15:31:20.798 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-03-08T15:31:20.798 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-03-08T15:31:20.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-03-08T15:31:20.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/mellanox 2023-03-08T15:31:20.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-03-08T15:31:20.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-03-08T15:31:20.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-03-08T15:31:20.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-03-08T15:31:20.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-03-08T15:31:20.799 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-03-08T15:31:20.800 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/micrel 2023-03-08T15:31:20.800 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-03-08T15:31:20.800 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/myricom 2023-03-08T15:31:20.800 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-03-08T15:31:20.800 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-03-08T15:31:20.800 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/natsemi 2023-03-08T15:31:20.800 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-03-08T15:31:20.800 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-03-08T15:31:20.801 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/neterion 2023-03-08T15:31:20.801 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-03-08T15:31:20.801 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/nvidia 2023-03-08T15:31:20.801 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-03-08T15:31:20.801 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/packetengines 2023-03-08T15:31:20.801 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-03-08T15:31:20.801 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-03-08T15:31:20.802 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/qlogic 2023-03-08T15:31:20.802 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/qlogic/netxen 2023-03-08T15:31:20.802 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-03-08T15:31:20.802 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-03-08T15:31:20.802 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-03-08T15:31:20.802 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-03-08T15:31:20.802 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/rdc 2023-03-08T15:31:20.803 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-03-08T15:31:20.803 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/realtek 2023-03-08T15:31:20.803 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-03-08T15:31:20.803 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-03-08T15:31:20.803 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-03-08T15:31:20.803 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-03-08T15:31:20.803 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/rocker 2023-03-08T15:31:20.804 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-03-08T15:31:20.804 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sfc 2023-03-08T15:31:20.804 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-03-08T15:31:20.804 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/silan 2023-03-08T15:31:20.804 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-03-08T15:31:20.804 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sis 2023-03-08T15:31:20.804 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-03-08T15:31:20.804 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-03-08T15:31:20.805 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/smsc 2023-03-08T15:31:20.805 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-03-08T15:31:20.805 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-03-08T15:31:20.805 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-03-08T15:31:20.805 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-03-08T15:31:20.805 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/stmicro 2023-03-08T15:31:20.805 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-03-08T15:31:20.806 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-03-08T15:31:20.806 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-03-08T15:31:20.806 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sun 2023-03-08T15:31:20.806 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-03-08T15:31:20.806 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sun/niu.ko 2023-03-08T15:31:20.807 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-03-08T15:31:20.807 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-03-08T15:31:20.807 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/tehuti 2023-03-08T15:31:20.807 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-03-08T15:31:20.807 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/ti 2023-03-08T15:31:20.807 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-03-08T15:31:20.807 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/via 2023-03-08T15:31:20.808 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-03-08T15:31:20.808 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-03-08T15:31:20.808 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/wiznet 2023-03-08T15:31:20.808 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-03-08T15:31:20.808 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-03-08T15:31:20.808 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/xircom 2023-03-08T15:31:20.809 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-03-08T15:31:20.809 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/geneve.ko 2023-03-08T15:31:20.809 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/hyperv 2023-03-08T15:31:20.809 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-03-08T15:31:20.809 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ieee802154 2023-03-08T15:31:20.810 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ieee802154/fakelb.ko 2023-03-08T15:31:20.810 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ifb.ko 2023-03-08T15:31:20.810 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ipvlan 2023-03-08T15:31:20.810 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-03-08T15:31:20.810 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/macvlan.ko 2023-03-08T15:31:20.811 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/macvtap.ko 2023-03-08T15:31:20.811 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/mdio 2023-03-08T15:31:20.811 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/mdio.ko 2023-03-08T15:31:20.811 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-03-08T15:31:20.811 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-03-08T15:31:20.811 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/mii.ko 2023-03-08T15:31:20.812 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/net_failover.ko 2023-03-08T15:31:20.812 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/netconsole.ko 2023-03-08T15:31:20.812 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/nlmon.ko 2023-03-08T15:31:20.812 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/pcs 2023-03-08T15:31:20.812 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-03-08T15:31:20.813 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-03-08T15:31:20.813 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy 2023-03-08T15:31:20.813 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/amd.ko 2023-03-08T15:31:20.813 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-03-08T15:31:20.813 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-03-08T15:31:20.814 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/bcm7xxx.ko 2023-03-08T15:31:20.814 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/bcm87xx.ko 2023-03-08T15:31:20.814 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/broadcom.ko 2023-03-08T15:31:20.814 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/cicada.ko 2023-03-08T15:31:20.814 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/davicom.ko 2023-03-08T15:31:20.814 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/dp83640.ko 2023-03-08T15:31:20.815 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/et1011c.ko 2023-03-08T15:31:20.815 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/icplus.ko 2023-03-08T15:31:20.815 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/lxt.ko 2023-03-08T15:31:20.815 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/marvell.ko 2023-03-08T15:31:20.815 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/micrel.ko 2023-03-08T15:31:20.815 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/national.ko 2023-03-08T15:31:20.815 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/phylink.ko 2023-03-08T15:31:20.816 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/qsemi.ko 2023-03-08T15:31:20.816 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/realtek.ko 2023-03-08T15:31:20.816 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/smsc.ko 2023-03-08T15:31:20.816 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/ste10Xp.ko 2023-03-08T15:31:20.816 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/phy/vitesse.ko 2023-03-08T15:31:20.817 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp 2023-03-08T15:31:20.817 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/bsd_comp.ko 2023-03-08T15:31:20.817 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/ppp_async.ko 2023-03-08T15:31:20.817 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-03-08T15:31:20.817 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/ppp_generic.ko 2023-03-08T15:31:20.817 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-03-08T15:31:20.817 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-03-08T15:31:20.818 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/pppoe.ko 2023-03-08T15:31:20.818 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/pppox.ko 2023-03-08T15:31:20.818 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/ppp/pptp.ko 2023-03-08T15:31:20.818 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/slip 2023-03-08T15:31:20.818 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/slip/slhc.ko 2023-03-08T15:31:20.818 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/slip/slip.ko 2023-03-08T15:31:20.818 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/sungem_phy.ko 2023-03-08T15:31:20.818 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/tap.ko 2023-03-08T15:31:20.819 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/team 2023-03-08T15:31:20.819 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/team/team.ko 2023-03-08T15:31:20.819 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-03-08T15:31:20.819 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-03-08T15:31:20.819 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-03-08T15:31:20.819 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/team/team_mode_random.ko 2023-03-08T15:31:20.820 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-03-08T15:31:20.820 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/tun.ko 2023-03-08T15:31:20.820 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/veth.ko 2023-03-08T15:31:20.820 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/virtio_net.ko 2023-03-08T15:31:20.820 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/vmxnet3 2023-03-08T15:31:20.820 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-03-08T15:31:20.820 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/vxlan 2023-03-08T15:31:20.820 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/vxlan/vxlan.ko 2023-03-08T15:31:20.821 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/xen-netback 2023-03-08T15:31:20.821 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-03-08T15:31:20.821 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/net/xen-netfront.ko 2023-03-08T15:31:20.821 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ntb 2023-03-08T15:31:20.821 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ntb/ntb.ko 2023-03-08T15:31:20.821 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/nvme 2023-03-08T15:31:20.821 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/nvme/host 2023-03-08T15:31:20.822 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/nvme/host/nvme-core.ko 2023-03-08T15:31:20.822 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/nvme/host/nvme.ko 2023-03-08T15:31:20.822 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/parport 2023-03-08T15:31:20.822 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/parport/parport.ko 2023-03-08T15:31:20.822 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/parport/parport_cs.ko 2023-03-08T15:31:20.822 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/parport/parport_pc.ko 2023-03-08T15:31:20.822 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/parport/parport_serial.ko 2023-03-08T15:31:20.823 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pci 2023-03-08T15:31:20.823 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pci/hotplug 2023-03-08T15:31:20.823 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-03-08T15:31:20.823 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pci/pcie 2023-03-08T15:31:20.823 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pci/pcie/aer_inject.ko 2023-03-08T15:31:20.823 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pci/xen-pcifront.ko 2023-03-08T15:31:20.824 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pcmcia 2023-03-08T15:31:20.824 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pcmcia/i82092.ko 2023-03-08T15:31:20.824 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pcmcia/pd6729.ko 2023-03-08T15:31:20.824 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pcmcia/yenta_socket.ko 2023-03-08T15:31:20.824 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pinctrl 2023-03-08T15:31:20.825 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pinctrl/intel 2023-03-08T15:31:20.825 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-03-08T15:31:20.825 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform 2023-03-08T15:31:20.825 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86 2023-03-08T15:31:20.825 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/acer-wmi.ko 2023-03-08T15:31:20.825 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/acerhdf.ko 2023-03-08T15:31:20.826 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/apple-gmux.ko 2023-03-08T15:31:20.826 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/asus-laptop.ko 2023-03-08T15:31:20.826 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-03-08T15:31:20.826 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/asus-wmi.ko 2023-03-08T15:31:20.826 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-03-08T15:31:20.826 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-03-08T15:31:20.826 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-03-08T15:31:20.827 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-03-08T15:31:20.827 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-03-08T15:31:20.827 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/hdaps.ko 2023-03-08T15:31:20.827 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/intel 2023-03-08T15:31:20.827 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-03-08T15:31:20.827 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/intel_ips.ko 2023-03-08T15:31:20.827 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/msi-wmi.ko 2023-03-08T15:31:20.827 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-03-08T15:31:20.828 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-03-08T15:31:20.828 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-03-08T15:31:20.828 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/samsung-q10.ko 2023-03-08T15:31:20.828 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-03-08T15:31:20.828 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-03-08T15:31:20.829 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-03-08T15:31:20.829 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-03-08T15:31:20.829 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/platform/x86/wmi.ko 2023-03-08T15:31:20.829 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/powercap 2023-03-08T15:31:20.829 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/powercap/intel_rapl_common.ko 2023-03-08T15:31:20.829 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-03-08T15:31:20.830 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pps 2023-03-08T15:31:20.830 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pps/clients 2023-03-08T15:31:20.830 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pps/clients/pps-gpio.ko 2023-03-08T15:31:20.830 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-03-08T15:31:20.830 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pps/clients/pps_parport.ko 2023-03-08T15:31:20.830 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/pps/pps_core.ko 2023-03-08T15:31:20.830 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ptp 2023-03-08T15:31:20.830 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ptp/ptp.ko 2023-03-08T15:31:20.831 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ptp/ptp_kvm.ko 2023-03-08T15:31:20.831 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc 2023-03-08T15:31:20.831 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-bq32k.ko 2023-03-08T15:31:20.831 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-bq4802.ko 2023-03-08T15:31:20.831 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds1286.ko 2023-03-08T15:31:20.832 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds1307.ko 2023-03-08T15:31:20.832 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds1374.ko 2023-03-08T15:31:20.832 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds1511.ko 2023-03-08T15:31:20.832 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds1553.ko 2023-03-08T15:31:20.832 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds1672.ko 2023-03-08T15:31:20.832 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds1742.ko 2023-03-08T15:31:20.832 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds2404.ko 2023-03-08T15:31:20.832 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-ds3232.ko 2023-03-08T15:31:20.833 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-em3027.ko 2023-03-08T15:31:20.833 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-fm3130.ko 2023-03-08T15:31:20.833 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-isl12022.ko 2023-03-08T15:31:20.833 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-isl1208.ko 2023-03-08T15:31:20.833 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-m41t80.ko 2023-03-08T15:31:20.833 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-m48t35.ko 2023-03-08T15:31:20.833 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-m48t59.ko 2023-03-08T15:31:20.834 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-max6900.ko 2023-03-08T15:31:20.834 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-msm6242.ko 2023-03-08T15:31:20.834 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-03-08T15:31:20.834 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-03-08T15:31:20.834 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-03-08T15:31:20.834 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-03-08T15:31:20.834 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-03-08T15:31:20.835 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-03-08T15:31:20.835 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-03-08T15:31:20.835 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-03-08T15:31:20.835 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-rx8025.ko 2023-03-08T15:31:20.835 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-rx8581.ko 2023-03-08T15:31:20.835 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-03-08T15:31:20.835 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-v3020.ko 2023-03-08T15:31:20.836 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/rtc/rtc-x1205.ko 2023-03-08T15:31:20.836 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi 2023-03-08T15:31:20.836 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/3w-9xxx.ko 2023-03-08T15:31:20.836 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/3w-sas.ko 2023-03-08T15:31:20.836 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/3w-xxxx.ko 2023-03-08T15:31:20.836 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/BusLogic.ko 2023-03-08T15:31:20.836 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/a100u2w.ko 2023-03-08T15:31:20.837 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/aacraid 2023-03-08T15:31:20.837 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-03-08T15:31:20.837 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/advansys.ko 2023-03-08T15:31:20.837 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/aic7xxx 2023-03-08T15:31:20.837 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-03-08T15:31:20.837 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-03-08T15:31:20.837 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/am53c974.ko 2023-03-08T15:31:20.838 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/arcmsr 2023-03-08T15:31:20.838 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-03-08T15:31:20.838 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/atp870u.ko 2023-03-08T15:31:20.838 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/be2iscsi 2023-03-08T15:31:20.838 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-03-08T15:31:20.838 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/bfa 2023-03-08T15:31:20.838 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/bfa/bfa.ko 2023-03-08T15:31:20.839 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/bnx2fc 2023-03-08T15:31:20.839 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-03-08T15:31:20.839 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/bnx2i 2023-03-08T15:31:20.839 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-03-08T15:31:20.839 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/ch.ko 2023-03-08T15:31:20.840 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/csiostor 2023-03-08T15:31:20.840 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-03-08T15:31:20.840 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/cxgbi 2023-03-08T15:31:20.840 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-03-08T15:31:20.840 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-03-08T15:31:20.840 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-03-08T15:31:20.841 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-03-08T15:31:20.841 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-03-08T15:31:20.841 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/dc395x.ko 2023-03-08T15:31:20.842 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/device_handler 2023-03-08T15:31:20.842 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-03-08T15:31:20.842 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-03-08T15:31:20.843 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-03-08T15:31:20.843 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-03-08T15:31:20.843 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/dmx3191d.ko 2023-03-08T15:31:20.843 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/esas2r 2023-03-08T15:31:20.843 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-03-08T15:31:20.844 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/esp_scsi.ko 2023-03-08T15:31:20.844 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/fcoe 2023-03-08T15:31:20.844 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-03-08T15:31:20.844 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-03-08T15:31:20.844 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/fnic 2023-03-08T15:31:20.844 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/fnic/fnic.ko 2023-03-08T15:31:20.844 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/hpsa.ko 2023-03-08T15:31:20.845 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/hptiop.ko 2023-03-08T15:31:20.845 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/hv_storvsc.ko 2023-03-08T15:31:20.845 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/initio.ko 2023-03-08T15:31:20.845 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/ipr.ko 2023-03-08T15:31:20.845 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/ips.ko 2023-03-08T15:31:20.845 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/isci 2023-03-08T15:31:20.845 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/isci/isci.ko 2023-03-08T15:31:20.845 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-03-08T15:31:20.846 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/iscsi_tcp.ko 2023-03-08T15:31:20.846 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/libfc 2023-03-08T15:31:20.846 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/libfc/libfc.ko 2023-03-08T15:31:20.846 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/libiscsi.ko 2023-03-08T15:31:20.846 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-03-08T15:31:20.846 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/libsas 2023-03-08T15:31:20.846 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/libsas/libsas.ko 2023-03-08T15:31:20.847 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/lpfc 2023-03-08T15:31:20.847 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-03-08T15:31:20.847 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/megaraid 2023-03-08T15:31:20.847 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/megaraid.ko 2023-03-08T15:31:20.847 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-03-08T15:31:20.847 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-03-08T15:31:20.847 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-03-08T15:31:20.847 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/mpt3sas 2023-03-08T15:31:20.848 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-03-08T15:31:20.848 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/mvsas 2023-03-08T15:31:20.848 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-03-08T15:31:20.848 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/mvumi.ko 2023-03-08T15:31:20.848 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/pm8001 2023-03-08T15:31:20.848 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-03-08T15:31:20.848 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/pmcraid.ko 2023-03-08T15:31:20.849 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/qla1280.ko 2023-03-08T15:31:20.849 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/qla2xxx 2023-03-08T15:31:20.849 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-03-08T15:31:20.849 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-03-08T15:31:20.849 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/qla4xxx 2023-03-08T15:31:20.849 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-03-08T15:31:20.849 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/raid_class.ko 2023-03-08T15:31:20.849 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/scsi_debug.ko 2023-03-08T15:31:20.850 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-03-08T15:31:20.850 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-03-08T15:31:20.850 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-03-08T15:31:20.850 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-03-08T15:31:20.850 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-03-08T15:31:20.850 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/ses.ko 2023-03-08T15:31:20.850 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/st.ko 2023-03-08T15:31:20.850 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/stex.ko 2023-03-08T15:31:20.851 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/sym53c8xx_2 2023-03-08T15:31:20.851 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-03-08T15:31:20.851 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/virtio_scsi.ko 2023-03-08T15:31:20.851 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-03-08T15:31:20.851 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/scsi/wd719x.ko 2023-03-08T15:31:20.851 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ssb 2023-03-08T15:31:20.851 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ssb/ssb.ko 2023-03-08T15:31:20.852 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target 2023-03-08T15:31:20.852 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/iscsi 2023-03-08T15:31:20.852 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-03-08T15:31:20.852 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/loopback 2023-03-08T15:31:20.852 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/loopback/tcm_loop.ko 2023-03-08T15:31:20.852 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/target_core_file.ko 2023-03-08T15:31:20.852 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/target_core_iblock.ko 2023-03-08T15:31:20.853 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/target_core_mod.ko 2023-03-08T15:31:20.853 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/target_core_pscsi.ko 2023-03-08T15:31:20.853 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/target_core_user.ko 2023-03-08T15:31:20.853 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/tcm_fc 2023-03-08T15:31:20.853 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-03-08T15:31:20.853 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal 2023-03-08T15:31:20.853 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel 2023-03-08T15:31:20.854 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal 2023-03-08T15:31:20.854 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-03-08T15:31:20.854 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-03-08T15:31:20.854 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-03-08T15:31:20.854 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-03-08T15:31:20.854 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-03-08T15:31:20.854 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-03-08T15:31:20.854 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-03-08T15:31:20.855 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-03-08T15:31:20.855 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-03-08T15:31:20.855 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-03-08T15:31:20.855 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-03-08T15:31:20.855 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-03-08T15:31:20.855 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-03-08T15:31:20.855 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-03-08T15:31:20.856 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-03-08T15:31:20.856 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty 2023-03-08T15:31:20.856 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/ipwireless 2023-03-08T15:31:20.856 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-03-08T15:31:20.856 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/n_gsm.ko 2023-03-08T15:31:20.856 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/n_hdlc.ko 2023-03-08T15:31:20.856 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/nozomi.ko 2023-03-08T15:31:20.856 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial 2023-03-08T15:31:20.857 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/8250 2023-03-08T15:31:20.857 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-03-08T15:31:20.857 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/arc_uart.ko 2023-03-08T15:31:20.857 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/jsm 2023-03-08T15:31:20.857 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-03-08T15:31:20.857 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/tty/synclink_gt.ko 2023-03-08T15:31:20.857 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ufs 2023-03-08T15:31:20.858 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ufs/core 2023-03-08T15:31:20.858 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-03-08T15:31:20.858 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ufs/host 2023-03-08T15:31:20.858 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-03-08T15:31:20.858 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio 2023-03-08T15:31:20.858 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio/uio.ko 2023-03-08T15:31:20.859 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio/uio_aec.ko 2023-03-08T15:31:20.859 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio/uio_cif.ko 2023-03-08T15:31:20.859 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio/uio_pci_generic.ko 2023-03-08T15:31:20.859 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/uio/uio_sercos3.ko 2023-03-08T15:31:20.859 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb 2023-03-08T15:31:20.859 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/class 2023-03-08T15:31:20.859 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/class/cdc-acm.ko 2023-03-08T15:31:20.860 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/class/cdc-wdm.ko 2023-03-08T15:31:20.860 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/class/usblp.ko 2023-03-08T15:31:20.860 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/class/usbtmc.ko 2023-03-08T15:31:20.860 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/host 2023-03-08T15:31:20.860 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/host/sl811-hcd.ko 2023-03-08T15:31:20.860 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/host/u132-hcd.ko 2023-03-08T15:31:20.860 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/image 2023-03-08T15:31:20.861 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/image/mdc800.ko 2023-03-08T15:31:20.861 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/image/microtek.ko 2023-03-08T15:31:20.861 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc 2023-03-08T15:31:20.861 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/adutux.ko 2023-03-08T15:31:20.861 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/appledisplay.ko 2023-03-08T15:31:20.861 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/emi26.ko 2023-03-08T15:31:20.861 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/emi62.ko 2023-03-08T15:31:20.862 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/ezusb.ko 2023-03-08T15:31:20.862 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/ftdi-elan.ko 2023-03-08T15:31:20.862 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/idmouse.ko 2023-03-08T15:31:20.862 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/iowarrior.ko 2023-03-08T15:31:20.862 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/isight_firmware.ko 2023-03-08T15:31:20.862 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/ldusb.ko 2023-03-08T15:31:20.862 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/legousbtower.ko 2023-03-08T15:31:20.862 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/sisusbvga 2023-03-08T15:31:20.863 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-03-08T15:31:20.863 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/trancevibrator.ko 2023-03-08T15:31:20.863 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/usb3503.ko 2023-03-08T15:31:20.863 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/usblcd.ko 2023-03-08T15:31:20.863 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/usbsevseg.ko 2023-03-08T15:31:20.863 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/uss720.ko 2023-03-08T15:31:20.863 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/misc/yurex.ko 2023-03-08T15:31:20.863 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/phy 2023-03-08T15:31:20.864 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/phy/phy-generic.ko 2023-03-08T15:31:20.864 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial 2023-03-08T15:31:20.864 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/aircable.ko 2023-03-08T15:31:20.864 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ark3116.ko 2023-03-08T15:31:20.864 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/belkin_sa.ko 2023-03-08T15:31:20.864 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ch341.ko 2023-03-08T15:31:20.865 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/cp210x.ko 2023-03-08T15:31:20.865 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/cyberjack.ko 2023-03-08T15:31:20.865 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/cypress_m8.ko 2023-03-08T15:31:20.866 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-03-08T15:31:20.866 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/empeg.ko 2023-03-08T15:31:20.866 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-03-08T15:31:20.866 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/garmin_gps.ko 2023-03-08T15:31:20.867 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/io_edgeport.ko 2023-03-08T15:31:20.867 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/io_ti.ko 2023-03-08T15:31:20.867 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ipaq.ko 2023-03-08T15:31:20.867 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ipw.ko 2023-03-08T15:31:20.867 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ir-usb.ko 2023-03-08T15:31:20.867 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-03-08T15:31:20.867 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/keyspan.ko 2023-03-08T15:31:20.867 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-03-08T15:31:20.868 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-03-08T15:31:20.868 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/kobil_sct.ko 2023-03-08T15:31:20.868 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/mct_u232.ko 2023-03-08T15:31:20.868 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/mos7720.ko 2023-03-08T15:31:20.868 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/mos7840.ko 2023-03-08T15:31:20.868 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/navman.ko 2023-03-08T15:31:20.868 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/omninet.ko 2023-03-08T15:31:20.869 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/opticon.ko 2023-03-08T15:31:20.869 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/option.ko 2023-03-08T15:31:20.869 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/oti6858.ko 2023-03-08T15:31:20.869 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/pl2303.ko 2023-03-08T15:31:20.869 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/qcaux.ko 2023-03-08T15:31:20.869 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/qcserial.ko 2023-03-08T15:31:20.869 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/quatech2.ko 2023-03-08T15:31:20.870 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/safe_serial.ko 2023-03-08T15:31:20.870 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/sierra.ko 2023-03-08T15:31:20.870 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/spcp8x5.ko 2023-03-08T15:31:20.870 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ssu100.ko 2023-03-08T15:31:20.870 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/symbolserial.ko 2023-03-08T15:31:20.870 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-03-08T15:31:20.870 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-03-08T15:31:20.870 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/usb_debug.ko 2023-03-08T15:31:20.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/usb_wwan.ko 2023-03-08T15:31:20.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/visor.ko 2023-03-08T15:31:20.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/whiteheat.ko 2023-03-08T15:31:20.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/serial/xsens_mt.ko 2023-03-08T15:31:20.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage 2023-03-08T15:31:20.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/uas.ko 2023-03-08T15:31:20.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-alauda.ko 2023-03-08T15:31:20.871 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-cypress.ko 2023-03-08T15:31:20.872 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-datafab.ko 2023-03-08T15:31:20.872 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-03-08T15:31:20.872 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-freecom.ko 2023-03-08T15:31:20.872 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-isd200.ko 2023-03-08T15:31:20.872 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-03-08T15:31:20.872 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-karma.ko 2023-03-08T15:31:20.873 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-03-08T15:31:20.873 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-realtek.ko 2023-03-08T15:31:20.873 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-03-08T15:31:20.873 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-03-08T15:31:20.874 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/ums-usbat.ko 2023-03-08T15:31:20.874 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/storage/usb-storage.ko 2023-03-08T15:31:20.874 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/usbip 2023-03-08T15:31:20.874 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/usbip/usbip-core.ko 2023-03-08T15:31:20.874 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/usbip/usbip-host.ko 2023-03-08T15:31:20.874 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-03-08T15:31:20.875 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vfio 2023-03-08T15:31:20.875 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vfio/pci 2023-03-08T15:31:20.875 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-03-08T15:31:20.875 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-03-08T15:31:20.875 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vfio/vfio.ko 2023-03-08T15:31:20.875 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-03-08T15:31:20.875 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vhost 2023-03-08T15:31:20.875 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vhost/vhost.ko 2023-03-08T15:31:20.876 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vhost/vhost_iotlb.ko 2023-03-08T15:31:20.876 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vhost/vhost_net.ko 2023-03-08T15:31:20.876 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/vhost/vhost_scsi.ko 2023-03-08T15:31:20.876 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video 2023-03-08T15:31:20.876 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight 2023-03-08T15:31:20.876 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/apple_bl.ko 2023-03-08T15:31:20.876 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/lcd.ko 2023-03-08T15:31:20.877 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/video/backlight/platform_lcd.ko 2023-03-08T15:31:20.877 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/virtio 2023-03-08T15:31:20.877 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/virtio/virtio.ko 2023-03-08T15:31:20.877 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/virtio/virtio_balloon.ko 2023-03-08T15:31:20.877 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/virtio/virtio_mmio.ko 2023-03-08T15:31:20.877 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/virtio/virtio_pci.ko 2023-03-08T15:31:20.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-03-08T15:31:20.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-03-08T15:31:20.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/virtio/virtio_ring.ko 2023-03-08T15:31:20.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1 2023-03-08T15:31:20.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/masters 2023-03-08T15:31:20.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/masters/ds1wm.ko 2023-03-08T15:31:20.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/masters/ds2482.ko 2023-03-08T15:31:20.878 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/masters/ds2490.ko 2023-03-08T15:31:20.879 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves 2023-03-08T15:31:20.879 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-03-08T15:31:20.879 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-03-08T15:31:20.879 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-03-08T15:31:20.879 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-03-08T15:31:20.879 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-03-08T15:31:20.879 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-03-08T15:31:20.879 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-03-08T15:31:20.880 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-03-08T15:31:20.880 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-03-08T15:31:20.880 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_smem.ko 2023-03-08T15:31:20.880 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/slaves/w1_therm.ko 2023-03-08T15:31:20.880 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/w1/wire.ko 2023-03-08T15:31:20.880 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog 2023-03-08T15:31:20.880 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-03-08T15:31:20.880 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-03-08T15:31:20.881 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-03-08T15:31:20.881 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/hpwdt.ko 2023-03-08T15:31:20.881 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/i6300esb.ko 2023-03-08T15:31:20.881 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-03-08T15:31:20.881 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-03-08T15:31:20.881 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/ib700wdt.ko 2023-03-08T15:31:20.881 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/ibmasr.ko 2023-03-08T15:31:20.882 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-03-08T15:31:20.882 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-03-08T15:31:20.882 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/it87_wdt.ko 2023-03-08T15:31:20.882 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/machzwd.ko 2023-03-08T15:31:20.882 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/nv_tco.ko 2023-03-08T15:31:20.882 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/pcwd_pci.ko 2023-03-08T15:31:20.882 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/pcwd_usb.ko 2023-03-08T15:31:20.882 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-03-08T15:31:20.883 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-03-08T15:31:20.883 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/softdog.ko 2023-03-08T15:31:20.883 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/sp5100_tco.ko 2023-03-08T15:31:20.883 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/via_wdt.ko 2023-03-08T15:31:20.883 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-03-08T15:31:20.884 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-03-08T15:31:20.884 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-03-08T15:31:20.884 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/wdt_pci.ko 2023-03-08T15:31:20.884 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/watchdog/xen_wdt.ko 2023-03-08T15:31:20.884 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen 2023-03-08T15:31:20.884 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xen-acpi-processor.ko 2023-03-08T15:31:20.884 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xen-evtchn.ko 2023-03-08T15:31:20.884 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xen-gntalloc.ko 2023-03-08T15:31:20.885 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xen-gntdev.ko 2023-03-08T15:31:20.885 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xen-pciback 2023-03-08T15:31:20.885 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-03-08T15:31:20.885 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xen-privcmd.ko 2023-03-08T15:31:20.885 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xenfs 2023-03-08T15:31:20.885 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/drivers/xen/xenfs/xenfs.ko 2023-03-08T15:31:20.885 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs 2023-03-08T15:31:20.886 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/9p 2023-03-08T15:31:20.886 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/9p/9p.ko 2023-03-08T15:31:20.886 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/affs 2023-03-08T15:31:20.886 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/affs/affs.ko 2023-03-08T15:31:20.886 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/befs 2023-03-08T15:31:20.886 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/befs/befs.ko 2023-03-08T15:31:20.886 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/binfmt_misc.ko 2023-03-08T15:31:20.887 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/btrfs 2023-03-08T15:31:20.887 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/btrfs/btrfs.ko 2023-03-08T15:31:20.887 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/cachefiles 2023-03-08T15:31:20.887 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/cachefiles/cachefiles.ko 2023-03-08T15:31:20.887 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ceph 2023-03-08T15:31:20.887 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ceph/ceph.ko 2023-03-08T15:31:20.887 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/cifs 2023-03-08T15:31:20.887 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/cifs/cifs.ko 2023-03-08T15:31:20.888 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/coda 2023-03-08T15:31:20.888 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/coda/coda.ko 2023-03-08T15:31:20.888 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/cramfs 2023-03-08T15:31:20.888 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/cramfs/cramfs.ko 2023-03-08T15:31:20.889 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/dlm 2023-03-08T15:31:20.889 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/dlm/dlm.ko 2023-03-08T15:31:20.889 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ecryptfs 2023-03-08T15:31:20.889 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ecryptfs/ecryptfs.ko 2023-03-08T15:31:20.889 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/f2fs 2023-03-08T15:31:20.890 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/f2fs/f2fs.ko 2023-03-08T15:31:20.890 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/fat 2023-03-08T15:31:20.890 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/fat/fat.ko 2023-03-08T15:31:20.890 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/fat/msdos.ko 2023-03-08T15:31:20.890 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/fat/vfat.ko 2023-03-08T15:31:20.891 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/fscache 2023-03-08T15:31:20.891 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/fscache/fscache.ko 2023-03-08T15:31:20.891 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/fuse 2023-03-08T15:31:20.891 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/fuse/cuse.ko 2023-03-08T15:31:20.892 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/fuse/fuse.ko 2023-03-08T15:31:20.892 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/gfs2 2023-03-08T15:31:20.892 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/gfs2/gfs2.ko 2023-03-08T15:31:20.892 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/hfs 2023-03-08T15:31:20.892 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/hfs/hfs.ko 2023-03-08T15:31:20.892 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/hfsplus 2023-03-08T15:31:20.892 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/hfsplus/hfsplus.ko 2023-03-08T15:31:20.893 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/isofs 2023-03-08T15:31:20.893 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/isofs/isofs.ko 2023-03-08T15:31:20.893 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/jfs 2023-03-08T15:31:20.893 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/jfs/jfs.ko 2023-03-08T15:31:20.894 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/lockd 2023-03-08T15:31:20.894 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/lockd/lockd.ko 2023-03-08T15:31:20.894 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/minix 2023-03-08T15:31:20.894 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/minix/minix.ko 2023-03-08T15:31:20.895 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/netfs 2023-03-08T15:31:20.895 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/netfs/netfs.ko 2023-03-08T15:31:20.895 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs 2023-03-08T15:31:20.895 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/blocklayout 2023-03-08T15:31:20.895 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-03-08T15:31:20.895 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/filelayout 2023-03-08T15:31:20.895 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-03-08T15:31:20.895 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/flexfilelayout 2023-03-08T15:31:20.896 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-03-08T15:31:20.896 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/nfs.ko 2023-03-08T15:31:20.896 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/nfsv3.ko 2023-03-08T15:31:20.896 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs/nfsv4.ko 2023-03-08T15:31:20.896 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs_common 2023-03-08T15:31:20.896 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs_common/grace.ko 2023-03-08T15:31:20.896 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfs_common/nfs_acl.ko 2023-03-08T15:31:20.896 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfsd 2023-03-08T15:31:20.897 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nfsd/nfsd.ko 2023-03-08T15:31:20.897 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nilfs2 2023-03-08T15:31:20.897 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nilfs2/nilfs2.ko 2023-03-08T15:31:20.897 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls 2023-03-08T15:31:20.897 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-celtic.ko 2023-03-08T15:31:20.897 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-centeuro.ko 2023-03-08T15:31:20.898 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-croatian.ko 2023-03-08T15:31:20.898 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-cyrillic.ko 2023-03-08T15:31:20.898 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-gaelic.ko 2023-03-08T15:31:20.898 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-greek.ko 2023-03-08T15:31:20.898 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-iceland.ko 2023-03-08T15:31:20.898 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-inuit.ko 2023-03-08T15:31:20.898 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-roman.ko 2023-03-08T15:31:20.898 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-romanian.ko 2023-03-08T15:31:20.899 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/mac-turkish.ko 2023-03-08T15:31:20.899 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp1250.ko 2023-03-08T15:31:20.899 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp1251.ko 2023-03-08T15:31:20.899 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp1255.ko 2023-03-08T15:31:20.899 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp737.ko 2023-03-08T15:31:20.899 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp775.ko 2023-03-08T15:31:20.899 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp850.ko 2023-03-08T15:31:20.899 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp852.ko 2023-03-08T15:31:20.900 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp855.ko 2023-03-08T15:31:20.900 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp857.ko 2023-03-08T15:31:20.900 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp860.ko 2023-03-08T15:31:20.900 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp861.ko 2023-03-08T15:31:20.900 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp862.ko 2023-03-08T15:31:20.900 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp863.ko 2023-03-08T15:31:20.900 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp864.ko 2023-03-08T15:31:20.900 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp865.ko 2023-03-08T15:31:20.901 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp866.ko 2023-03-08T15:31:20.901 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp869.ko 2023-03-08T15:31:20.901 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp874.ko 2023-03-08T15:31:20.901 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp932.ko 2023-03-08T15:31:20.901 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp936.ko 2023-03-08T15:31:20.902 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp949.ko 2023-03-08T15:31:20.902 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_cp950.ko 2023-03-08T15:31:20.902 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_euc-jp.ko 2023-03-08T15:31:20.902 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-1.ko 2023-03-08T15:31:20.902 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-13.ko 2023-03-08T15:31:20.902 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-14.ko 2023-03-08T15:31:20.902 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-15.ko 2023-03-08T15:31:20.902 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-2.ko 2023-03-08T15:31:20.903 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-3.ko 2023-03-08T15:31:20.903 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-4.ko 2023-03-08T15:31:20.903 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-5.ko 2023-03-08T15:31:20.903 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-6.ko 2023-03-08T15:31:20.903 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-7.ko 2023-03-08T15:31:20.903 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_iso8859-9.ko 2023-03-08T15:31:20.903 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_koi8-r.ko 2023-03-08T15:31:20.904 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_koi8-ru.ko 2023-03-08T15:31:20.904 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_koi8-u.ko 2023-03-08T15:31:20.904 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/nls/nls_utf8.ko 2023-03-08T15:31:20.904 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2 2023-03-08T15:31:20.904 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/cluster 2023-03-08T15:31:20.904 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-03-08T15:31:20.904 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/dlm 2023-03-08T15:31:20.904 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-03-08T15:31:20.905 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/dlmfs 2023-03-08T15:31:20.905 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-03-08T15:31:20.905 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/ocfs2.ko 2023-03-08T15:31:20.905 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-03-08T15:31:20.905 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-03-08T15:31:20.905 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-03-08T15:31:20.905 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/overlayfs 2023-03-08T15:31:20.906 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/overlayfs/overlay.ko 2023-03-08T15:31:20.906 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/pstore 2023-03-08T15:31:20.906 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/pstore/ramoops.ko 2023-03-08T15:31:20.906 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/reiserfs 2023-03-08T15:31:20.906 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/reiserfs/reiserfs.ko 2023-03-08T15:31:20.906 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/romfs 2023-03-08T15:31:20.906 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/romfs/romfs.ko 2023-03-08T15:31:20.906 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/smbfs_common 2023-03-08T15:31:20.907 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/smbfs_common/cifs_arc4.ko 2023-03-08T15:31:20.907 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/smbfs_common/cifs_md4.ko 2023-03-08T15:31:20.907 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/squashfs 2023-03-08T15:31:20.907 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/squashfs/squashfs.ko 2023-03-08T15:31:20.907 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/sysv 2023-03-08T15:31:20.908 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/sysv/sysv.ko 2023-03-08T15:31:20.908 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/udf 2023-03-08T15:31:20.908 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/udf/udf.ko 2023-03-08T15:31:20.908 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ufs 2023-03-08T15:31:20.909 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/ufs/ufs.ko 2023-03-08T15:31:20.909 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/xfs 2023-03-08T15:31:20.909 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/fs/xfs/xfs.ko 2023-03-08T15:31:20.909 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/kernel 2023-03-08T15:31:20.909 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/kernel/rcu 2023-03-08T15:31:20.909 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/kernel/rcu/rcutorture.ko 2023-03-08T15:31:20.909 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/kernel/torture.ko 2023-03-08T15:31:20.910 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/kernel/trace 2023-03-08T15:31:20.910 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-03-08T15:31:20.910 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib 2023-03-08T15:31:20.910 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/asn1_encoder.ko 2023-03-08T15:31:20.910 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/crc-itu-t.ko 2023-03-08T15:31:20.910 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/crc8.ko 2023-03-08T15:31:20.910 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/crypto 2023-03-08T15:31:20.910 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/crypto/libarc4.ko 2023-03-08T15:31:20.911 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/crypto/libdes.ko 2023-03-08T15:31:20.911 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/libcrc32c.ko 2023-03-08T15:31:20.911 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/lru_cache.ko 2023-03-08T15:31:20.911 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/lz4 2023-03-08T15:31:20.911 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/lz4/lz4_compress.ko 2023-03-08T15:31:20.911 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/lz4/lz4hc_compress.ko 2023-03-08T15:31:20.911 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/math 2023-03-08T15:31:20.911 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/math/cordic.ko 2023-03-08T15:31:20.912 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/raid6 2023-03-08T15:31:20.912 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/raid6/raid6_pq.ko 2023-03-08T15:31:20.912 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/reed_solomon 2023-03-08T15:31:20.912 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/reed_solomon/reed_solomon.ko 2023-03-08T15:31:20.912 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/ts_bm.ko 2023-03-08T15:31:20.913 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/ts_fsm.ko 2023-03-08T15:31:20.913 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/ts_kmp.ko 2023-03-08T15:31:20.913 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/zstd 2023-03-08T15:31:20.914 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/lib/zstd/zstd_compress.ko 2023-03-08T15:31:20.914 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/mm 2023-03-08T15:31:20.914 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/mm/hwpoison-inject.ko 2023-03-08T15:31:20.914 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net 2023-03-08T15:31:20.914 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan 2023-03-08T15:31:20.914 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/6lowpan.ko 2023-03-08T15:31:20.914 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/nhc_dest.ko 2023-03-08T15:31:20.915 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/nhc_fragment.ko 2023-03-08T15:31:20.915 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/nhc_hop.ko 2023-03-08T15:31:20.915 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/nhc_ipv6.ko 2023-03-08T15:31:20.915 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/nhc_mobility.ko 2023-03-08T15:31:20.915 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/nhc_routing.ko 2023-03-08T15:31:20.915 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/6lowpan/nhc_udp.ko 2023-03-08T15:31:20.915 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/802 2023-03-08T15:31:20.916 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/802/garp.ko 2023-03-08T15:31:20.916 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/802/mrp.ko 2023-03-08T15:31:20.916 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/802/p8022.ko 2023-03-08T15:31:20.916 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/802/psnap.ko 2023-03-08T15:31:20.916 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/802/stp.ko 2023-03-08T15:31:20.916 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/8021q 2023-03-08T15:31:20.916 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/8021q/8021q.ko 2023-03-08T15:31:20.917 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/9p 2023-03-08T15:31:20.917 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/9p/9pnet.ko 2023-03-08T15:31:20.917 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/9p/9pnet_fd.ko 2023-03-08T15:31:20.917 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/9p/9pnet_rdma.ko 2023-03-08T15:31:20.917 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/9p/9pnet_virtio.ko 2023-03-08T15:31:20.917 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/batman-adv 2023-03-08T15:31:20.917 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/batman-adv/batman-adv.ko 2023-03-08T15:31:20.917 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge 2023-03-08T15:31:20.918 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/br_netfilter.ko 2023-03-08T15:31:20.918 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/bridge.ko 2023-03-08T15:31:20.918 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter 2023-03-08T15:31:20.918 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-03-08T15:31:20.918 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_among.ko 2023-03-08T15:31:20.918 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-03-08T15:31:20.918 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-03-08T15:31:20.918 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-03-08T15:31:20.919 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-03-08T15:31:20.919 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-03-08T15:31:20.919 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-03-08T15:31:20.919 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_log.ko 2023-03-08T15:31:20.919 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-03-08T15:31:20.919 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-03-08T15:31:20.919 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-03-08T15:31:20.920 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-03-08T15:31:20.920 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-03-08T15:31:20.920 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-03-08T15:31:20.920 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-03-08T15:31:20.920 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-03-08T15:31:20.920 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-03-08T15:31:20.920 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-03-08T15:31:20.920 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-03-08T15:31:20.921 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/ebtables.ko 2023-03-08T15:31:20.921 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-03-08T15:31:20.921 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-03-08T15:31:20.921 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-03-08T15:31:20.921 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ceph 2023-03-08T15:31:20.921 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ceph/libceph.ko 2023-03-08T15:31:20.922 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/core 2023-03-08T15:31:20.922 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/core/failover.ko 2023-03-08T15:31:20.922 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/core/pktgen.ko 2023-03-08T15:31:20.922 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dccp 2023-03-08T15:31:20.922 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dccp/dccp.ko 2023-03-08T15:31:20.922 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dccp/dccp_diag.ko 2023-03-08T15:31:20.922 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dccp/dccp_ipv4.ko 2023-03-08T15:31:20.923 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dccp/dccp_ipv6.ko 2023-03-08T15:31:20.923 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dns_resolver 2023-03-08T15:31:20.923 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dns_resolver/dns_resolver.ko 2023-03-08T15:31:20.923 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dsa 2023-03-08T15:31:20.923 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dsa/dsa_core.ko 2023-03-08T15:31:20.923 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dsa/tag_brcm.ko 2023-03-08T15:31:20.923 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dsa/tag_dsa.ko 2023-03-08T15:31:20.923 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dsa/tag_none.ko 2023-03-08T15:31:20.924 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/dsa/tag_trailer.ko 2023-03-08T15:31:20.924 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ieee802154 2023-03-08T15:31:20.924 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ieee802154/6lowpan 2023-03-08T15:31:20.924 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-03-08T15:31:20.924 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ieee802154/ieee802154.ko 2023-03-08T15:31:20.925 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ieee802154/ieee802154_socket.ko 2023-03-08T15:31:20.925 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4 2023-03-08T15:31:20.925 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/ah4.ko 2023-03-08T15:31:20.925 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/esp4.ko 2023-03-08T15:31:20.925 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/fou.ko 2023-03-08T15:31:20.925 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/gre.ko 2023-03-08T15:31:20.925 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/inet_diag.ko 2023-03-08T15:31:20.926 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/ip_gre.ko 2023-03-08T15:31:20.926 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/ip_tunnel.ko 2023-03-08T15:31:20.926 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/ip_vti.ko 2023-03-08T15:31:20.926 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/ipcomp.ko 2023-03-08T15:31:20.926 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/ipip.ko 2023-03-08T15:31:20.926 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter 2023-03-08T15:31:20.926 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-03-08T15:31:20.926 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-03-08T15:31:20.927 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-03-08T15:31:20.927 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/ipt_CLUSTERIP.ko 2023-03-08T15:31:20.927 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-03-08T15:31:20.927 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-03-08T15:31:20.927 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-03-08T15:31:20.927 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-03-08T15:31:20.927 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-03-08T15:31:20.927 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-03-08T15:31:20.928 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-03-08T15:31:20.928 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-03-08T15:31:20.928 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-03-08T15:31:20.928 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-03-08T15:31:20.928 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-03-08T15:31:20.928 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-03-08T15:31:20.928 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-03-08T15:31:20.929 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-03-08T15:31:20.929 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-03-08T15:31:20.929 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-03-08T15:31:20.929 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-03-08T15:31:20.929 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-03-08T15:31:20.929 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_bic.ko 2023-03-08T15:31:20.930 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_dctcp.ko 2023-03-08T15:31:20.930 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_diag.ko 2023-03-08T15:31:20.930 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_highspeed.ko 2023-03-08T15:31:20.930 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_htcp.ko 2023-03-08T15:31:20.930 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_hybla.ko 2023-03-08T15:31:20.931 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_illinois.ko 2023-03-08T15:31:20.931 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_lp.ko 2023-03-08T15:31:20.931 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_scalable.ko 2023-03-08T15:31:20.931 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_vegas.ko 2023-03-08T15:31:20.931 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_veno.ko 2023-03-08T15:31:20.931 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_westwood.ko 2023-03-08T15:31:20.931 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tcp_yeah.ko 2023-03-08T15:31:20.931 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/tunnel4.ko 2023-03-08T15:31:20.932 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/udp_diag.ko 2023-03-08T15:31:20.932 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/udp_tunnel.ko 2023-03-08T15:31:20.932 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-03-08T15:31:20.932 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6 2023-03-08T15:31:20.932 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/ah6.ko 2023-03-08T15:31:20.932 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/esp6.ko 2023-03-08T15:31:20.932 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/fou6.ko 2023-03-08T15:31:20.933 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/ip6_tunnel.ko 2023-03-08T15:31:20.933 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-03-08T15:31:20.933 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/ip6_vti.ko 2023-03-08T15:31:20.933 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/ipcomp6.ko 2023-03-08T15:31:20.933 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter 2023-03-08T15:31:20.933 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-03-08T15:31:20.933 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-03-08T15:31:20.933 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-03-08T15:31:20.934 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-03-08T15:31:20.934 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-03-08T15:31:20.934 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-03-08T15:31:20.934 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-03-08T15:31:20.934 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-03-08T15:31:20.934 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-03-08T15:31:20.934 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-03-08T15:31:20.934 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-03-08T15:31:20.935 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-03-08T15:31:20.935 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-03-08T15:31:20.935 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-03-08T15:31:20.935 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-03-08T15:31:20.935 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-03-08T15:31:20.935 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-03-08T15:31:20.936 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-03-08T15:31:20.936 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-03-08T15:31:20.936 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-03-08T15:31:20.936 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-03-08T15:31:20.936 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-03-08T15:31:20.936 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-03-08T15:31:20.936 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-03-08T15:31:20.936 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/sit.ko 2023-03-08T15:31:20.937 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/tunnel6.ko 2023-03-08T15:31:20.937 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-03-08T15:31:20.937 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/key 2023-03-08T15:31:20.937 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/key/af_key.ko 2023-03-08T15:31:20.937 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp 2023-03-08T15:31:20.937 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp/l2tp_core.ko 2023-03-08T15:31:20.937 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp/l2tp_debugfs.ko 2023-03-08T15:31:20.938 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp/l2tp_eth.ko 2023-03-08T15:31:20.938 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp/l2tp_ip.ko 2023-03-08T15:31:20.938 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp/l2tp_ip6.ko 2023-03-08T15:31:20.938 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp/l2tp_netlink.ko 2023-03-08T15:31:20.938 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/l2tp/l2tp_ppp.ko 2023-03-08T15:31:20.938 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/llc 2023-03-08T15:31:20.938 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/llc/llc.ko 2023-03-08T15:31:20.939 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/mac802154 2023-03-08T15:31:20.940 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/mac802154/mac802154.ko 2023-03-08T15:31:20.940 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/mpls 2023-03-08T15:31:20.940 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/mpls/mpls_gso.ko 2023-03-08T15:31:20.940 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter 2023-03-08T15:31:20.940 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset 2023-03-08T15:31:20.940 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set.ko 2023-03-08T15:31:20.941 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-03-08T15:31:20.941 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-03-08T15:31:20.941 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-03-08T15:31:20.941 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-03-08T15:31:20.941 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-03-08T15:31:20.941 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-03-08T15:31:20.941 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-03-08T15:31:20.942 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-03-08T15:31:20.942 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-03-08T15:31:20.942 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-03-08T15:31:20.942 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-03-08T15:31:20.942 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-03-08T15:31:20.942 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-03-08T15:31:20.942 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-03-08T15:31:20.942 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-03-08T15:31:20.943 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs 2023-03-08T15:31:20.943 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-03-08T15:31:20.943 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-03-08T15:31:20.943 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-03-08T15:31:20.943 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-03-08T15:31:20.944 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-03-08T15:31:20.944 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-03-08T15:31:20.944 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-03-08T15:31:20.944 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-03-08T15:31:20.944 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-03-08T15:31:20.944 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-03-08T15:31:20.944 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-03-08T15:31:20.945 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-03-08T15:31:20.945 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-03-08T15:31:20.945 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-03-08T15:31:20.945 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conncount.ko 2023-03-08T15:31:20.945 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack.ko 2023-03-08T15:31:20.945 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-03-08T15:31:20.945 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-03-08T15:31:20.945 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-03-08T15:31:20.946 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-03-08T15:31:20.946 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-03-08T15:31:20.946 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-03-08T15:31:20.946 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-03-08T15:31:20.946 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-03-08T15:31:20.946 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-03-08T15:31:20.946 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-03-08T15:31:20.947 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-03-08T15:31:20.947 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-03-08T15:31:20.947 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_dup_netdev.ko 2023-03-08T15:31:20.947 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_flow_table.ko 2023-03-08T15:31:20.947 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-03-08T15:31:20.947 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_log_syslog.ko 2023-03-08T15:31:20.947 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_nat.ko 2023-03-08T15:31:20.947 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_nat_amanda.ko 2023-03-08T15:31:20.948 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_nat_ftp.ko 2023-03-08T15:31:20.948 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_nat_irc.ko 2023-03-08T15:31:20.948 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_nat_sip.ko 2023-03-08T15:31:20.948 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_nat_tftp.ko 2023-03-08T15:31:20.948 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_synproxy_core.ko 2023-03-08T15:31:20.948 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nf_tables.ko 2023-03-08T15:31:20.948 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nfnetlink.ko 2023-03-08T15:31:20.948 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nfnetlink_acct.ko 2023-03-08T15:31:20.949 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nfnetlink_log.ko 2023-03-08T15:31:20.949 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nfnetlink_osf.ko 2023-03-08T15:31:20.949 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nfnetlink_queue.ko 2023-03-08T15:31:20.949 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_chain_nat.ko 2023-03-08T15:31:20.949 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_compat.ko 2023-03-08T15:31:20.949 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_ct.ko 2023-03-08T15:31:20.949 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_dup_netdev.ko 2023-03-08T15:31:20.950 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_fib.ko 2023-03-08T15:31:20.950 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-03-08T15:31:20.950 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_hash.ko 2023-03-08T15:31:20.950 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_limit.ko 2023-03-08T15:31:20.950 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_log.ko 2023-03-08T15:31:20.950 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_masq.ko 2023-03-08T15:31:20.950 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_nat.ko 2023-03-08T15:31:20.951 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_numgen.ko 2023-03-08T15:31:20.951 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_queue.ko 2023-03-08T15:31:20.951 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_quota.ko 2023-03-08T15:31:20.951 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_redir.ko 2023-03-08T15:31:20.951 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_reject.ko 2023-03-08T15:31:20.951 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_reject_inet.ko 2023-03-08T15:31:20.952 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_socket.ko 2023-03-08T15:31:20.952 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/nft_tunnel.ko 2023-03-08T15:31:20.952 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_AUDIT.ko 2023-03-08T15:31:20.952 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-03-08T15:31:20.952 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-03-08T15:31:20.952 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-03-08T15:31:20.953 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_CT.ko 2023-03-08T15:31:20.953 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_DSCP.ko 2023-03-08T15:31:20.953 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_HL.ko 2023-03-08T15:31:20.953 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_HMARK.ko 2023-03-08T15:31:20.953 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-03-08T15:31:20.953 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_LED.ko 2023-03-08T15:31:20.953 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_LOG.ko 2023-03-08T15:31:20.953 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-03-08T15:31:20.954 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_NETMAP.ko 2023-03-08T15:31:20.954 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_NFLOG.ko 2023-03-08T15:31:20.954 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-03-08T15:31:20.954 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_RATEEST.ko 2023-03-08T15:31:20.954 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_REDIRECT.ko 2023-03-08T15:31:20.954 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_SECMARK.ko 2023-03-08T15:31:20.954 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_TCPMSS.ko 2023-03-08T15:31:20.954 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-03-08T15:31:20.955 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_TEE.ko 2023-03-08T15:31:20.955 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_TPROXY.ko 2023-03-08T15:31:20.955 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_TRACE.ko 2023-03-08T15:31:20.955 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_addrtype.ko 2023-03-08T15:31:20.955 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_bpf.ko 2023-03-08T15:31:20.955 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_cgroup.ko 2023-03-08T15:31:20.955 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_cluster.ko 2023-03-08T15:31:20.956 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_comment.ko 2023-03-08T15:31:20.956 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_connbytes.ko 2023-03-08T15:31:20.956 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_connlabel.ko 2023-03-08T15:31:20.956 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_connlimit.ko 2023-03-08T15:31:20.956 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_connmark.ko 2023-03-08T15:31:20.957 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_conntrack.ko 2023-03-08T15:31:20.957 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_cpu.ko 2023-03-08T15:31:20.957 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_dccp.ko 2023-03-08T15:31:20.957 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_devgroup.ko 2023-03-08T15:31:20.957 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_dscp.ko 2023-03-08T15:31:20.957 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_ecn.ko 2023-03-08T15:31:20.957 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_esp.ko 2023-03-08T15:31:20.957 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_hashlimit.ko 2023-03-08T15:31:20.958 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_helper.ko 2023-03-08T15:31:20.958 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_hl.ko 2023-03-08T15:31:20.958 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_ipcomp.ko 2023-03-08T15:31:20.958 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_iprange.ko 2023-03-08T15:31:20.958 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_ipvs.ko 2023-03-08T15:31:20.958 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_l2tp.ko 2023-03-08T15:31:20.959 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_length.ko 2023-03-08T15:31:20.959 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_limit.ko 2023-03-08T15:31:20.959 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_mac.ko 2023-03-08T15:31:20.959 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_mark.ko 2023-03-08T15:31:20.959 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_multiport.ko 2023-03-08T15:31:20.959 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_nat.ko 2023-03-08T15:31:20.959 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_nfacct.ko 2023-03-08T15:31:20.960 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_osf.ko 2023-03-08T15:31:20.960 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_owner.ko 2023-03-08T15:31:20.960 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_physdev.ko 2023-03-08T15:31:20.960 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_pkttype.ko 2023-03-08T15:31:20.960 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_policy.ko 2023-03-08T15:31:20.960 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_quota.ko 2023-03-08T15:31:20.960 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_rateest.ko 2023-03-08T15:31:20.960 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_realm.ko 2023-03-08T15:31:20.961 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_recent.ko 2023-03-08T15:31:20.961 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_sctp.ko 2023-03-08T15:31:20.961 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_set.ko 2023-03-08T15:31:20.961 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_socket.ko 2023-03-08T15:31:20.961 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_state.ko 2023-03-08T15:31:20.961 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_statistic.ko 2023-03-08T15:31:20.961 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_string.ko 2023-03-08T15:31:20.962 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_tcpmss.ko 2023-03-08T15:31:20.962 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_time.ko 2023-03-08T15:31:20.962 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netfilter/xt_u32.ko 2023-03-08T15:31:20.962 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netlink 2023-03-08T15:31:20.962 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/netlink/netlink_diag.ko 2023-03-08T15:31:20.962 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/nsh 2023-03-08T15:31:20.962 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/nsh/nsh.ko 2023-03-08T15:31:20.962 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/openvswitch 2023-03-08T15:31:20.963 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/openvswitch/openvswitch.ko 2023-03-08T15:31:20.963 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/openvswitch/vport-geneve.ko 2023-03-08T15:31:20.963 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/openvswitch/vport-gre.ko 2023-03-08T15:31:20.963 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/openvswitch/vport-vxlan.ko 2023-03-08T15:31:20.963 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/packet 2023-03-08T15:31:20.963 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/packet/af_packet_diag.ko 2023-03-08T15:31:20.963 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/rds 2023-03-08T15:31:20.964 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/rds/rds.ko 2023-03-08T15:31:20.964 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/rds/rds_rdma.ko 2023-03-08T15:31:20.964 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/rds/rds_tcp.ko 2023-03-08T15:31:20.964 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched 2023-03-08T15:31:20.964 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_csum.ko 2023-03-08T15:31:20.964 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_gact.ko 2023-03-08T15:31:20.964 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_ipt.ko 2023-03-08T15:31:20.965 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_mirred.ko 2023-03-08T15:31:20.965 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_nat.ko 2023-03-08T15:31:20.965 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_pedit.ko 2023-03-08T15:31:20.965 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_police.ko 2023-03-08T15:31:20.965 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_simple.ko 2023-03-08T15:31:20.965 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_skbedit.ko 2023-03-08T15:31:20.965 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/act_vlan.ko 2023-03-08T15:31:20.965 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_basic.ko 2023-03-08T15:31:20.966 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_bpf.ko 2023-03-08T15:31:20.966 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_flow.ko 2023-03-08T15:31:20.966 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_fw.ko 2023-03-08T15:31:20.966 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_route.ko 2023-03-08T15:31:20.966 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_rsvp.ko 2023-03-08T15:31:20.966 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_rsvp6.ko 2023-03-08T15:31:20.966 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_tcindex.ko 2023-03-08T15:31:20.967 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/cls_u32.ko 2023-03-08T15:31:20.967 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/em_cmp.ko 2023-03-08T15:31:20.967 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/em_ipset.ko 2023-03-08T15:31:20.967 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/em_meta.ko 2023-03-08T15:31:20.967 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/em_nbyte.ko 2023-03-08T15:31:20.967 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/em_text.ko 2023-03-08T15:31:20.967 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/em_u32.ko 2023-03-08T15:31:20.968 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_cbq.ko 2023-03-08T15:31:20.968 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_choke.ko 2023-03-08T15:31:20.968 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_codel.ko 2023-03-08T15:31:20.968 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_drr.ko 2023-03-08T15:31:20.968 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_dsmark.ko 2023-03-08T15:31:20.968 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_fq.ko 2023-03-08T15:31:20.968 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_gred.ko 2023-03-08T15:31:20.968 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_hfsc.ko 2023-03-08T15:31:20.969 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_hhf.ko 2023-03-08T15:31:20.969 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_htb.ko 2023-03-08T15:31:20.969 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_ingress.ko 2023-03-08T15:31:20.969 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_mqprio.ko 2023-03-08T15:31:20.969 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_multiq.ko 2023-03-08T15:31:20.969 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_netem.ko 2023-03-08T15:31:20.969 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_pie.ko 2023-03-08T15:31:20.970 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_plug.ko 2023-03-08T15:31:20.970 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_prio.ko 2023-03-08T15:31:20.970 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_qfq.ko 2023-03-08T15:31:20.970 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_red.ko 2023-03-08T15:31:20.970 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_sfb.ko 2023-03-08T15:31:20.970 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_sfq.ko 2023-03-08T15:31:20.970 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_tbf.ko 2023-03-08T15:31:20.970 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sched/sch_teql.ko 2023-03-08T15:31:20.971 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sctp 2023-03-08T15:31:20.971 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sctp/sctp.ko 2023-03-08T15:31:20.971 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sctp/sctp_diag.ko 2023-03-08T15:31:20.971 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sunrpc 2023-03-08T15:31:20.971 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sunrpc/auth_gss 2023-03-08T15:31:20.971 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-03-08T15:31:20.971 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-03-08T15:31:20.971 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sunrpc/sunrpc.ko 2023-03-08T15:31:20.972 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sunrpc/xprtrdma 2023-03-08T15:31:20.972 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-03-08T15:31:20.972 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/tipc 2023-03-08T15:31:20.972 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/tipc/diag.ko 2023-03-08T15:31:20.972 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/tipc/tipc.ko 2023-03-08T15:31:20.972 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/unix 2023-03-08T15:31:20.973 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/unix/unix_diag.ko 2023-03-08T15:31:20.973 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/vmw_vsock 2023-03-08T15:31:20.973 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-03-08T15:31:20.973 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-03-08T15:31:20.973 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/vmw_vsock/vsock.ko 2023-03-08T15:31:20.973 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/vmw_vsock/vsock_diag.ko 2023-03-08T15:31:20.973 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-03-08T15:31:20.974 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/xfrm 2023-03-08T15:31:20.974 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-03-08T15:31:20.974 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/security 2023-03-08T15:31:20.974 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/security/keys 2023-03-08T15:31:20.974 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/security/keys/encrypted-keys 2023-03-08T15:31:20.974 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-03-08T15:31:20.974 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/security/keys/trusted-keys 2023-03-08T15:31:20.974 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/security/keys/trusted-keys/trusted.ko 2023-03-08T15:31:20.975 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/virt 2023-03-08T15:31:20.975 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/virt/lib 2023-03-08T15:31:20.975 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/kernel/virt/lib/irqbypass.ko 2023-03-08T15:31:20.975 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/modules.alias 2023-03-08T15:31:20.975 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/modules.alias.bin 2023-03-08T15:31:20.975 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/modules.builtin 2023-03-08T15:31:20.975 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/modules.builtin.bin 2023-03-08T15:31:20.975 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/modules.builtin.modinfo 2023-03-08T15:31:20.976 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/modules.dep 2023-03-08T15:31:20.976 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/modules.dep.bin 2023-03-08T15:31:20.976 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/modules.devname 2023-03-08T15:31:20.976 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/modules.order 2023-03-08T15:31:20.976 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/modules.softdep 2023-03-08T15:31:20.976 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/modules.symbols 2023-03-08T15:31:20.976 INFO:teuthology.orchestra.run.smithi182.stdout:/lib/modules/6.2.0-ceph-g75534f74ac3d/modules.symbols.bin 2023-03-08T15:31:20.977 DEBUG:teuthology.task.kernel:get_image_version: 6.2.0-ceph-g75534f74ac3d 2023-03-08T15:31:20.977 DEBUG:teuthology.orchestra.run.smithi182:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-03-08T15:31:21.004 INFO:teuthology.orchestra.run.smithi182.stdout:postinstall scriptlet (using /bin/sh): 2023-03-08T15:31:21.004 INFO:teuthology.orchestra.run.smithi182.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.2.0-ceph-g75534f74ac3d -a -r /boot/System.map-6.2.0-ceph-g75534f74ac3d ]; then 2023-03-08T15:31:21.004 INFO:teuthology.orchestra.run.smithi182.stdout:cp /boot/vmlinuz-6.2.0-ceph-g75534f74ac3d /boot/.vmlinuz-6.2.0-ceph-g75534f74ac3d-rpm 2023-03-08T15:31:21.004 INFO:teuthology.orchestra.run.smithi182.stdout:cp /boot/System.map-6.2.0-ceph-g75534f74ac3d /boot/.System.map-6.2.0-ceph-g75534f74ac3d-rpm 2023-03-08T15:31:21.004 INFO:teuthology.orchestra.run.smithi182.stdout:rm -f /boot/vmlinuz-6.2.0-ceph-g75534f74ac3d /boot/System.map-6.2.0-ceph-g75534f74ac3d 2023-03-08T15:31:21.005 INFO:teuthology.orchestra.run.smithi182.stdout:/sbin/installkernel 6.2.0-ceph-g75534f74ac3d /boot/.vmlinuz-6.2.0-ceph-g75534f74ac3d-rpm /boot/.System.map-6.2.0-ceph-g75534f74ac3d-rpm 2023-03-08T15:31:21.005 INFO:teuthology.orchestra.run.smithi182.stdout:rm -f /boot/.vmlinuz-6.2.0-ceph-g75534f74ac3d-rpm /boot/.System.map-6.2.0-ceph-g75534f74ac3d-rpm 2023-03-08T15:31:21.005 INFO:teuthology.orchestra.run.smithi182.stdout:fi 2023-03-08T15:31:21.005 INFO:teuthology.orchestra.run.smithi182.stdout:preuninstall scriptlet (using /bin/sh): 2023-03-08T15:31:21.005 INFO:teuthology.orchestra.run.smithi182.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-03-08T15:31:21.005 INFO:teuthology.orchestra.run.smithi182.stdout:new-kernel-pkg --remove 6.2.0-ceph-g75534f74ac3d --rminitrd --initrdfile=/boot/initramfs-6.2.0-ceph-g75534f74ac3d.img 2023-03-08T15:31:21.006 INFO:teuthology.orchestra.run.smithi182.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-03-08T15:31:21.006 INFO:teuthology.orchestra.run.smithi182.stdout:kernel-install remove 6.2.0-ceph-g75534f74ac3d 2023-03-08T15:31:21.006 INFO:teuthology.orchestra.run.smithi182.stdout:fi 2023-03-08T15:31:21.006 INFO:teuthology.orchestra.run.smithi182.stdout:postuninstall scriptlet (using /bin/sh): 2023-03-08T15:31:21.006 INFO:teuthology.orchestra.run.smithi182.stdout:if [ -x /sbin/update-bootloader ]; then 2023-03-08T15:31:21.006 INFO:teuthology.orchestra.run.smithi182.stdout:/sbin/update-bootloader --remove 6.2.0-ceph-g75534f74ac3d 2023-03-08T15:31:21.006 INFO:teuthology.orchestra.run.smithi182.stdout:fi 2023-03-08T15:31:21.007 DEBUG:teuthology.orchestra.run.smithi182:> sudo rpm -qi grub2-tools 2023-03-08T15:31:21.083 INFO:teuthology.orchestra.run.smithi182.stdout:Name : grub2-tools 2023-03-08T15:31:21.083 INFO:teuthology.orchestra.run.smithi182.stdout:Epoch : 1 2023-03-08T15:31:21.084 INFO:teuthology.orchestra.run.smithi182.stdout:Version : 2.02 2023-03-08T15:31:21.084 INFO:teuthology.orchestra.run.smithi182.stdout:Release : 129.el8 2023-03-08T15:31:21.084 INFO:teuthology.orchestra.run.smithi182.stdout:Architecture: x86_64 2023-03-08T15:31:21.085 INFO:teuthology.orchestra.run.smithi182.stdout:Install Date: Sun 28 Aug 2022 01:03:50 PM UTC 2023-03-08T15:31:21.085 INFO:teuthology.orchestra.run.smithi182.stdout:Group : System Environment/Base 2023-03-08T15:31:21.085 INFO:teuthology.orchestra.run.smithi182.stdout:Size : 9265586 2023-03-08T15:31:21.086 INFO:teuthology.orchestra.run.smithi182.stdout:License : GPLv3+ 2023-03-08T15:31:21.086 INFO:teuthology.orchestra.run.smithi182.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-03-08T15:31:21.086 INFO:teuthology.orchestra.run.smithi182.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-03-08T15:31:21.087 INFO:teuthology.orchestra.run.smithi182.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-03-08T15:31:21.087 INFO:teuthology.orchestra.run.smithi182.stdout:Build Host : kbuilder.bsys.centos.org 2023-03-08T15:31:21.087 INFO:teuthology.orchestra.run.smithi182.stdout:Relocations : (not relocatable) 2023-03-08T15:31:21.087 INFO:teuthology.orchestra.run.smithi182.stdout:Packager : CentOS BuildSystem 2023-03-08T15:31:21.088 INFO:teuthology.orchestra.run.smithi182.stdout:Vendor : CentOS 2023-03-08T15:31:21.089 INFO:teuthology.orchestra.run.smithi182.stdout:URL : http://www.gnu.org/software/grub/ 2023-03-08T15:31:21.090 INFO:teuthology.orchestra.run.smithi182.stdout:Summary : Support tools for GRUB. 2023-03-08T15:31:21.090 INFO:teuthology.orchestra.run.smithi182.stdout:Description : 2023-03-08T15:31:21.091 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:31:21.091 INFO:teuthology.orchestra.run.smithi182.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-03-08T15:31:21.091 INFO:teuthology.orchestra.run.smithi182.stdout:customizable bootloader with modular architecture. It supports a rich 2023-03-08T15:31:21.096 INFO:teuthology.orchestra.run.smithi182.stdout:variety of kernel formats, file systems, computer architectures and 2023-03-08T15:31:21.097 INFO:teuthology.orchestra.run.smithi182.stdout:hardware devices. 2023-03-08T15:31:21.097 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:31:21.097 INFO:teuthology.orchestra.run.smithi182.stdout:This subpackage provides tools for support of all platforms. 2023-03-08T15:31:21.098 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-03-08T15:31:21.098 INFO:teuthology.task.kernel:Updating grub on smithi182 to boot 6.2.0-ceph-g75534f74ac3d 2023-03-08T15:31:21.098 DEBUG:teuthology.orchestra.run.smithi182:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-03-08T15:31:24.983 INFO:teuthology.orchestra.run.smithi182.stderr:Generating grub configuration file ... 2023-03-08T15:31:26.786 INFO:teuthology.orchestra.run.smithi182.stderr:done 2023-03-08T15:31:26.787 DEBUG:teuthology.orchestra.run.smithi182:> mktemp 2023-03-08T15:31:26.810 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.nQyoFezeIj 2023-03-08T15:31:26.811 DEBUG:teuthology.orchestra.run.smithi182:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nQyoFezeIj 2023-03-08T15:31:26.886 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod 0666 /tmp/tmp.nQyoFezeIj 2023-03-08T15:31:27.044 DEBUG:teuthology.orchestra.remote:smithi182:/tmp/tmp.nQyoFezeIj is 6KB 2023-03-08T15:31:27.091 DEBUG:teuthology.orchestra.run.smithi182:> rm -fr /tmp/tmp.nQyoFezeIj 2023-03-08T15:31:27.109 DEBUG:teuthology.orchestra.run.smithi182:> sudo /bin/ls /boot/loader/entries || true 2023-03-08T15:31:27.173 INFO:teuthology.orchestra.run.smithi182.stdout:2ff282740cf84d4fa02ff60ed95fbbff-0-rescue.conf 2023-03-08T15:31:27.174 INFO:teuthology.orchestra.run.smithi182.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-305.3.1.el8.x86_64.conf 2023-03-08T15:31:27.174 INFO:teuthology.orchestra.run.smithi182.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-408.el8.x86_64.conf 2023-03-08T15:31:27.174 INFO:teuthology.orchestra.run.smithi182.stdout:2ff282740cf84d4fa02ff60ed95fbbff-6.2.0-ceph-g75534f74ac3d.conf 2023-03-08T15:31:27.177 DEBUG:teuthology.orchestra.run.smithi182:> sudo grub2-set-default 2ff282740cf84d4fa02ff60ed95fbbff-6.2.0-ceph-g75534f74ac3d 2023-03-08T15:31:27.330 DEBUG:teuthology.orchestra.run.smithi182:> sudo shutdown -r now 2023-03-08T15:31:57.333 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-03-08T15:31:57.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2023-03-08T15:31:57.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-08T15:32:15.749 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.182 2023-03-08T15:32:45.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2023-03-08T15:32:45.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-08T15:32:48.806 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.182 2023-03-08T15:33:18.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2023-03-08T15:33:18.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-08T15:33:19.250 DEBUG:teuthology.orchestra.run.smithi182:> true 2023-03-08T15:33:19.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi182.front.sepia.ceph.com' 2023-03-08T15:33:19.749 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.2.0-ceph-g75534f74ac3d"... 2023-03-08T15:33:19.749 DEBUG:teuthology.orchestra.run.smithi182:> uname -r 2023-03-08T15:33:19.815 INFO:teuthology.orchestra.run.smithi182.stdout:6.2.0-ceph-g75534f74ac3d 2023-03-08T15:33:19.816 DEBUG:teuthology.task.kernel:current kernel version is 6.2.0-ceph-g75534f74ac3d vs 6.2.0-ceph-g75534f74ac3d 2023-03-08T15:33:19.816 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-03-08T15:33:19.816 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-03-08T15:33:20.817 DEBUG:teuthology.parallel:result is None 2023-03-08T15:33:20.818 INFO:teuthology.run_tasks:Running task internal.base... 2023-03-08T15:33:20.832 INFO:teuthology.task.internal:Creating test directory... 2023-03-08T15:33:20.832 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-08T15:33:20.835 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-08T15:33:20.839 DEBUG:teuthology.orchestra.run.smithi182:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-08T15:33:20.911 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-03-08T15:33:20.918 INFO:teuthology.run_tasks:Running task internal.archive... 2023-03-08T15:33:20.925 INFO:teuthology.task.internal:Creating archive directory... 2023-03-08T15:33:20.925 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-08T15:33:20.928 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-08T15:33:20.930 DEBUG:teuthology.orchestra.run.smithi182:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-08T15:33:21.023 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-03-08T15:33:21.030 INFO:teuthology.task.internal:Enabling coredump saving... 2023-03-08T15:33:21.032 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-08T15:33:21.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-08T15:33:21.051 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-08T15:33:21.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-08T15:33:21.075 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-08T15:33:21.093 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-08T15:33:21.116 DEBUG:teuthology.orchestra.run.smithi182:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-08T15:33:21.141 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-08T15:33:21.155 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-08T15:33:21.157 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-08T15:33:21.179 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-08T15:33:21.285 INFO:teuthology.orchestra.run.smithi182.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-08T15:33:21.324 INFO:teuthology.orchestra.run.smithi182.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-08T15:33:21.330 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-03-08T15:33:21.338 INFO:teuthology.task.internal:Configuring sudo... 2023-03-08T15:33:21.338 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-08T15:33:21.343 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-08T15:33:21.347 DEBUG:teuthology.orchestra.run.smithi182:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-08T15:33:21.448 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-03-08T15:33:21.459 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-03-08T15:33:21.460 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-08T15:33:21.466 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-08T15:33:21.470 DEBUG:teuthology.orchestra.run.smithi182:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-08T15:33:21.537 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-08T15:33:21.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-08T15:33:21.639 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-08T15:33:21.729 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-08T15:33:21.767 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:33:21.767 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-08T15:33:21.834 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-08T15:33:21.885 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-08T15:33:21.965 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-08T15:33:22.025 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-08T15:33:22.058 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:33:22.059 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-08T15:33:22.125 DEBUG:teuthology.orchestra.run.smithi182:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-08T15:33:22.230 DEBUG:teuthology.orchestra.run.smithi182:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-08T15:33:22.332 DEBUG:teuthology.orchestra.run.smithi182:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-08T15:33:22.437 DEBUG:teuthology.orchestra.run.smithi182:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-08T15:33:22.537 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:33:22.538 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-08T15:33:22.656 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2023-03-08T15:33:22.658 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2023-03-08T15:33:22.661 DEBUG:teuthology.orchestra.run.smithi182:> sudo service rsyslog restart 2023-03-08T15:33:22.718 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-08T15:33:22.721 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-08T15:33:22.845 INFO:teuthology.orchestra.run.smithi182.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-08T15:33:23.186 INFO:teuthology.run_tasks:Running task internal.timer... 2023-03-08T15:33:23.198 INFO:teuthology.task.internal:Starting timer... 2023-03-08T15:33:23.198 INFO:teuthology.run_tasks:Running task pcp... 2023-03-08T15:33:23.217 INFO:teuthology.run_tasks:Running task selinux... 2023-03-08T15:33:23.227 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-03-08T15:33:23.228 DEBUG:teuthology.orchestra.run.smithi123:> sudo service auditd rotate 2023-03-08T15:33:23.305 INFO:teuthology.orchestra.run.smithi123.stdout:Rotating logs: 2023-03-08T15:33:23.307 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2023-03-08T15:33:23.379 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2023-03-08T15:33:23.382 DEBUG:teuthology.orchestra.run.smithi182:> sudo service auditd rotate 2023-03-08T15:33:23.531 INFO:teuthology.orchestra.run.smithi182.stdout:Rotating logs: 2023-03-08T15:33:23.539 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-03-08T15:33:23.539 DEBUG:teuthology.orchestra.run.smithi123:> /usr/sbin/getenforce 2023-03-08T15:33:23.577 INFO:teuthology.orchestra.run.smithi123.stdout:Permissive 2023-03-08T15:33:23.577 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2023-03-08T15:33:23.605 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2023-03-08T15:33:23.605 DEBUG:teuthology.orchestra.run.smithi182:> /usr/sbin/getenforce 2023-03-08T15:33:23.689 INFO:teuthology.orchestra.run.smithi182.stdout:Permissive 2023-03-08T15:33:23.690 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi123.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi182.front.sepia.ceph.com': 'permissive'} 2023-03-08T15:33:23.690 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-08T15:33:23.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-08T15:33:23.720 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-08T15:33:23.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-08T15:33:23.749 DEBUG:teuthology.orchestra.run.smithi182:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-08T15:33:23.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-08T15:33:23.850 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-03-08T15:33:23.850 DEBUG:teuthology.orchestra.run.smithi123:> sudo /usr/sbin/setenforce permissive 2023-03-08T15:33:23.878 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2023-03-08T15:33:23.905 DEBUG:teuthology.orchestra.run.smithi182:> sudo /usr/sbin/setenforce permissive 2023-03-08T15:33:24.004 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-03-08T15:33:24.016 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-03-08T15:33:24.024 INFO:teuthology.repo_utils:Fetching main from origin 2023-03-08T15:33:24.164 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-03-08T15:33:24.189 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-03-08T15:33:24.191 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi123.front.sepia.ceph.com,smithi175.front.sepia.ceph.com,smithi182.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-03-08T15:45:49.664 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi123.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com'), Remote(name='ubuntu@smithi182.front.sepia.ceph.com')] 2023-03-08T15:45:49.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-03-08T15:45:49.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-08T15:45:49.734 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-03-08T15:45:49.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-03-08T15:45:49.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-08T15:45:49.877 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-03-08T15:45:49.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2023-03-08T15:45:49.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-08T15:45:50.040 DEBUG:teuthology.orchestra.run.smithi182:> true 2023-03-08T15:45:50.179 INFO:teuthology.run_tasks:Running task clock... 2023-03-08T15:45:50.189 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-03-08T15:45:50.190 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-08T15:45:50.191 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-08T15:45:50.193 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-08T15:45:50.193 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-08T15:45:50.195 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-08T15:45:50.196 DEBUG:teuthology.orchestra.run.smithi182:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-08T15:45:50.226 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-08T15:45:50.228 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-08T15:45:50.240 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-08T15:45:50.244 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-08T15:45:50.298 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-08T15:45:50.303 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: ntpd: command not found 2023-03-08T15:45:50.314 INFO:teuthology.orchestra.run.smithi123.stdout:506 Cannot talk to daemon 2023-03-08T15:45:50.317 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2023-03-08T15:45:50.328 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-08T15:45:50.329 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2023-03-08T15:45:50.341 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-08T15:45:50.343 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-08T15:45:50.344 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-08T15:45:50.358 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-08T15:45:50.409 INFO:teuthology.orchestra.run.smithi123.stderr:bash: ntpq: command not found 2023-03-08T15:45:50.412 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-08T15:45:50.412 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2023-03-08T15:45:50.413 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-08T15:45:50.413 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-08T15:45:50.413 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-08T15:45:50.413 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-08T15:45:50.425 INFO:teuthology.orchestra.run.smithi175.stderr:bash: ntpq: command not found 2023-03-08T15:45:50.428 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-08T15:45:50.428 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2023-03-08T15:45:50.429 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-08T15:45:50.429 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-08T15:45:50.429 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-08T15:45:50.429 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-08T15:45:50.461 INFO:teuthology.orchestra.run.smithi182.stderr:sudo: ntpd: command not found 2023-03-08T15:45:50.498 INFO:teuthology.orchestra.run.smithi182.stdout:506 Cannot talk to daemon 2023-03-08T15:45:50.541 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-08T15:45:50.586 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-08T15:45:50.708 INFO:teuthology.orchestra.run.smithi182.stderr:bash: ntpq: command not found 2023-03-08T15:45:50.718 INFO:teuthology.orchestra.run.smithi182.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-08T15:45:50.718 INFO:teuthology.orchestra.run.smithi182.stdout:=============================================================================== 2023-03-08T15:45:50.718 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-08T15:45:50.719 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-08T15:45:50.719 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-08T15:45:50.719 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-08T15:45:50.720 INFO:teuthology.run_tasks:Running task install... 2023-03-08T15:45:50.729 DEBUG:teuthology.task.install:project ceph 2023-03-08T15:45:50.730 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2b8f27f8eef4b6c46c66813a64c178fb019988a'}} 2023-03-08T15:45:50.730 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a2b8f27f8eef4b6c46c66813a64c178fb019988a'} 2023-03-08T15:45:50.730 INFO:teuthology.task.install:Using flavor: default 2023-03-08T15:45:50.736 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-03-08T15:45:50.736 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-03-08T15:45:50.737 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2b8f27f8eef4b6c46c66813a64c178fb019988a', 'tag': None, 'wait_for_package': False} 2023-03-08T15:45:50.738 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a2b8f27f8eef4b6c46c66813a64c178fb019988a 2023-03-08T15:45:50.740 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2b8f27f8eef4b6c46c66813a64c178fb019988a', 'tag': None, 'wait_for_package': False} 2023-03-08T15:45:50.740 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a2b8f27f8eef4b6c46c66813a64c178fb019988a 2023-03-08T15:45:50.741 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2b8f27f8eef4b6c46c66813a64c178fb019988a', 'tag': None, 'wait_for_package': False} 2023-03-08T15:45:50.741 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a2b8f27f8eef4b6c46c66813a64c178fb019988a 2023-03-08T15:45:50.883 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230308.112059/a2b8f27f8eef4b6c46c66813a64c178fb019988a/centos/8/flavors/default/ 2023-03-08T15:45:50.884 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2861.ga2b8f27f 2023-03-08T15:45:50.888 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230308.112059/a2b8f27f8eef4b6c46c66813a64c178fb019988a/centos/8/flavors/default/ 2023-03-08T15:45:50.888 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2861.ga2b8f27f 2023-03-08T15:45:50.894 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230308.112059/a2b8f27f8eef4b6c46c66813a64c178fb019988a/centos/8/flavors/default/ 2023-03-08T15:45:50.895 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2861.ga2b8f27f 2023-03-08T15:45:50.992 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230308.112059/a2b8f27f8eef4b6c46c66813a64c178fb019988a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230308.112059/a2b8f27f8eef4b6c46c66813a64c178fb019988a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230308.112059/a2b8f27f8eef4b6c46c66813a64c178fb019988a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-08T15:45:50.993 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:45:50.993 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-08T15:45:50.998 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230308.112059/a2b8f27f8eef4b6c46c66813a64c178fb019988a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230308.112059/a2b8f27f8eef4b6c46c66813a64c178fb019988a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230308.112059/a2b8f27f8eef4b6c46c66813a64c178fb019988a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-08T15:45:50.998 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:45:50.998 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-08T15:45:51.003 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230308.112059/a2b8f27f8eef4b6c46c66813a64c178fb019988a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230308.112059/a2b8f27f8eef4b6c46c66813a64c178fb019988a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230308.112059/a2b8f27f8eef4b6c46c66813a64c178fb019988a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-08T15:45:51.003 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:45:51.004 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-08T15:45:51.023 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-08T15:45:51.023 DEBUG:teuthology.orchestra.run.smithi123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2b8f27f8eef4b6c46c66813a64c178fb019988a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-08T15:45:51.033 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-08T15:45:51.033 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2b8f27f8eef4b6c46c66813a64c178fb019988a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-08T15:45:51.092 DEBUG:teuthology.orchestra.run.smithi123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-08T15:45:51.097 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-08T15:45:51.097 DEBUG:teuthology.orchestra.run.smithi182:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2b8f27f8eef4b6c46c66813a64c178fb019988a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-08T15:45:51.102 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-08T15:45:51.170 DEBUG:teuthology.orchestra.run.smithi123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-08T15:45:51.180 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-08T15:45:51.238 INFO:teuthology.orchestra.run.smithi123.stdout:check_obsoletes = 1 2023-03-08T15:45:51.239 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum clean all 2023-03-08T15:45:51.240 DEBUG:teuthology.orchestra.run.smithi182:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-08T15:45:51.247 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2023-03-08T15:45:51.248 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2023-03-08T15:45:51.374 DEBUG:teuthology.orchestra.run.smithi182:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-08T15:45:51.472 INFO:teuthology.orchestra.run.smithi182.stdout:check_obsoletes = 1 2023-03-08T15:45:51.478 DEBUG:teuthology.orchestra.run.smithi182:> sudo yum clean all 2023-03-08T15:45:51.500 INFO:teuthology.orchestra.run.smithi123.stdout:71 files removed 2023-03-08T15:45:51.510 INFO:teuthology.orchestra.run.smithi175.stdout:71 files removed 2023-03-08T15:45:51.530 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-08T15:45:51.541 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-08T15:45:51.891 INFO:teuthology.orchestra.run.smithi182.stdout:71 files removed 2023-03-08T15:45:51.938 DEBUG:teuthology.orchestra.run.smithi182:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-08T15:45:52.171 INFO:teuthology.orchestra.run.smithi123.stdout:ceph packages for x86_64 301 kB/s | 80 kB 00:00 2023-03-08T15:45:52.179 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 306 kB/s | 80 kB 00:00 2023-03-08T15:45:52.447 INFO:teuthology.orchestra.run.smithi123.stdout:ceph noarch packages 39 kB/s | 9.4 kB 00:00 2023-03-08T15:45:52.487 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 34 kB/s | 9.4 kB 00:00 2023-03-08T15:45:52.689 INFO:teuthology.orchestra.run.smithi123.stdout:ceph source packages 6.9 kB/s | 1.5 kB 00:00 2023-03-08T15:45:52.747 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 6.4 kB/s | 1.5 kB 00:00 2023-03-08T15:45:52.853 INFO:teuthology.orchestra.run.smithi182.stdout:ceph packages for x86_64 304 kB/s | 80 kB 00:00 2023-03-08T15:45:53.120 INFO:teuthology.orchestra.run.smithi182.stdout:ceph noarch packages 41 kB/s | 9.4 kB 00:00 2023-03-08T15:45:53.379 INFO:teuthology.orchestra.run.smithi182.stdout:ceph source packages 6.4 kB/s | 1.5 kB 00:00 2023-03-08T15:45:53.790 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS-8 - AppStream 28 MB/s | 28 MB 00:01 2023-03-08T15:45:54.217 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS-8 - AppStream 19 MB/s | 28 MB 00:01 2023-03-08T15:45:54.631 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS-8 - AppStream 23 MB/s | 28 MB 00:01 2023-03-08T15:45:59.791 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS-8 - BaseOS 30 MB/s | 27 MB 00:00 2023-03-08T15:46:00.267 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS-8 - BaseOS 30 MB/s | 27 MB 00:00 2023-03-08T15:46:01.190 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS-8 - BaseOS 31 MB/s | 27 MB 00:00 2023-03-08T15:46:04.081 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS-8 - Extras 146 kB/s | 18 kB 00:00 2023-03-08T15:46:05.250 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS-8 - PowerTools 5.5 MB/s | 5.7 MB 00:01 2023-03-08T15:46:05.741 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS-8 - Extras 14 kB/s | 18 kB 00:01 2023-03-08T15:46:05.839 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS-8 - Extras 140 kB/s | 18 kB 00:00 2023-03-08T15:46:06.243 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS-8 - PowerTools 15 MB/s | 5.7 MB 00:00 2023-03-08T15:46:06.292 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS-8 - PowerTools 18 MB/s | 5.7 MB 00:00 2023-03-08T15:46:06.507 INFO:teuthology.orchestra.run.smithi175.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-03-08T15:46:07.451 INFO:teuthology.orchestra.run.smithi123.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-03-08T15:46:07.674 INFO:teuthology.orchestra.run.smithi182.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-03-08T15:46:07.808 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 12 MB/s | 14 MB 00:01 2023-03-08T15:46:08.793 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 11 MB/s | 14 MB 00:01 2023-03-08T15:46:09.158 INFO:teuthology.orchestra.run.smithi182.stdout:Extra Packages for Enterprise Linux 10 MB/s | 14 MB 00:01 2023-03-08T15:46:11.225 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 377 kB/s | 24 kB 00:00 2023-03-08T15:46:12.135 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 421 kB/s | 24 kB 00:00 2023-03-08T15:46:13.400 INFO:teuthology.orchestra.run.smithi182.stdout:lab-extras 410 kB/s | 24 kB 00:00 2023-03-08T15:46:14.653 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-08T15:46:14.653 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-08T15:46:14.665 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.39.12-1.el8.x86_64 is already installed. 2023-03-08T15:46:14.665 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-initscripts-updown-1:1.39.12-1.el8.noarch is already installed. 2023-03-08T15:46:14.666 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-5.18.0-1.el8.x86_64 is already installed. 2023-03-08T15:46:14.667 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.32.1-38.el8.x86_64 is already installed. 2023-03-08T15:46:14.668 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-08T15:46:14.670 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-08T15:46:14.672 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-08T15:46:14.673 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-08T15:46:14.802 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2023-03-08T15:46:14.815 INFO:teuthology.orchestra.run.smithi175.stdout:========================================================================================================= 2023-03-08T15:46:14.816 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2023-03-08T15:46:14.816 INFO:teuthology.orchestra.run.smithi175.stdout:========================================================================================================= 2023-03-08T15:46:14.816 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2023-03-08T15:46:14.816 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2023-03-08T15:46:14.816 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 6.4 k 2023-03-08T15:46:14.816 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 5.4 M 2023-03-08T15:46:14.817 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 845 k 2023-03-08T15:46:14.817 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 166 k 2023-03-08T15:46:14.817 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 1.5 M 2023-03-08T15:46:14.817 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 123 k 2023-03-08T15:46:14.817 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 1.7 M 2023-03-08T15:46:14.817 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 7.4 M 2023-03-08T15:46:14.817 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 47 k 2023-03-08T15:46:14.817 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 13 M 2023-03-08T15:46:14.818 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 47 M 2023-03-08T15:46:14.818 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 263 k 2023-03-08T15:46:14.818 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 83 k 2023-03-08T15:46:14.818 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 257 k 2023-03-08T15:46:14.818 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 18 k 2023-03-08T15:46:14.818 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.188-3.el8 CentOS-BaseOS 61 k 2023-03-08T15:46:14.819 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2023-03-08T15:46:14.819 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 19 k 2023-03-08T15:46:14.819 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 30 k 2023-03-08T15:46:14.819 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 767 k 2023-03-08T15:46:14.819 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 139 k 2023-03-08T15:46:14.819 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2023-03-08T15:46:14.819 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.32.1-40.el8 CentOS-BaseOS 99 k 2023-03-08T15:46:14.820 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:1.1.1k-7.el8 CentOS-BaseOS 2.3 M 2023-03-08T15:46:14.820 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 1.5 M 2023-03-08T15:46:14.820 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 807 k 2023-03-08T15:46:14.820 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 5.1 M 2023-03-08T15:46:14.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 190 k 2023-03-08T15:46:14.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 369 k 2023-03-08T15:46:14.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 364 k 2023-03-08T15:46:14.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 106 k 2023-03-08T15:46:14.821 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 94 k 2023-03-08T15:46:14.821 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 3.4 M 2023-03-08T15:46:14.821 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 179 k 2023-03-08T15:46:14.821 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 CentOS-BaseOS 72 k 2023-03-08T15:46:14.821 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2023-03-08T15:46:14.821 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-initscripts-updown noarch 1:1.40.12-1.el8 CentOS-BaseOS 142 k 2023-03-08T15:46:14.822 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-debuginfod-client x86_64 0.188-3.el8 CentOS-BaseOS 75 k 2023-03-08T15:46:14.822 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf x86_64 0.188-3.el8 CentOS-BaseOS 231 k 2023-03-08T15:46:14.822 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libs x86_64 0.188-3.el8 CentOS-BaseOS 299 k 2023-03-08T15:46:14.822 INFO:teuthology.orchestra.run.smithi175.stdout: libblkid x86_64 2.32.1-40.el8 CentOS-BaseOS 220 k 2023-03-08T15:46:14.822 INFO:teuthology.orchestra.run.smithi175.stdout: libfdisk x86_64 2.32.1-40.el8 CentOS-BaseOS 253 k 2023-03-08T15:46:14.822 INFO:teuthology.orchestra.run.smithi175.stdout: libmount x86_64 2.32.1-40.el8 CentOS-BaseOS 236 k 2023-03-08T15:46:14.822 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 3.7 M 2023-03-08T15:46:14.822 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 3.6 M 2023-03-08T15:46:14.823 INFO:teuthology.orchestra.run.smithi175.stdout: libsmartcols x86_64 2.32.1-40.el8 CentOS-BaseOS 179 k 2023-03-08T15:46:14.823 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid x86_64 2.32.1-40.el8 CentOS-BaseOS 98 k 2023-03-08T15:46:14.823 INFO:teuthology.orchestra.run.smithi175.stdout: util-linux x86_64 2.32.1-40.el8 CentOS-BaseOS 2.5 M 2023-03-08T15:46:14.823 INFO:teuthology.orchestra.run.smithi175.stdout: util-linux-user x86_64 2.32.1-40.el8 CentOS-BaseOS 102 k 2023-03-08T15:46:14.823 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2023-03-08T15:46:14.823 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2023-03-08T15:46:14.823 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 22 M 2023-03-08T15:46:14.824 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 23 k 2023-03-08T15:46:14.824 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 2.3 M 2023-03-08T15:46:14.824 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 239 k 2023-03-08T15:46:14.824 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 4.6 M 2023-03-08T15:46:14.824 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 18 M 2023-03-08T15:46:14.824 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 15 k 2023-03-08T15:46:14.824 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 24 k 2023-03-08T15:46:14.824 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-03-08T15:46:14.825 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-08T15:46:14.825 INFO:teuthology.orchestra.run.smithi175.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-03-08T15:46:14.825 INFO:teuthology.orchestra.run.smithi175.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-BaseOS 48 k 2023-03-08T15:46:14.825 INFO:teuthology.orchestra.run.smithi175.stdout: krb5-devel x86_64 1.18.2-22.el8 CentOS-BaseOS 561 k 2023-03-08T15:46:14.825 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 137 k 2023-03-08T15:46:14.825 INFO:teuthology.orchestra.run.smithi175.stdout: libcom_err-devel x86_64 1.45.6-5.el8 CentOS-BaseOS 39 k 2023-03-08T15:46:14.825 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 8.5.0-18.el8 CentOS-BaseOS 645 k 2023-03-08T15:46:14.826 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-08T15:46:14.826 INFO:teuthology.orchestra.run.smithi175.stdout: libpq x86_64 13.5-1.el8 CentOS-AppStream 198 k 2023-03-08T15:46:14.826 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 8.5.0-18.el8 CentOS-BaseOS 172 k 2023-03-08T15:46:14.826 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-03-08T15:46:14.826 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 474 k 2023-03-08T15:46:14.826 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-03-08T15:46:14.826 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 6.5 M 2023-03-08T15:46:14.826 INFO:teuthology.orchestra.run.smithi175.stdout: libselinux-devel x86_64 2.9-6.el8 CentOS-BaseOS 200 k 2023-03-08T15:46:14.827 INFO:teuthology.orchestra.run.smithi175.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-BaseOS 87 k 2023-03-08T15:46:14.827 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-08T15:46:14.827 INFO:teuthology.orchestra.run.smithi175.stdout: libverto-devel x86_64 0.3.2-2.el8 CentOS-BaseOS 18 k 2023-03-08T15:46:14.827 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-03-08T15:46:14.827 INFO:teuthology.orchestra.run.smithi175.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-03-08T15:46:14.827 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-03-08T15:46:14.827 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-03-08T15:46:14.827 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-devel x86_64 10.32-3.el8 CentOS-BaseOS 605 k 2023-03-08T15:46:14.828 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf16 x86_64 10.32-3.el8 CentOS-BaseOS 229 k 2023-03-08T15:46:14.828 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf32 x86_64 10.32-3.el8 CentOS-BaseOS 220 k 2023-03-08T15:46:14.828 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-08T15:46:14.828 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-03-08T15:46:14.828 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-08T15:46:14.828 INFO:teuthology.orchestra.run.smithi175.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-08T15:46:14.828 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-08T15:46:14.829 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 45 k 2023-03-08T15:46:14.829 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 117 k 2023-03-08T15:46:14.829 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-08T15:46:14.829 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-03-08T15:46:14.829 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-08T15:46:14.829 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-08T15:46:14.829 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-03-08T15:46:14.829 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-08T15:46:14.830 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-08T15:46:14.830 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-08T15:46:14.830 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-03-08T15:46:14.830 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-03-08T15:46:14.830 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-03-08T15:46:14.830 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-03-08T15:46:14.830 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-08T15:46:14.830 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-08T15:46:14.831 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.0.6-14.el8 CentOS-AppStream 157 k 2023-03-08T15:46:14.831 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-03-08T15:46:14.831 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-08T15:46:14.831 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-08T15:46:14.831 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-03-08T15:46:14.831 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-03-08T15:46:14.831 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-03-08T15:46:14.832 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-08T15:46:14.832 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-08T15:46:14.832 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-03-08T15:46:14.832 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-03-08T15:46:14.832 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-03-08T15:46:14.832 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-03-08T15:46:14.832 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-03-08T15:46:14.832 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-03-08T15:46:14.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-08T15:46:14.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-03-08T15:46:14.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-08T15:46:14.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-08T15:46:14.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-03-08T15:46:14.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-08T15:46:14.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-08T15:46:14.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-08T15:46:14.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-08T15:46:14.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-08T15:46:14.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-08T15:46:14.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-08T15:46:14.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-08T15:46:14.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-03-08T15:46:14.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-08T15:46:14.835 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-03-08T15:46:14.835 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-08T15:46:14.835 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-43.el8 CentOS-AppStream 64 k 2023-03-08T15:46:14.835 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-03-08T15:46:14.835 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-19.el8 CentOS-BaseOS 58 k 2023-03-08T15:46:14.835 INFO:teuthology.orchestra.run.smithi175.stdout:Enabling module streams: 2023-03-08T15:46:14.835 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql 10 2023-03-08T15:46:14.835 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:46:14.836 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2023-03-08T15:46:14.836 INFO:teuthology.orchestra.run.smithi175.stdout:========================================================================================================= 2023-03-08T15:46:14.836 INFO:teuthology.orchestra.run.smithi175.stdout:Install 127 Packages 2023-03-08T15:46:14.836 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 13 Packages 2023-03-08T15:46:14.836 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:46:14.837 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 206 M 2023-03-08T15:46:14.837 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2023-03-08T15:46:15.142 INFO:teuthology.orchestra.run.smithi175.stdout:(1/140): ceph-18.0.0-2861.ga2b8f27f.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2023-03-08T15:46:15.596 INFO:teuthology.orchestra.run.smithi123.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-08T15:46:15.597 INFO:teuthology.orchestra.run.smithi123.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-08T15:46:15.609 INFO:teuthology.orchestra.run.smithi123.stdout:Package NetworkManager-1:1.39.12-1.el8.x86_64 is already installed. 2023-03-08T15:46:15.609 INFO:teuthology.orchestra.run.smithi123.stdout:Package NetworkManager-initscripts-updown-1:1.39.12-1.el8.noarch is already installed. 2023-03-08T15:46:15.610 INFO:teuthology.orchestra.run.smithi123.stdout:Package iproute-5.18.0-1.el8.x86_64 is already installed. 2023-03-08T15:46:15.610 INFO:teuthology.orchestra.run.smithi123.stdout:Package util-linux-2.32.1-38.el8.x86_64 is already installed. 2023-03-08T15:46:15.611 INFO:teuthology.orchestra.run.smithi123.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-08T15:46:15.613 INFO:teuthology.orchestra.run.smithi123.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-08T15:46:15.616 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-08T15:46:15.617 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-08T15:46:15.748 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-03-08T15:46:15.761 INFO:teuthology.orchestra.run.smithi123.stdout:========================================================================================================= 2023-03-08T15:46:15.761 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2023-03-08T15:46:15.761 INFO:teuthology.orchestra.run.smithi123.stdout:========================================================================================================= 2023-03-08T15:46:15.761 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-03-08T15:46:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2023-03-08T15:46:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: ceph x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 6.4 k 2023-03-08T15:46:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 5.4 M 2023-03-08T15:46:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 845 k 2023-03-08T15:46:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 166 k 2023-03-08T15:46:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 1.5 M 2023-03-08T15:46:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 123 k 2023-03-08T15:46:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 1.7 M 2023-03-08T15:46:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 7.4 M 2023-03-08T15:46:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 47 k 2023-03-08T15:46:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 13 M 2023-03-08T15:46:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 47 M 2023-03-08T15:46:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 263 k 2023-03-08T15:46:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 83 k 2023-03-08T15:46:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 257 k 2023-03-08T15:46:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 18 k 2023-03-08T15:46:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel x86_64 0.188-3.el8 CentOS-BaseOS 61 k 2023-03-08T15:46:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2023-03-08T15:46:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 19 k 2023-03-08T15:46:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 30 k 2023-03-08T15:46:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 767 k 2023-03-08T15:46:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 139 k 2023-03-08T15:46:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2023-03-08T15:46:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel x86_64 2.32.1-40.el8 CentOS-BaseOS 99 k 2023-03-08T15:46:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel x86_64 1:1.1.1k-7.el8 CentOS-BaseOS 2.3 M 2023-03-08T15:46:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 1.5 M 2023-03-08T15:46:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 807 k 2023-03-08T15:46:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 5.1 M 2023-03-08T15:46:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 190 k 2023-03-08T15:46:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 369 k 2023-03-08T15:46:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 364 k 2023-03-08T15:46:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 106 k 2023-03-08T15:46:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 94 k 2023-03-08T15:46:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 3.4 M 2023-03-08T15:46:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 179 k 2023-03-08T15:46:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 CentOS-BaseOS 72 k 2023-03-08T15:46:15.767 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2023-03-08T15:46:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-initscripts-updown noarch 1:1.40.12-1.el8 CentOS-BaseOS 142 k 2023-03-08T15:46:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-debuginfod-client x86_64 0.188-3.el8 CentOS-BaseOS 75 k 2023-03-08T15:46:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf x86_64 0.188-3.el8 CentOS-BaseOS 231 k 2023-03-08T15:46:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libs x86_64 0.188-3.el8 CentOS-BaseOS 299 k 2023-03-08T15:46:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: libblkid x86_64 2.32.1-40.el8 CentOS-BaseOS 220 k 2023-03-08T15:46:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: libfdisk x86_64 2.32.1-40.el8 CentOS-BaseOS 253 k 2023-03-08T15:46:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: libmount x86_64 2.32.1-40.el8 CentOS-BaseOS 236 k 2023-03-08T15:46:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 3.7 M 2023-03-08T15:46:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1 x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 3.6 M 2023-03-08T15:46:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: libsmartcols x86_64 2.32.1-40.el8 CentOS-BaseOS 179 k 2023-03-08T15:46:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid x86_64 2.32.1-40.el8 CentOS-BaseOS 98 k 2023-03-08T15:46:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux x86_64 2.32.1-40.el8 CentOS-BaseOS 2.5 M 2023-03-08T15:46:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-user x86_64 2.32.1-40.el8 CentOS-BaseOS 102 k 2023-03-08T15:46:15.769 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2023-03-08T15:46:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2023-03-08T15:46:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 22 M 2023-03-08T15:46:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 23 k 2023-03-08T15:46:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 2.3 M 2023-03-08T15:46:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 239 k 2023-03-08T15:46:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 4.6 M 2023-03-08T15:46:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 18 M 2023-03-08T15:46:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 15 k 2023-03-08T15:46:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 24 k 2023-03-08T15:46:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-03-08T15:46:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-08T15:46:15.771 INFO:teuthology.orchestra.run.smithi123.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-03-08T15:46:15.771 INFO:teuthology.orchestra.run.smithi123.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-BaseOS 48 k 2023-03-08T15:46:15.771 INFO:teuthology.orchestra.run.smithi123.stdout: krb5-devel x86_64 1.18.2-22.el8 CentOS-BaseOS 561 k 2023-03-08T15:46:15.771 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 137 k 2023-03-08T15:46:15.771 INFO:teuthology.orchestra.run.smithi123.stdout: libcom_err-devel x86_64 1.45.6-5.el8 CentOS-BaseOS 39 k 2023-03-08T15:46:15.771 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran x86_64 8.5.0-18.el8 CentOS-BaseOS 645 k 2023-03-08T15:46:15.771 INFO:teuthology.orchestra.run.smithi123.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-08T15:46:15.772 INFO:teuthology.orchestra.run.smithi123.stdout: libpq x86_64 13.5-1.el8 CentOS-AppStream 198 k 2023-03-08T15:46:15.772 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath x86_64 8.5.0-18.el8 CentOS-BaseOS 172 k 2023-03-08T15:46:15.772 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-03-08T15:46:15.772 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 474 k 2023-03-08T15:46:15.772 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-03-08T15:46:15.772 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2 x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 6.5 M 2023-03-08T15:46:15.772 INFO:teuthology.orchestra.run.smithi123.stdout: libselinux-devel x86_64 2.9-6.el8 CentOS-BaseOS 200 k 2023-03-08T15:46:15.773 INFO:teuthology.orchestra.run.smithi123.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-BaseOS 87 k 2023-03-08T15:46:15.773 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-08T15:46:15.773 INFO:teuthology.orchestra.run.smithi123.stdout: libverto-devel x86_64 0.3.2-2.el8 CentOS-BaseOS 18 k 2023-03-08T15:46:15.773 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-03-08T15:46:15.773 INFO:teuthology.orchestra.run.smithi123.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-03-08T15:46:15.773 INFO:teuthology.orchestra.run.smithi123.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-03-08T15:46:15.773 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-03-08T15:46:15.774 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-devel x86_64 10.32-3.el8 CentOS-BaseOS 605 k 2023-03-08T15:46:15.774 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf16 x86_64 10.32-3.el8 CentOS-BaseOS 229 k 2023-03-08T15:46:15.774 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf32 x86_64 10.32-3.el8 CentOS-BaseOS 220 k 2023-03-08T15:46:15.774 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-08T15:46:15.774 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-03-08T15:46:15.774 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-08T15:46:15.774 INFO:teuthology.orchestra.run.smithi123.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-08T15:46:15.775 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-08T15:46:15.775 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 45 k 2023-03-08T15:46:15.775 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 117 k 2023-03-08T15:46:15.775 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-08T15:46:15.775 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-03-08T15:46:15.775 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-08T15:46:15.775 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-08T15:46:15.776 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-03-08T15:46:15.776 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-08T15:46:15.776 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-08T15:46:15.776 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-08T15:46:15.776 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-03-08T15:46:15.776 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-03-08T15:46:15.776 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-03-08T15:46:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-03-08T15:46:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-08T15:46:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-08T15:46:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako noarch 1.0.6-14.el8 CentOS-AppStream 157 k 2023-03-08T15:46:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-03-08T15:46:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-08T15:46:15.777 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-08T15:46:15.778 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-03-08T15:46:15.778 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-03-08T15:46:15.778 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-03-08T15:46:15.778 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-08T15:46:15.778 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-08T15:46:15.778 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-03-08T15:46:15.778 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-03-08T15:46:15.779 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-03-08T15:46:15.779 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-03-08T15:46:15.779 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-03-08T15:46:15.779 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-03-08T15:46:15.779 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-08T15:46:15.779 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-03-08T15:46:15.779 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-08T15:46:15.780 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-08T15:46:15.780 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-03-08T15:46:15.780 INFO:teuthology.orchestra.run.smithi123.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-08T15:46:15.780 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-08T15:46:15.780 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-08T15:46:15.780 INFO:teuthology.orchestra.run.smithi123.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-08T15:46:15.780 INFO:teuthology.orchestra.run.smithi123.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-08T15:46:15.781 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-08T15:46:15.781 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-08T15:46:15.781 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-08T15:46:15.781 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-03-08T15:46:15.781 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-08T15:46:15.781 INFO:teuthology.orchestra.run.smithi123.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-03-08T15:46:15.781 INFO:teuthology.orchestra.run.smithi123.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-08T15:46:15.782 INFO:teuthology.orchestra.run.smithi123.stdout: uuid x86_64 1.6.2-43.el8 CentOS-AppStream 64 k 2023-03-08T15:46:15.782 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-03-08T15:46:15.782 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel x86_64 1.2.11-19.el8 CentOS-BaseOS 58 k 2023-03-08T15:46:15.782 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling module streams: 2023-03-08T15:46:15.782 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql 10 2023-03-08T15:46:15.782 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:46:15.782 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-03-08T15:46:15.783 INFO:teuthology.orchestra.run.smithi123.stdout:========================================================================================================= 2023-03-08T15:46:15.783 INFO:teuthology.orchestra.run.smithi123.stdout:Install 127 Packages 2023-03-08T15:46:15.783 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 13 Packages 2023-03-08T15:46:15.783 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:46:15.783 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 206 M 2023-03-08T15:46:15.784 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-03-08T15:46:16.069 INFO:teuthology.orchestra.run.smithi123.stdout:(1/140): ceph-18.0.0-2861.ga2b8f27f.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2023-03-08T15:46:16.117 INFO:teuthology.orchestra.run.smithi175.stdout:(2/140): ceph-fuse-18.0.0-2861.ga2b8f27f.el8.x8 867 kB/s | 845 kB 00:00 2023-03-08T15:46:16.308 INFO:teuthology.orchestra.run.smithi175.stdout:(3/140): ceph-immutable-object-cache-18.0.0-286 872 kB/s | 166 kB 00:00 2023-03-08T15:46:16.969 INFO:teuthology.orchestra.run.smithi123.stdout:(2/140): ceph-fuse-18.0.0-2861.ga2b8f27f.el8.x8 939 kB/s | 845 kB 00:00 2023-03-08T15:46:17.116 INFO:teuthology.orchestra.run.smithi182.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-08T15:46:17.117 INFO:teuthology.orchestra.run.smithi182.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-08T15:46:17.128 INFO:teuthology.orchestra.run.smithi123.stdout:(3/140): ceph-immutable-object-cache-18.0.0-286 1.0 MB/s | 166 kB 00:00 2023-03-08T15:46:17.129 INFO:teuthology.orchestra.run.smithi182.stdout:Package NetworkManager-1:1.39.12-1.el8.x86_64 is already installed. 2023-03-08T15:46:17.129 INFO:teuthology.orchestra.run.smithi182.stdout:Package NetworkManager-initscripts-updown-1:1.39.12-1.el8.noarch is already installed. 2023-03-08T15:46:17.130 INFO:teuthology.orchestra.run.smithi182.stdout:Package iproute-5.18.0-1.el8.x86_64 is already installed. 2023-03-08T15:46:17.131 INFO:teuthology.orchestra.run.smithi182.stdout:Package util-linux-2.32.1-38.el8.x86_64 is already installed. 2023-03-08T15:46:17.132 INFO:teuthology.orchestra.run.smithi182.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-08T15:46:17.134 INFO:teuthology.orchestra.run.smithi182.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-08T15:46:17.136 INFO:teuthology.orchestra.run.smithi182.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-08T15:46:17.137 INFO:teuthology.orchestra.run.smithi182.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-08T15:46:17.275 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies resolved. 2023-03-08T15:46:17.289 INFO:teuthology.orchestra.run.smithi182.stdout:========================================================================================================= 2023-03-08T15:46:17.289 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository Size 2023-03-08T15:46:17.289 INFO:teuthology.orchestra.run.smithi182.stdout:========================================================================================================= 2023-03-08T15:46:17.289 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2023-03-08T15:46:17.289 INFO:teuthology.orchestra.run.smithi182.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2023-03-08T15:46:17.290 INFO:teuthology.orchestra.run.smithi182.stdout: ceph x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 6.4 k 2023-03-08T15:46:17.290 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-base x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 5.4 M 2023-03-08T15:46:17.290 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-fuse x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 845 k 2023-03-08T15:46:17.290 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 166 k 2023-03-08T15:46:17.290 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 1.5 M 2023-03-08T15:46:17.290 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 123 k 2023-03-08T15:46:17.290 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 1.7 M 2023-03-08T15:46:17.291 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 7.4 M 2023-03-08T15:46:17.291 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-rook noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 47 k 2023-03-08T15:46:17.291 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-radosgw x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 13 M 2023-03-08T15:46:17.291 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-test x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 47 M 2023-03-08T15:46:17.291 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-volume noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 263 k 2023-03-08T15:46:17.291 INFO:teuthology.orchestra.run.smithi182.stdout: cephadm noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 83 k 2023-03-08T15:46:17.291 INFO:teuthology.orchestra.run.smithi182.stdout: cephfs-mirror x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 257 k 2023-03-08T15:46:17.292 INFO:teuthology.orchestra.run.smithi182.stdout: cephfs-top noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 18 k 2023-03-08T15:46:17.292 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-libelf-devel x86_64 0.188-3.el8 CentOS-BaseOS 61 k 2023-03-08T15:46:17.292 INFO:teuthology.orchestra.run.smithi182.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2023-03-08T15:46:17.292 INFO:teuthology.orchestra.run.smithi182.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 19 k 2023-03-08T15:46:17.292 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs-devel x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 30 k 2023-03-08T15:46:17.292 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs2 x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 767 k 2023-03-08T15:46:17.292 INFO:teuthology.orchestra.run.smithi182.stdout: librados-devel x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 139 k 2023-03-08T15:46:17.293 INFO:teuthology.orchestra.run.smithi182.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2023-03-08T15:46:17.293 INFO:teuthology.orchestra.run.smithi182.stdout: libuuid-devel x86_64 2.32.1-40.el8 CentOS-BaseOS 99 k 2023-03-08T15:46:17.293 INFO:teuthology.orchestra.run.smithi182.stdout: openssl-devel x86_64 1:1.1.1k-7.el8 CentOS-BaseOS 2.3 M 2023-03-08T15:46:17.293 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 1.5 M 2023-03-08T15:46:17.293 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql-contrib x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 807 k 2023-03-08T15:46:17.293 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql-server x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 5.1 M 2023-03-08T15:46:17.293 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cephfs x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 190 k 2023-03-08T15:46:17.294 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rados x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 369 k 2023-03-08T15:46:17.294 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rbd x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 364 k 2023-03-08T15:46:17.294 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rgw x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 106 k 2023-03-08T15:46:17.294 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-fuse x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 94 k 2023-03-08T15:46:17.294 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-mirror x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 3.4 M 2023-03-08T15:46:17.294 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-nbd x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 179 k 2023-03-08T15:46:17.294 INFO:teuthology.orchestra.run.smithi182.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 CentOS-BaseOS 72 k 2023-03-08T15:46:17.295 INFO:teuthology.orchestra.run.smithi182.stdout:Upgrading: 2023-03-08T15:46:17.295 INFO:teuthology.orchestra.run.smithi182.stdout: NetworkManager-initscripts-updown noarch 1:1.40.12-1.el8 CentOS-BaseOS 142 k 2023-03-08T15:46:17.295 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-debuginfod-client x86_64 0.188-3.el8 CentOS-BaseOS 75 k 2023-03-08T15:46:17.295 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-libelf x86_64 0.188-3.el8 CentOS-BaseOS 231 k 2023-03-08T15:46:17.295 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-libs x86_64 0.188-3.el8 CentOS-BaseOS 299 k 2023-03-08T15:46:17.295 INFO:teuthology.orchestra.run.smithi182.stdout: libblkid x86_64 2.32.1-40.el8 CentOS-BaseOS 220 k 2023-03-08T15:46:17.295 INFO:teuthology.orchestra.run.smithi182.stdout: libfdisk x86_64 2.32.1-40.el8 CentOS-BaseOS 253 k 2023-03-08T15:46:17.295 INFO:teuthology.orchestra.run.smithi182.stdout: libmount x86_64 2.32.1-40.el8 CentOS-BaseOS 236 k 2023-03-08T15:46:17.296 INFO:teuthology.orchestra.run.smithi182.stdout: librados2 x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 3.7 M 2023-03-08T15:46:17.296 INFO:teuthology.orchestra.run.smithi182.stdout: librbd1 x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 3.6 M 2023-03-08T15:46:17.296 INFO:teuthology.orchestra.run.smithi182.stdout: libsmartcols x86_64 2.32.1-40.el8 CentOS-BaseOS 179 k 2023-03-08T15:46:17.296 INFO:teuthology.orchestra.run.smithi182.stdout: libuuid x86_64 2.32.1-40.el8 CentOS-BaseOS 98 k 2023-03-08T15:46:17.296 INFO:teuthology.orchestra.run.smithi182.stdout: util-linux x86_64 2.32.1-40.el8 CentOS-BaseOS 2.5 M 2023-03-08T15:46:17.296 INFO:teuthology.orchestra.run.smithi182.stdout: util-linux-user x86_64 2.32.1-40.el8 CentOS-BaseOS 102 k 2023-03-08T15:46:17.296 INFO:teuthology.orchestra.run.smithi182.stdout:Installing dependencies: 2023-03-08T15:46:17.297 INFO:teuthology.orchestra.run.smithi182.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2023-03-08T15:46:17.297 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-common x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 22 M 2023-03-08T15:46:17.297 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 23 k 2023-03-08T15:46:17.297 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mds x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 2.3 M 2023-03-08T15:46:17.297 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 239 k 2023-03-08T15:46:17.297 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mon x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 4.6 M 2023-03-08T15:46:17.297 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-osd x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 18 M 2023-03-08T15:46:17.297 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2861.ga2b8f27f.el8 ceph-noarch 15 k 2023-03-08T15:46:17.298 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-selinux x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 24 k 2023-03-08T15:46:17.298 INFO:teuthology.orchestra.run.smithi182.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-03-08T15:46:17.298 INFO:teuthology.orchestra.run.smithi182.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-08T15:46:17.298 INFO:teuthology.orchestra.run.smithi182.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-03-08T15:46:17.298 INFO:teuthology.orchestra.run.smithi182.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-BaseOS 48 k 2023-03-08T15:46:17.298 INFO:teuthology.orchestra.run.smithi182.stdout: krb5-devel x86_64 1.18.2-22.el8 CentOS-BaseOS 561 k 2023-03-08T15:46:17.298 INFO:teuthology.orchestra.run.smithi182.stdout: libcephsqlite x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 137 k 2023-03-08T15:46:17.299 INFO:teuthology.orchestra.run.smithi182.stdout: libcom_err-devel x86_64 1.45.6-5.el8 CentOS-BaseOS 39 k 2023-03-08T15:46:17.299 INFO:teuthology.orchestra.run.smithi182.stdout: libgfortran x86_64 8.5.0-18.el8 CentOS-BaseOS 645 k 2023-03-08T15:46:17.299 INFO:teuthology.orchestra.run.smithi182.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-08T15:46:17.299 INFO:teuthology.orchestra.run.smithi182.stdout: libpq x86_64 13.5-1.el8 CentOS-AppStream 198 k 2023-03-08T15:46:17.299 INFO:teuthology.orchestra.run.smithi182.stdout: libquadmath x86_64 8.5.0-18.el8 CentOS-BaseOS 172 k 2023-03-08T15:46:17.299 INFO:teuthology.orchestra.run.smithi182.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-03-08T15:46:17.299 INFO:teuthology.orchestra.run.smithi182.stdout: libradosstriper1 x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 474 k 2023-03-08T15:46:17.299 INFO:teuthology.orchestra.run.smithi182.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-03-08T15:46:17.300 INFO:teuthology.orchestra.run.smithi182.stdout: librgw2 x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 6.5 M 2023-03-08T15:46:17.300 INFO:teuthology.orchestra.run.smithi182.stdout: libselinux-devel x86_64 2.9-6.el8 CentOS-BaseOS 200 k 2023-03-08T15:46:17.300 INFO:teuthology.orchestra.run.smithi182.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-BaseOS 87 k 2023-03-08T15:46:17.300 INFO:teuthology.orchestra.run.smithi182.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-08T15:46:17.300 INFO:teuthology.orchestra.run.smithi182.stdout: libverto-devel x86_64 0.3.2-2.el8 CentOS-BaseOS 18 k 2023-03-08T15:46:17.300 INFO:teuthology.orchestra.run.smithi182.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-03-08T15:46:17.300 INFO:teuthology.orchestra.run.smithi182.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-03-08T15:46:17.300 INFO:teuthology.orchestra.run.smithi182.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-03-08T15:46:17.301 INFO:teuthology.orchestra.run.smithi182.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-03-08T15:46:17.301 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-devel x86_64 10.32-3.el8 CentOS-BaseOS 605 k 2023-03-08T15:46:17.301 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-utf16 x86_64 10.32-3.el8 CentOS-BaseOS 229 k 2023-03-08T15:46:17.301 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-utf32 x86_64 10.32-3.el8 CentOS-BaseOS 220 k 2023-03-08T15:46:17.301 INFO:teuthology.orchestra.run.smithi182.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-08T15:46:17.301 INFO:teuthology.orchestra.run.smithi182.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-03-08T15:46:17.301 INFO:teuthology.orchestra.run.smithi182.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-08T15:46:17.302 INFO:teuthology.orchestra.run.smithi182.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-08T15:46:17.302 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-08T15:46:17.302 INFO:teuthology.orchestra.run.smithi182.stdout: python3-ceph-argparse x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 45 k 2023-03-08T15:46:17.302 INFO:teuthology.orchestra.run.smithi182.stdout: python3-ceph-common x86_64 2:18.0.0-2861.ga2b8f27f.el8 ceph 117 k 2023-03-08T15:46:17.302 INFO:teuthology.orchestra.run.smithi182.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-08T15:46:17.302 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-03-08T15:46:17.302 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-08T15:46:17.303 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-08T15:46:17.303 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-03-08T15:46:17.303 INFO:teuthology.orchestra.run.smithi182.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-08T15:46:17.303 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-08T15:46:17.303 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-08T15:46:17.303 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-03-08T15:46:17.303 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-03-08T15:46:17.303 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-03-08T15:46:17.304 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-03-08T15:46:17.304 INFO:teuthology.orchestra.run.smithi182.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-08T15:46:17.304 INFO:teuthology.orchestra.run.smithi182.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-08T15:46:17.304 INFO:teuthology.orchestra.run.smithi182.stdout: python3-mako noarch 1.0.6-14.el8 CentOS-AppStream 157 k 2023-03-08T15:46:17.304 INFO:teuthology.orchestra.run.smithi182.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-03-08T15:46:17.304 INFO:teuthology.orchestra.run.smithi182.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-08T15:46:17.304 INFO:teuthology.orchestra.run.smithi182.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-08T15:46:17.304 INFO:teuthology.orchestra.run.smithi182.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-03-08T15:46:17.305 INFO:teuthology.orchestra.run.smithi182.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-03-08T15:46:17.305 INFO:teuthology.orchestra.run.smithi182.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-03-08T15:46:17.305 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-08T15:46:17.305 INFO:teuthology.orchestra.run.smithi182.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-08T15:46:17.305 INFO:teuthology.orchestra.run.smithi182.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-03-08T15:46:17.305 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-03-08T15:46:17.305 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-03-08T15:46:17.306 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-03-08T15:46:17.306 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-03-08T15:46:17.306 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-03-08T15:46:17.306 INFO:teuthology.orchestra.run.smithi182.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-08T15:46:17.306 INFO:teuthology.orchestra.run.smithi182.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-03-08T15:46:17.306 INFO:teuthology.orchestra.run.smithi182.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-08T15:46:17.306 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-08T15:46:17.307 INFO:teuthology.orchestra.run.smithi182.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-03-08T15:46:17.307 INFO:teuthology.orchestra.run.smithi182.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-08T15:46:17.307 INFO:teuthology.orchestra.run.smithi182.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-08T15:46:17.307 INFO:teuthology.orchestra.run.smithi182.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-08T15:46:17.307 INFO:teuthology.orchestra.run.smithi182.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-08T15:46:17.307 INFO:teuthology.orchestra.run.smithi182.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-08T15:46:17.308 INFO:teuthology.orchestra.run.smithi182.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-08T15:46:17.308 INFO:teuthology.orchestra.run.smithi182.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-08T15:46:17.308 INFO:teuthology.orchestra.run.smithi182.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-08T15:46:17.308 INFO:teuthology.orchestra.run.smithi182.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-03-08T15:46:17.308 INFO:teuthology.orchestra.run.smithi182.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-08T15:46:17.308 INFO:teuthology.orchestra.run.smithi182.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-03-08T15:46:17.308 INFO:teuthology.orchestra.run.smithi182.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-08T15:46:17.309 INFO:teuthology.orchestra.run.smithi182.stdout: uuid x86_64 1.6.2-43.el8 CentOS-AppStream 64 k 2023-03-08T15:46:17.309 INFO:teuthology.orchestra.run.smithi182.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-03-08T15:46:17.309 INFO:teuthology.orchestra.run.smithi182.stdout: zlib-devel x86_64 1.2.11-19.el8 CentOS-BaseOS 58 k 2023-03-08T15:46:17.309 INFO:teuthology.orchestra.run.smithi182.stdout:Enabling module streams: 2023-03-08T15:46:17.309 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql 10 2023-03-08T15:46:17.309 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:46:17.310 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2023-03-08T15:46:17.310 INFO:teuthology.orchestra.run.smithi182.stdout:========================================================================================================= 2023-03-08T15:46:17.310 INFO:teuthology.orchestra.run.smithi182.stdout:Install 127 Packages 2023-03-08T15:46:17.310 INFO:teuthology.orchestra.run.smithi182.stdout:Upgrade 13 Packages 2023-03-08T15:46:17.310 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:46:17.311 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 206 M 2023-03-08T15:46:17.311 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading Packages: 2023-03-08T15:46:17.353 INFO:teuthology.orchestra.run.smithi175.stdout:(4/140): ceph-mds-18.0.0-2861.ga2b8f27f.el8.x86 2.2 MB/s | 2.3 MB 00:01 2023-03-08T15:46:17.660 INFO:teuthology.orchestra.run.smithi182.stdout:(1/140): ceph-18.0.0-2861.ga2b8f27f.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2023-03-08T15:46:17.835 INFO:teuthology.orchestra.run.smithi175.stdout:(5/140): ceph-base-18.0.0-2861.ga2b8f27f.el8.x8 1.8 MB/s | 5.4 MB 00:03 2023-03-08T15:46:18.010 INFO:teuthology.orchestra.run.smithi175.stdout:(6/140): ceph-mgr-18.0.0-2861.ga2b8f27f.el8.x86 2.4 MB/s | 1.5 MB 00:00 2023-03-08T15:46:18.728 INFO:teuthology.orchestra.run.smithi123.stdout:(4/140): ceph-mds-18.0.0-2861.ga2b8f27f.el8.x86 1.4 MB/s | 2.3 MB 00:01 2023-03-08T15:46:19.035 INFO:teuthology.orchestra.run.smithi182.stdout:(2/140): ceph-fuse-18.0.0-2861.ga2b8f27f.el8.x8 614 kB/s | 845 kB 00:01 2023-03-08T15:46:19.302 INFO:teuthology.orchestra.run.smithi175.stdout:(7/140): ceph-mon-18.0.0-2861.ga2b8f27f.el8.x86 3.1 MB/s | 4.6 MB 00:01 2023-03-08T15:46:19.327 INFO:teuthology.orchestra.run.smithi182.stdout:(3/140): ceph-immutable-object-cache-18.0.0-286 569 kB/s | 166 kB 00:00 2023-03-08T15:46:19.720 INFO:teuthology.orchestra.run.smithi123.stdout:(5/140): ceph-mgr-18.0.0-2861.ga2b8f27f.el8.x86 1.6 MB/s | 1.5 MB 00:00 2023-03-08T15:46:19.987 INFO:teuthology.orchestra.run.smithi123.stdout:(6/140): ceph-base-18.0.0-2861.ga2b8f27f.el8.x8 1.3 MB/s | 5.4 MB 00:04 2023-03-08T15:46:22.387 INFO:teuthology.orchestra.run.smithi123.stdout:(7/140): ceph-mon-18.0.0-2861.ga2b8f27f.el8.x86 1.7 MB/s | 4.6 MB 00:02 2023-03-08T15:46:22.460 INFO:teuthology.orchestra.run.smithi182.stdout:(4/140): ceph-mds-18.0.0-2861.ga2b8f27f.el8.x86 743 kB/s | 2.3 MB 00:03 2023-03-08T15:46:23.126 INFO:teuthology.orchestra.run.smithi175.stdout:(8/140): ceph-radosgw-18.0.0-2861.ga2b8f27f.el8 3.4 MB/s | 13 MB 00:03 2023-03-08T15:46:23.319 INFO:teuthology.orchestra.run.smithi182.stdout:(5/140): ceph-base-18.0.0-2861.ga2b8f27f.el8.x8 916 kB/s | 5.4 MB 00:06 2023-03-08T15:46:23.385 INFO:teuthology.orchestra.run.smithi175.stdout:(9/140): ceph-common-18.0.0-2861.ga2b8f27f.el8. 2.5 MB/s | 22 MB 00:08 2023-03-08T15:46:23.410 INFO:teuthology.orchestra.run.smithi175.stdout:(10/140): ceph-selinux-18.0.0-2861.ga2b8f27f.el 86 kB/s | 24 kB 00:00 2023-03-08T15:46:23.569 INFO:teuthology.orchestra.run.smithi175.stdout:(11/140): cephfs-mirror-18.0.0-2861.ga2b8f27f.e 1.6 MB/s | 257 kB 00:00 2023-03-08T15:46:23.660 INFO:teuthology.orchestra.run.smithi175.stdout:(12/140): libcephfs-devel-18.0.0-2861.ga2b8f27f 332 kB/s | 30 kB 00:00 2023-03-08T15:46:23.769 INFO:teuthology.orchestra.run.smithi182.stdout:(6/140): ceph-mgr-18.0.0-2861.ga2b8f27f.el8.x86 1.2 MB/s | 1.5 MB 00:01 2023-03-08T15:46:23.944 INFO:teuthology.orchestra.run.smithi175.stdout:(13/140): libcephfs2-18.0.0-2861.ga2b8f27f.el8. 2.6 MB/s | 767 kB 00:00 2023-03-08T15:46:24.028 INFO:teuthology.orchestra.run.smithi175.stdout:(14/140): libcephsqlite-18.0.0-2861.ga2b8f27f.e 1.6 MB/s | 137 kB 00:00 2023-03-08T15:46:24.128 INFO:teuthology.orchestra.run.smithi175.stdout:(15/140): librados-devel-18.0.0-2861.ga2b8f27f. 1.4 MB/s | 139 kB 00:00 2023-03-08T15:46:24.311 INFO:teuthology.orchestra.run.smithi175.stdout:(16/140): libradosstriper1-18.0.0-2861.ga2b8f27 2.5 MB/s | 474 kB 00:00 2023-03-08T15:46:25.378 INFO:teuthology.orchestra.run.smithi175.stdout:(17/140): ceph-osd-18.0.0-2861.ga2b8f27f.el8.x8 2.4 MB/s | 18 MB 00:07 2023-03-08T15:46:25.436 INFO:teuthology.orchestra.run.smithi182.stdout:(7/140): ceph-common-18.0.0-2861.ga2b8f27f.el8. 2.7 MB/s | 22 MB 00:08 2023-03-08T15:46:25.479 INFO:teuthology.orchestra.run.smithi175.stdout:(18/140): python3-ceph-argparse-18.0.0-2861.ga2 446 kB/s | 45 kB 00:00 2023-03-08T15:46:25.570 INFO:teuthology.orchestra.run.smithi175.stdout:(19/140): python3-ceph-common-18.0.0-2861.ga2b8 1.2 MB/s | 117 kB 00:00 2023-03-08T15:46:25.746 INFO:teuthology.orchestra.run.smithi175.stdout:(20/140): python3-cephfs-18.0.0-2861.ga2b8f27f. 1.1 MB/s | 190 kB 00:00 2023-03-08T15:46:26.004 INFO:teuthology.orchestra.run.smithi175.stdout:(21/140): python3-rados-18.0.0-2861.ga2b8f27f.e 1.4 MB/s | 369 kB 00:00 2023-03-08T15:46:26.263 INFO:teuthology.orchestra.run.smithi175.stdout:(22/140): python3-rbd-18.0.0-2861.ga2b8f27f.el8 1.4 MB/s | 364 kB 00:00 2023-03-08T15:46:26.346 INFO:teuthology.orchestra.run.smithi175.stdout:(23/140): python3-rgw-18.0.0-2861.ga2b8f27f.el8 1.2 MB/s | 106 kB 00:00 2023-03-08T15:46:26.455 INFO:teuthology.orchestra.run.smithi175.stdout:(24/140): librgw2-18.0.0-2861.ga2b8f27f.el8.x86 3.0 MB/s | 6.5 MB 00:02 2023-03-08T15:46:26.504 INFO:teuthology.orchestra.run.smithi175.stdout:(25/140): rbd-fuse-18.0.0-2861.ga2b8f27f.el8.x8 599 kB/s | 94 kB 00:00 2023-03-08T15:46:26.664 INFO:teuthology.orchestra.run.smithi175.stdout:(26/140): rbd-nbd-18.0.0-2861.ga2b8f27f.el8.x86 1.1 MB/s | 179 kB 00:00 2023-03-08T15:46:26.748 INFO:teuthology.orchestra.run.smithi175.stdout:(27/140): ceph-grafana-dashboards-18.0.0-2861.g 276 kB/s | 23 kB 00:00 2023-03-08T15:46:26.873 INFO:teuthology.orchestra.run.smithi175.stdout:(28/140): ceph-mgr-cephadm-18.0.0-2861.ga2b8f27 985 kB/s | 123 kB 00:00 2023-03-08T15:46:27.053 INFO:teuthology.orchestra.run.smithi182.stdout:(8/140): ceph-mon-18.0.0-2861.ga2b8f27f.el8.x86 1.2 MB/s | 4.6 MB 00:03 2023-03-08T15:46:27.153 INFO:teuthology.orchestra.run.smithi182.stdout:(9/140): ceph-selinux-18.0.0-2861.ga2b8f27f.el8 244 kB/s | 24 kB 00:00 2023-03-08T15:46:27.657 INFO:teuthology.orchestra.run.smithi175.stdout:(29/140): ceph-mgr-dashboard-18.0.0-2861.ga2b8f 2.2 MB/s | 1.7 MB 00:00 2023-03-08T15:46:27.774 INFO:teuthology.orchestra.run.smithi175.stdout:(30/140): rbd-mirror-18.0.0-2861.ga2b8f27f.el8. 2.6 MB/s | 3.4 MB 00:01 2023-03-08T15:46:27.941 INFO:teuthology.orchestra.run.smithi175.stdout:(31/140): ceph-mgr-modules-core-18.0.0-2861.ga2 1.4 MB/s | 239 kB 00:00 2023-03-08T15:46:28.024 INFO:teuthology.orchestra.run.smithi175.stdout:(32/140): ceph-mgr-rook-18.0.0-2861.ga2b8f27f.e 570 kB/s | 47 kB 00:00 2023-03-08T15:46:28.108 INFO:teuthology.orchestra.run.smithi175.stdout:(33/140): ceph-prometheus-alerts-18.0.0-2861.ga 174 kB/s | 15 kB 00:00 2023-03-08T15:46:28.161 INFO:teuthology.orchestra.run.smithi123.stdout:(8/140): ceph-radosgw-18.0.0-2861.ga2b8f27f.el8 2.3 MB/s | 13 MB 00:05 2023-03-08T15:46:28.262 INFO:teuthology.orchestra.run.smithi123.stdout:(9/140): ceph-selinux-18.0.0-2861.ga2b8f27f.el8 244 kB/s | 24 kB 00:00 2023-03-08T15:46:28.266 INFO:teuthology.orchestra.run.smithi175.stdout:(34/140): ceph-volume-18.0.0-2861.ga2b8f27f.el8 1.6 MB/s | 263 kB 00:00 2023-03-08T15:46:28.350 INFO:teuthology.orchestra.run.smithi175.stdout:(35/140): cephadm-18.0.0-2861.ga2b8f27f.el8.noa 997 kB/s | 83 kB 00:00 2023-03-08T15:46:28.434 INFO:teuthology.orchestra.run.smithi175.stdout:(36/140): cephfs-top-18.0.0-2861.ga2b8f27f.el8. 217 kB/s | 18 kB 00:00 2023-03-08T15:46:28.500 INFO:teuthology.orchestra.run.smithi175.stdout:(37/140): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-03-08T15:46:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:(38/140): bison-3.0.4-10.el8.x86_64.rpm 16 MB/s | 688 kB 00:00 2023-03-08T15:46:28.610 INFO:teuthology.orchestra.run.smithi175.stdout:(39/140): flex-2.6.1-9.el8.x86_64.rpm 4.7 MB/s | 320 kB 00:00 2023-03-08T15:46:28.635 INFO:teuthology.orchestra.run.smithi175.stdout:(40/140): jq-1.6-6.el8.x86_64.rpm 7.9 MB/s | 202 kB 00:00 2023-03-08T15:46:28.660 INFO:teuthology.orchestra.run.smithi175.stdout:(41/140): libpq-13.5-1.el8.x86_64.rpm 7.8 MB/s | 198 kB 00:00 2023-03-08T15:46:28.694 INFO:teuthology.orchestra.run.smithi175.stdout:(42/140): librdkafka-0.11.4-3.el8.x86_64.rpm 10 MB/s | 354 kB 00:00 2023-03-08T15:46:28.735 INFO:teuthology.orchestra.run.smithi175.stdout:(43/140): libtool-2.4.6-25.el8.x86_64.rpm 17 MB/s | 709 kB 00:00 2023-03-08T15:46:28.761 INFO:teuthology.orchestra.run.smithi175.stdout:(44/140): lttng-ust-2.8.1-11.el8.x86_64.rpm 10 MB/s | 259 kB 00:00 2023-03-08T15:46:28.786 INFO:teuthology.orchestra.run.smithi175.stdout:(45/140): oniguruma-6.8.2-2.el8.x86_64.rpm 7.4 MB/s | 187 kB 00:00 2023-03-08T15:46:28.961 INFO:teuthology.orchestra.run.smithi175.stdout:(46/140): openblas-0.3.15-4.el8.x86_64.rpm 27 MB/s | 4.7 MB 00:00 2023-03-08T15:46:29.070 INFO:teuthology.orchestra.run.smithi123.stdout:(10/140): ceph-osd-18.0.0-2861.ga2b8f27f.el8.x8 1.9 MB/s | 18 MB 00:09 2023-03-08T15:46:29.137 INFO:teuthology.orchestra.run.smithi175.stdout:(47/140): openblas-threads-0.3.15-4.el8.x86_64. 28 MB/s | 4.9 MB 00:00 2023-03-08T15:46:29.203 INFO:teuthology.orchestra.run.smithi175.stdout:(48/140): postgresql-10.19-1.module_el8.6.0+104 23 MB/s | 1.5 MB 00:00 2023-03-08T15:46:29.229 INFO:teuthology.orchestra.run.smithi123.stdout:(11/140): cephfs-mirror-18.0.0-2861.ga2b8f27f.e 1.6 MB/s | 257 kB 00:00 2023-03-08T15:46:29.304 INFO:teuthology.orchestra.run.smithi175.stdout:(49/140): postgresql-contrib-10.19-1.module_el8 7.9 MB/s | 807 kB 00:00 2023-03-08T15:46:29.379 INFO:teuthology.orchestra.run.smithi123.stdout:(12/140): libcephfs-devel-18.0.0-2861.ga2b8f27f 203 kB/s | 30 kB 00:00 2023-03-08T15:46:29.503 INFO:teuthology.orchestra.run.smithi182.stdout:(10/140): ceph-radosgw-18.0.0-2861.ga2b8f27f.el 3.2 MB/s | 13 MB 00:04 2023-03-08T15:46:29.512 INFO:teuthology.orchestra.run.smithi175.stdout:(50/140): postgresql-server-10.19-1.module_el8. 24 MB/s | 5.1 MB 00:00 2023-03-08T15:46:29.645 INFO:teuthology.orchestra.run.smithi182.stdout:(11/140): cephfs-mirror-18.0.0-2861.ga2b8f27f.e 1.8 MB/s | 257 kB 00:00 2023-03-08T15:46:29.688 INFO:teuthology.orchestra.run.smithi175.stdout:(51/140): python3-babel-2.5.1-7.el8.noarch.rpm 27 MB/s | 4.8 MB 00:00 2023-03-08T15:46:29.703 INFO:teuthology.orchestra.run.smithi182.stdout:(12/140): libcephfs-devel-18.0.0-2861.ga2b8f27f 526 kB/s | 30 kB 00:00 2023-03-08T15:46:29.721 INFO:teuthology.orchestra.run.smithi175.stdout:(52/140): python3-jinja2-2.10.1-3.el8.noarch.rp 16 MB/s | 538 kB 00:00 2023-03-08T15:46:29.746 INFO:teuthology.orchestra.run.smithi123.stdout:(13/140): libcephfs2-18.0.0-2861.ga2b8f27f.el8. 2.0 MB/s | 767 kB 00:00 2023-03-08T15:46:29.747 INFO:teuthology.orchestra.run.smithi175.stdout:(53/140): python3-jsonpatch-1.21-2.el8.noarch.r 1.0 MB/s | 27 kB 00:00 2023-03-08T15:46:29.772 INFO:teuthology.orchestra.run.smithi175.stdout:(54/140): python3-jsonpointer-1.10-11.el8.noarc 804 kB/s | 20 kB 00:00 2023-03-08T15:46:29.797 INFO:teuthology.orchestra.run.smithi175.stdout:(55/140): python3-mako-1.0.6-14.el8.noarch.rpm 6.2 MB/s | 157 kB 00:00 2023-03-08T15:46:29.823 INFO:teuthology.orchestra.run.smithi175.stdout:(56/140): python3-markupsafe-0.23-19.el8.x86_64 1.5 MB/s | 39 kB 00:00 2023-03-08T15:46:29.871 INFO:teuthology.orchestra.run.smithi123.stdout:(14/140): libcephsqlite-18.0.0-2861.ga2b8f27f.e 1.1 MB/s | 137 kB 00:00 2023-03-08T15:46:29.923 INFO:teuthology.orchestra.run.smithi175.stdout:(57/140): python3-numpy-1.14.3-10.el8.x86_64.rp 37 MB/s | 3.7 MB 00:00 2023-03-08T15:46:29.963 INFO:teuthology.orchestra.run.smithi123.stdout:(15/140): librados-devel-18.0.0-2861.ga2b8f27f. 1.5 MB/s | 139 kB 00:00 2023-03-08T15:46:29.990 INFO:teuthology.orchestra.run.smithi175.stdout:(58/140): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.3 MB/s | 225 kB 00:00 2023-03-08T15:46:30.024 INFO:teuthology.orchestra.run.smithi175.stdout:(59/140): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-03-08T15:46:30.065 INFO:teuthology.orchestra.run.smithi175.stdout:(60/140): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-03-08T15:46:30.079 INFO:teuthology.orchestra.run.smithi182.stdout:(13/140): libcephfs2-18.0.0-2861.ga2b8f27f.el8. 2.0 MB/s | 767 kB 00:00 2023-03-08T15:46:30.116 INFO:teuthology.orchestra.run.smithi175.stdout:(61/140): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-03-08T15:46:30.166 INFO:teuthology.orchestra.run.smithi175.stdout:(62/140): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2023-03-08T15:46:30.180 INFO:teuthology.orchestra.run.smithi123.stdout:(16/140): libradosstriper1-18.0.0-2861.ga2b8f27 2.1 MB/s | 474 kB 00:00 2023-03-08T15:46:30.191 INFO:teuthology.orchestra.run.smithi175.stdout:(63/140): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2023-03-08T15:46:30.237 INFO:teuthology.orchestra.run.smithi182.stdout:(14/140): libcephsqlite-18.0.0-2861.ga2b8f27f.e 867 kB/s | 137 kB 00:00 2023-03-08T15:46:30.329 INFO:teuthology.orchestra.run.smithi182.stdout:(15/140): librados-devel-18.0.0-2861.ga2b8f27f. 1.5 MB/s | 139 kB 00:00 2023-03-08T15:46:30.517 INFO:teuthology.orchestra.run.smithi175.stdout:(64/140): python3-scipy-1.0.0-21.module_el8.5.0 42 MB/s | 14 MB 00:00 2023-03-08T15:46:30.538 INFO:teuthology.orchestra.run.smithi182.stdout:(16/140): libradosstriper1-18.0.0-2861.ga2b8f27 2.2 MB/s | 474 kB 00:00 2023-03-08T15:46:30.609 INFO:teuthology.orchestra.run.smithi175.stdout:(65/140): ceph-mgr-diskprediction-local-18.0.0- 2.5 MB/s | 7.4 MB 00:02 2023-03-08T15:46:30.678 INFO:teuthology.orchestra.run.smithi175.stdout:(66/140): python3-werkzeug-0.12.2-4.el8.noarch. 2.8 MB/s | 457 kB 00:00 2023-03-08T15:46:30.709 INFO:teuthology.orchestra.run.smithi175.stdout:(67/140): uuid-1.6.2-43.el8.x86_64.rpm 2.1 MB/s | 64 kB 00:00 2023-03-08T15:46:30.735 INFO:teuthology.orchestra.run.smithi175.stdout:(68/140): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 71 kB 00:00 2023-03-08T15:46:30.760 INFO:teuthology.orchestra.run.smithi175.stdout:(69/140): socat-1.7.4.1-1.el8.x86_64.rpm 2.1 MB/s | 323 kB 00:00 2023-03-08T15:46:30.785 INFO:teuthology.orchestra.run.smithi175.stdout:(70/140): elfutils-libelf-devel-0.188-3.el8.x86 1.2 MB/s | 61 kB 00:00 2023-03-08T15:46:30.810 INFO:teuthology.orchestra.run.smithi175.stdout:(71/140): fuse-2.9.7-16.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-03-08T15:46:30.835 INFO:teuthology.orchestra.run.smithi175.stdout:(72/140): keyutils-libs-devel-1.5.10-9.el8.x86_ 956 kB/s | 48 kB 00:00 2023-03-08T15:46:30.861 INFO:teuthology.orchestra.run.smithi175.stdout:(73/140): krb5-devel-1.18.2-22.el8.x86_64.rpm 11 MB/s | 561 kB 00:00 2023-03-08T15:46:30.886 INFO:teuthology.orchestra.run.smithi175.stdout:(74/140): libaio-devel-0.3.112-1.el8.x86_64.rpm 371 kB/s | 19 kB 00:00 2023-03-08T15:46:30.911 INFO:teuthology.orchestra.run.smithi175.stdout:(75/140): libcom_err-devel-1.45.6-5.el8.x86_64. 768 kB/s | 39 kB 00:00 2023-03-08T15:46:30.945 INFO:teuthology.orchestra.run.smithi175.stdout:(76/140): libgfortran-8.5.0-18.el8.x86_64.rpm 11 MB/s | 645 kB 00:00 2023-03-08T15:46:30.970 INFO:teuthology.orchestra.run.smithi175.stdout:(77/140): libquadmath-8.5.0-18.el8.x86_64.rpm 2.9 MB/s | 172 kB 00:00 2023-03-08T15:46:31.023 INFO:teuthology.orchestra.run.smithi175.stdout:(78/140): librabbitmq-0.9.0-3.el8.x86_64.rpm 601 kB/s | 47 kB 00:00 2023-03-08T15:46:31.054 INFO:teuthology.orchestra.run.smithi175.stdout:(79/140): libselinux-devel-2.9-6.el8.x86_64.rpm 2.3 MB/s | 200 kB 00:00 2023-03-08T15:46:31.080 INFO:teuthology.orchestra.run.smithi175.stdout:(80/140): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-03-08T15:46:31.105 INFO:teuthology.orchestra.run.smithi175.stdout:(81/140): libuuid-devel-2.32.1-40.el8.x86_64.rp 1.9 MB/s | 99 kB 00:00 2023-03-08T15:46:31.130 INFO:teuthology.orchestra.run.smithi175.stdout:(82/140): libverto-devel-0.3.2-2.el8.x86_64.rpm 359 kB/s | 18 kB 00:00 2023-03-08T15:46:31.181 INFO:teuthology.orchestra.run.smithi175.stdout:(83/140): pcre2-devel-10.32-3.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-03-08T15:46:31.214 INFO:teuthology.orchestra.run.smithi175.stdout:(84/140): pcre2-utf16-10.32-3.el8.x86_64.rpm 6.7 MB/s | 229 kB 00:00 2023-03-08T15:46:31.248 INFO:teuthology.orchestra.run.smithi175.stdout:(85/140): pcre2-utf32-10.32-3.el8.x86_64.rpm 6.5 MB/s | 220 kB 00:00 2023-03-08T15:46:31.281 INFO:teuthology.orchestra.run.smithi175.stdout:(86/140): python3-cffi-1.11.5-5.el8.x86_64.rpm 7.0 MB/s | 237 kB 00:00 2023-03-08T15:46:31.323 INFO:teuthology.orchestra.run.smithi175.stdout:(87/140): openssl-devel-1.1.1k-7.el8.x86_64.rpm 11 MB/s | 2.3 MB 00:00 2023-03-08T15:46:31.380 INFO:teuthology.orchestra.run.smithi182.stdout:(17/140): ceph-osd-18.0.0-2861.ga2b8f27f.el8.x8 2.3 MB/s | 18 MB 00:07 2023-03-08T15:46:31.382 INFO:teuthology.orchestra.run.smithi175.stdout:(88/140): python3-jwt-1.6.1-2.el8.noarch.rpm 727 kB/s | 43 kB 00:00 2023-03-08T15:46:31.416 INFO:teuthology.orchestra.run.smithi175.stdout:(89/140): python3-cryptography-3.2.1-5.el8.x86_ 4.1 MB/s | 559 kB 00:00 2023-03-08T15:46:31.439 INFO:teuthology.orchestra.run.smithi182.stdout:(18/140): python3-ceph-argparse-18.0.0-2861.ga2 768 kB/s | 45 kB 00:00 2023-03-08T15:46:31.441 INFO:teuthology.orchestra.run.smithi175.stdout:(90/140): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-03-08T15:46:31.466 INFO:teuthology.orchestra.run.smithi175.stdout:(91/140): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-03-08T15:46:31.491 INFO:teuthology.orchestra.run.smithi175.stdout:(92/140): python3-requests-oauthlib-1.0.0-1.el8 853 kB/s | 43 kB 00:00 2023-03-08T15:46:31.497 INFO:teuthology.orchestra.run.smithi182.stdout:(19/140): python3-ceph-common-18.0.0-2861.ga2b8 2.0 MB/s | 117 kB 00:00 2023-03-08T15:46:31.517 INFO:teuthology.orchestra.run.smithi175.stdout:(93/140): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-03-08T15:46:31.542 INFO:teuthology.orchestra.run.smithi175.stdout:(94/140): zlib-devel-1.2.11-19.el8.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-03-08T15:46:31.556 INFO:teuthology.orchestra.run.smithi182.stdout:(20/140): python3-cephfs-18.0.0-2861.ga2b8f27f. 3.2 MB/s | 190 kB 00:00 2023-03-08T15:46:31.597 INFO:teuthology.orchestra.run.smithi123.stdout:(17/140): ceph-common-18.0.0-2861.ga2b8f27f.el8 1.4 MB/s | 22 MB 00:15 2023-03-08T15:46:31.684 INFO:teuthology.orchestra.run.smithi175.stdout:(95/140): liboath-2.6.2-3.el8.x86_64.rpm 415 kB/s | 59 kB 00:00 2023-03-08T15:46:31.689 INFO:teuthology.orchestra.run.smithi123.stdout:(18/140): python3-ceph-argparse-18.0.0-2861.ga2 488 kB/s | 45 kB 00:00 2023-03-08T15:46:31.714 INFO:teuthology.orchestra.run.smithi182.stdout:(21/140): python3-rados-18.0.0-2861.ga2b8f27f.e 2.3 MB/s | 369 kB 00:00 2023-03-08T15:46:31.751 INFO:teuthology.orchestra.run.smithi175.stdout:(96/140): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2023-03-08T15:46:31.776 INFO:teuthology.orchestra.run.smithi175.stdout:(97/140): libunwind-1.3.1-3.el8.x86_64.rpm 816 kB/s | 75 kB 00:00 2023-03-08T15:46:31.806 INFO:teuthology.orchestra.run.smithi182.stdout:(22/140): python3-rbd-18.0.0-2861.ga2b8f27f.el8 3.9 MB/s | 364 kB 00:00 2023-03-08T15:46:31.826 INFO:teuthology.orchestra.run.smithi175.stdout:(98/140): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 877 kB/s | 44 kB 00:00 2023-03-08T15:46:31.832 INFO:teuthology.orchestra.run.smithi123.stdout:(19/140): python3-ceph-common-18.0.0-2861.ga2b8 830 kB/s | 117 kB 00:00 2023-03-08T15:46:31.877 INFO:teuthology.orchestra.run.smithi175.stdout:(99/140): python3-asyncssh-2.7.0-2.el8.noarch.r 3.7 MB/s | 476 kB 00:00 2023-03-08T15:46:31.907 INFO:teuthology.orchestra.run.smithi182.stdout:(23/140): python3-rgw-18.0.0-2861.ga2b8f27f.el8 1.0 MB/s | 106 kB 00:00 2023-03-08T15:46:31.935 INFO:teuthology.orchestra.run.smithi175.stdout:(100/140): python3-beautifulsoup4-4.6.3-2.el8.1 1.7 MB/s | 185 kB 00:00 2023-03-08T15:46:31.960 INFO:teuthology.orchestra.run.smithi175.stdout:(101/140): python3-cachetools-3.1.1-4.el8.noarc 395 kB/s | 33 kB 00:00 2023-03-08T15:46:31.989 INFO:teuthology.orchestra.run.smithi123.stdout:(20/140): python3-cephfs-18.0.0-2861.ga2b8f27f. 1.2 MB/s | 190 kB 00:00 2023-03-08T15:46:31.990 INFO:teuthology.orchestra.run.smithi182.stdout:(24/140): rbd-fuse-18.0.0-2861.ga2b8f27f.el8.x8 1.1 MB/s | 94 kB 00:00 2023-03-08T15:46:31.994 INFO:teuthology.orchestra.run.smithi175.stdout:(102/140): python3-certifi-2018.10.15-7.el8.noa 277 kB/s | 16 kB 00:00 2023-03-08T15:46:32.028 INFO:teuthology.orchestra.run.smithi175.stdout:(103/140): python3-cheroot-8.5.2-1.el8.noarch.r 2.5 MB/s | 173 kB 00:00 2023-03-08T15:46:32.082 INFO:teuthology.orchestra.run.smithi182.stdout:(25/140): librgw2-18.0.0-2861.ga2b8f27f.el8.x86 4.2 MB/s | 6.5 MB 00:01 2023-03-08T15:46:32.086 INFO:teuthology.orchestra.run.smithi175.stdout:(104/140): python3-google-auth-1.1.1-10.el8.noa 1.4 MB/s | 81 kB 00:00 2023-03-08T15:46:32.112 INFO:teuthology.orchestra.run.smithi175.stdout:(105/140): python3-cherrypy-18.4.0-1.el8.noarch 3.2 MB/s | 384 kB 00:00 2023-03-08T15:46:32.137 INFO:teuthology.orchestra.run.smithi175.stdout:(106/140): python3-jaraco-6.2-6.el8.noarch.rpm 220 kB/s | 11 kB 00:00 2023-03-08T15:46:32.162 INFO:teuthology.orchestra.run.smithi175.stdout:(107/140): python3-jaraco-functools-2.0-4.el8.n 351 kB/s | 18 kB 00:00 2023-03-08T15:46:32.191 INFO:teuthology.orchestra.run.smithi182.stdout:(26/140): rbd-nbd-18.0.0-2861.ga2b8f27f.el8.x86 1.6 MB/s | 179 kB 00:00 2023-03-08T15:46:32.198 INFO:teuthology.orchestra.run.smithi123.stdout:(21/140): python3-rados-18.0.0-2861.ga2b8f27f.e 1.7 MB/s | 369 kB 00:00 2023-03-08T15:46:32.212 INFO:teuthology.orchestra.run.smithi175.stdout:(108/140): python3-logutils-0.3.5-11.el8.noarch 972 kB/s | 49 kB 00:00 2023-03-08T15:46:32.275 INFO:teuthology.orchestra.run.smithi182.stdout:(27/140): ceph-grafana-dashboards-18.0.0-2861.g 277 kB/s | 23 kB 00:00 2023-03-08T15:46:32.280 INFO:teuthology.orchestra.run.smithi175.stdout:(109/140): python3-more-itertools-7.2.0-3.el8.n 877 kB/s | 59 kB 00:00 2023-03-08T15:46:32.347 INFO:teuthology.orchestra.run.smithi175.stdout:(110/140): python3-natsort-7.1.1-2.el8.noarch.r 903 kB/s | 60 kB 00:00 2023-03-08T15:46:32.375 INFO:teuthology.orchestra.run.smithi182.stdout:(28/140): ceph-mgr-cephadm-18.0.0-2861.ga2b8f27 1.2 MB/s | 123 kB 00:00 2023-03-08T15:46:32.440 INFO:teuthology.orchestra.run.smithi123.stdout:(22/140): python3-rbd-18.0.0-2861.ga2b8f27f.el8 1.5 MB/s | 364 kB 00:00 2023-03-08T15:46:32.532 INFO:teuthology.orchestra.run.smithi123.stdout:(23/140): python3-rgw-18.0.0-2861.ga2b8f27f.el8 1.1 MB/s | 106 kB 00:00 2023-03-08T15:46:32.624 INFO:teuthology.orchestra.run.smithi123.stdout:(24/140): rbd-fuse-18.0.0-2861.ga2b8f27f.el8.x8 1.0 MB/s | 94 kB 00:00 2023-03-08T15:46:32.650 INFO:teuthology.orchestra.run.smithi175.stdout:(111/140): python3-pecan-1.3.2-9.el8.noarch.rpm 932 kB/s | 283 kB 00:00 2023-03-08T15:46:32.692 INFO:teuthology.orchestra.run.smithi182.stdout:(29/140): rbd-mirror-18.0.0-2861.ga2b8f27f.el8. 4.9 MB/s | 3.4 MB 00:00 2023-03-08T15:46:32.797 INFO:teuthology.orchestra.run.smithi175.stdout:(112/140): python3-kubernetes-11.0.0-6.el8.noar 1.8 MB/s | 1.2 MB 00:00 2023-03-08T15:46:32.823 INFO:teuthology.orchestra.run.smithi175.stdout:(113/140): python3-portend-2.6-1.el8.noarch.rpm 90 kB/s | 16 kB 00:00 2023-03-08T15:46:32.856 INFO:teuthology.orchestra.run.smithi175.stdout:(114/140): python3-repoze-lru-0.7-6.el8.noarch. 576 kB/s | 34 kB 00:00 2023-03-08T15:46:32.867 INFO:teuthology.orchestra.run.smithi182.stdout:(30/140): ceph-mgr-dashboard-18.0.0-2861.ga2b8f 3.5 MB/s | 1.7 MB 00:00 2023-03-08T15:46:32.907 INFO:teuthology.orchestra.run.smithi175.stdout:(115/140): python3-routes-2.4.1-12.el8.noarch.r 2.3 MB/s | 196 kB 00:00 2023-03-08T15:46:32.916 INFO:teuthology.orchestra.run.smithi123.stdout:(25/140): librgw2-18.0.0-2861.ga2b8f27f.el8.x86 2.4 MB/s | 6.5 MB 00:02 2023-03-08T15:46:32.932 INFO:teuthology.orchestra.run.smithi175.stdout:(116/140): python3-rsa-4.8-1.el8.noarch.rpm 817 kB/s | 61 kB 00:00 2023-03-08T15:46:32.957 INFO:teuthology.orchestra.run.smithi175.stdout:(117/140): python3-simplegeneric-0.8.1-17.el8.n 373 kB/s | 19 kB 00:00 2023-03-08T15:46:32.967 INFO:teuthology.orchestra.run.smithi182.stdout:(31/140): ceph-mgr-modules-core-18.0.0-2861.ga2 2.3 MB/s | 239 kB 00:00 2023-03-08T15:46:32.982 INFO:teuthology.orchestra.run.smithi175.stdout:(118/140): python3-singledispatch-3.4.0.3-18.el 476 kB/s | 24 kB 00:00 2023-03-08T15:46:33.008 INFO:teuthology.orchestra.run.smithi175.stdout:(119/140): python3-tempora-1.14.1-5.el8.noarch. 582 kB/s | 29 kB 00:00 2023-03-08T15:46:33.041 INFO:teuthology.orchestra.run.smithi175.stdout:(120/140): python3-trustme-0.6.0-4.el8.noarch.r 470 kB/s | 27 kB 00:00 2023-03-08T15:46:33.083 INFO:teuthology.orchestra.run.smithi123.stdout:(26/140): rbd-nbd-18.0.0-2861.ga2b8f27f.el8.x86 1.1 MB/s | 179 kB 00:00 2023-03-08T15:46:33.093 INFO:teuthology.orchestra.run.smithi182.stdout:(32/140): ceph-mgr-rook-18.0.0-2861.ga2b8f27f.e 380 kB/s | 47 kB 00:00 2023-03-08T15:46:33.112 INFO:teuthology.orchestra.run.smithi175.stdout:(121/140): python3-waitress-1.2.1-2.el8.1.noarc 2.3 MB/s | 241 kB 00:00 2023-03-08T15:46:33.167 INFO:teuthology.orchestra.run.smithi175.stdout:(122/140): python3-webob-1.8.5-1.el8.1.noarch.r 2.0 MB/s | 251 kB 00:00 2023-03-08T15:46:33.183 INFO:teuthology.orchestra.run.smithi123.stdout:(27/140): ceph-grafana-dashboards-18.0.0-2861.g 231 kB/s | 23 kB 00:00 2023-03-08T15:46:33.192 INFO:teuthology.orchestra.run.smithi175.stdout:(123/140): python3-websocket-client-0.56.0-5.el 769 kB/s | 61 kB 00:00 2023-03-08T15:46:33.193 INFO:teuthology.orchestra.run.smithi182.stdout:(33/140): ceph-prometheus-alerts-18.0.0-2861.ga 145 kB/s | 15 kB 00:00 2023-03-08T15:46:33.217 INFO:teuthology.orchestra.run.smithi175.stdout:(124/140): python3-webtest-2.0.33-1.el8.noarch. 1.7 MB/s | 85 kB 00:00 2023-03-08T15:46:33.251 INFO:teuthology.orchestra.run.smithi175.stdout:(125/140): python3-zc-lockfile-2.0-2.el8.noarch 392 kB/s | 23 kB 00:00 2023-03-08T15:46:33.275 INFO:teuthology.orchestra.run.smithi123.stdout:(28/140): ceph-mgr-cephadm-18.0.0-2861.ga2b8f27 1.3 MB/s | 123 kB 00:00 2023-03-08T15:46:33.377 INFO:teuthology.orchestra.run.smithi182.stdout:(34/140): ceph-volume-18.0.0-2861.ga2b8f27f.el8 1.4 MB/s | 263 kB 00:00 2023-03-08T15:46:33.460 INFO:teuthology.orchestra.run.smithi182.stdout:(35/140): cephadm-18.0.0-2861.ga2b8f27f.el8.noa 997 kB/s | 83 kB 00:00 2023-03-08T15:46:33.544 INFO:teuthology.orchestra.run.smithi182.stdout:(36/140): cephfs-top-18.0.0-2861.ga2b8f27f.el8. 217 kB/s | 18 kB 00:00 2023-03-08T15:46:33.620 INFO:teuthology.orchestra.run.smithi182.stdout:(37/140): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-03-08T15:46:33.673 INFO:teuthology.orchestra.run.smithi182.stdout:(38/140): bison-3.0.4-10.el8.x86_64.rpm 14 MB/s | 688 kB 00:00 2023-03-08T15:46:33.720 INFO:teuthology.orchestra.run.smithi182.stdout:(39/140): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-03-08T15:46:33.746 INFO:teuthology.orchestra.run.smithi182.stdout:(40/140): jq-1.6-6.el8.x86_64.rpm 8.0 MB/s | 202 kB 00:00 2023-03-08T15:46:33.771 INFO:teuthology.orchestra.run.smithi182.stdout:(41/140): libpq-13.5-1.el8.x86_64.rpm 7.7 MB/s | 198 kB 00:00 2023-03-08T15:46:33.776 INFO:teuthology.orchestra.run.smithi175.stdout:(126/140): thrift-0.13.0-2.el8.x86_64.rpm 3.1 MB/s | 1.7 MB 00:00 2023-03-08T15:46:33.805 INFO:teuthology.orchestra.run.smithi182.stdout:(42/140): librdkafka-0.11.4-3.el8.x86_64.rpm 10 MB/s | 354 kB 00:00 2023-03-08T15:46:33.880 INFO:teuthology.orchestra.run.smithi182.stdout:(43/140): libtool-2.4.6-25.el8.x86_64.rpm 9.2 MB/s | 709 kB 00:00 2023-03-08T15:46:33.914 INFO:teuthology.orchestra.run.smithi182.stdout:(44/140): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.6 MB/s | 259 kB 00:00 2023-03-08T15:46:33.947 INFO:teuthology.orchestra.run.smithi182.stdout:(45/140): oniguruma-6.8.2-2.el8.x86_64.rpm 5.5 MB/s | 187 kB 00:00 2023-03-08T15:46:34.123 INFO:teuthology.orchestra.run.smithi182.stdout:(46/140): openblas-0.3.15-4.el8.x86_64.rpm 27 MB/s | 4.7 MB 00:00 2023-03-08T15:46:34.175 INFO:teuthology.orchestra.run.smithi123.stdout:(29/140): ceph-mgr-dashboard-18.0.0-2861.ga2b8f 1.9 MB/s | 1.7 MB 00:00 2023-03-08T15:46:34.281 INFO:teuthology.orchestra.run.smithi182.stdout:(47/140): openblas-threads-0.3.15-4.el8.x86_64. 31 MB/s | 4.9 MB 00:00 2023-03-08T15:46:34.340 INFO:teuthology.orchestra.run.smithi182.stdout:(48/140): postgresql-10.19-1.module_el8.6.0+104 26 MB/s | 1.5 MB 00:00 2023-03-08T15:46:34.382 INFO:teuthology.orchestra.run.smithi182.stdout:(49/140): postgresql-contrib-10.19-1.module_el8 19 MB/s | 807 kB 00:00 2023-03-08T15:46:34.566 INFO:teuthology.orchestra.run.smithi182.stdout:(50/140): postgresql-server-10.19-1.module_el8. 28 MB/s | 5.1 MB 00:00 2023-03-08T15:46:34.717 INFO:teuthology.orchestra.run.smithi123.stdout:(30/140): rbd-mirror-18.0.0-2861.ga2b8f27f.el8. 1.6 MB/s | 3.4 MB 00:02 2023-03-08T15:46:34.791 INFO:teuthology.orchestra.run.smithi182.stdout:(51/140): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-03-08T15:46:34.825 INFO:teuthology.orchestra.run.smithi182.stdout:(52/140): python3-jinja2-2.10.1-3.el8.noarch.rp 16 MB/s | 538 kB 00:00 2023-03-08T15:46:34.850 INFO:teuthology.orchestra.run.smithi182.stdout:(53/140): python3-jsonpatch-1.21-2.el8.noarch.r 1.0 MB/s | 27 kB 00:00 2023-03-08T15:46:34.883 INFO:teuthology.orchestra.run.smithi182.stdout:(54/140): python3-jsonpointer-1.10-11.el8.noarc 602 kB/s | 20 kB 00:00 2023-03-08T15:46:34.901 INFO:teuthology.orchestra.run.smithi175.stdout:(127/140): librados2-18.0.0-2861.ga2b8f27f.el8. 2.2 MB/s | 3.7 MB 00:01 2023-03-08T15:46:34.917 INFO:teuthology.orchestra.run.smithi182.stdout:(55/140): python3-mako-1.0.6-14.el8.noarch.rpm 4.6 MB/s | 157 kB 00:00 2023-03-08T15:46:34.926 INFO:teuthology.orchestra.run.smithi175.stdout:(128/140): NetworkManager-initscripts-updown-1. 5.6 MB/s | 142 kB 00:00 2023-03-08T15:46:34.943 INFO:teuthology.orchestra.run.smithi123.stdout:(31/140): ceph-mgr-modules-core-18.0.0-2861.ga2 1.0 MB/s | 239 kB 00:00 2023-03-08T15:46:34.943 INFO:teuthology.orchestra.run.smithi182.stdout:(56/140): python3-markupsafe-0.23-19.el8.x86_64 1.5 MB/s | 39 kB 00:00 2023-03-08T15:46:34.960 INFO:teuthology.orchestra.run.smithi175.stdout:(129/140): elfutils-debuginfod-client-0.188-3.e 2.2 MB/s | 75 kB 00:00 2023-03-08T15:46:35.019 INFO:teuthology.orchestra.run.smithi175.stdout:(130/140): elfutils-libelf-0.188-3.el8.x86_64.r 3.9 MB/s | 231 kB 00:00 2023-03-08T15:46:35.034 INFO:teuthology.orchestra.run.smithi123.stdout:(32/140): ceph-mgr-rook-18.0.0-2861.ga2b8f27f.e 518 kB/s | 47 kB 00:00 2023-03-08T15:46:35.051 INFO:teuthology.orchestra.run.smithi182.stdout:(57/140): python3-numpy-1.14.3-10.el8.x86_64.rp 34 MB/s | 3.7 MB 00:00 2023-03-08T15:46:35.061 INFO:teuthology.orchestra.run.smithi175.stdout:(131/140): elfutils-libs-0.188-3.el8.x86_64.rpm 7.0 MB/s | 299 kB 00:00 2023-03-08T15:46:35.085 INFO:teuthology.orchestra.run.smithi182.stdout:(58/140): python3-numpy-f2py-1.14.3-10.el8.x86_ 6.7 MB/s | 225 kB 00:00 2023-03-08T15:46:35.094 INFO:teuthology.orchestra.run.smithi175.stdout:(132/140): libblkid-2.32.1-40.el8.x86_64.rpm 6.5 MB/s | 220 kB 00:00 2023-03-08T15:46:35.120 INFO:teuthology.orchestra.run.smithi175.stdout:(133/140): libfdisk-2.32.1-40.el8.x86_64.rpm 9.8 MB/s | 253 kB 00:00 2023-03-08T15:46:35.126 INFO:teuthology.orchestra.run.smithi123.stdout:(33/140): ceph-prometheus-alerts-18.0.0-2861.ga 158 kB/s | 15 kB 00:00 2023-03-08T15:46:35.153 INFO:teuthology.orchestra.run.smithi175.stdout:(134/140): libmount-2.32.1-40.el8.x86_64.rpm 6.9 MB/s | 236 kB 00:00 2023-03-08T15:46:35.220 INFO:teuthology.orchestra.run.smithi175.stdout:(135/140): libsmartcols-2.32.1-40.el8.x86_64.rp 2.6 MB/s | 179 kB 00:00 2023-03-08T15:46:35.245 INFO:teuthology.orchestra.run.smithi175.stdout:(136/140): libuuid-2.32.1-40.el8.x86_64.rpm 3.9 MB/s | 98 kB 00:00 2023-03-08T15:46:35.261 INFO:teuthology.orchestra.run.smithi182.stdout:(59/140): python3-prettytable-0.7.2-14.el8.noar 250 kB/s | 44 kB 00:00 2023-03-08T15:46:35.286 INFO:teuthology.orchestra.run.smithi182.stdout:(60/140): python3-pyOpenSSL-19.0.0-1.el8.noarch 4.1 MB/s | 103 kB 00:00 2023-03-08T15:46:35.295 INFO:teuthology.orchestra.run.smithi175.stdout:(137/140): librbd1-18.0.0-2861.ga2b8f27f.el8.x8 2.3 MB/s | 3.6 MB 00:01 2023-03-08T15:46:35.319 INFO:teuthology.orchestra.run.smithi182.stdout:(61/140): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.7 MB/s | 126 kB 00:00 2023-03-08T15:46:35.338 INFO:teuthology.orchestra.run.smithi175.stdout:(138/140): util-linux-user-2.32.1-40.el8.x86_64 2.4 MB/s | 102 kB 00:00 2023-03-08T15:46:35.345 INFO:teuthology.orchestra.run.smithi182.stdout:(62/140): python3-pyasn1-modules-0.3.7-6.el8.no 4.3 MB/s | 110 kB 00:00 2023-03-08T15:46:35.351 INFO:teuthology.orchestra.run.smithi123.stdout:(34/140): ceph-volume-18.0.0-2861.ga2b8f27f.el8 1.1 MB/s | 263 kB 00:00 2023-03-08T15:46:35.395 INFO:teuthology.orchestra.run.smithi182.stdout:(63/140): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-03-08T15:46:35.405 INFO:teuthology.orchestra.run.smithi175.stdout:(139/140): util-linux-2.32.1-40.el8.x86_64.rpm 16 MB/s | 2.5 MB 00:00 2023-03-08T15:46:35.443 INFO:teuthology.orchestra.run.smithi123.stdout:(35/140): cephadm-18.0.0-2861.ga2b8f27f.el8.noa 906 kB/s | 83 kB 00:00 2023-03-08T15:46:35.573 INFO:teuthology.orchestra.run.smithi123.stdout:(36/140): cephfs-top-18.0.0-2861.ga2b8f27f.el8. 140 kB/s | 18 kB 00:00 2023-03-08T15:46:35.694 INFO:teuthology.orchestra.run.smithi123.stdout:(37/140): automake-1.16.1-7.el8.noarch.rpm 5.8 MB/s | 713 kB 00:00 2023-03-08T15:46:35.744 INFO:teuthology.orchestra.run.smithi123.stdout:(38/140): bison-3.0.4-10.el8.x86_64.rpm 14 MB/s | 688 kB 00:00 2023-03-08T15:46:35.778 INFO:teuthology.orchestra.run.smithi123.stdout:(39/140): flex-2.6.1-9.el8.x86_64.rpm 9.4 MB/s | 320 kB 00:00 2023-03-08T15:46:35.779 INFO:teuthology.orchestra.run.smithi182.stdout:(64/140): python3-scipy-1.0.0-21.module_el8.5.0 36 MB/s | 14 MB 00:00 2023-03-08T15:46:35.820 INFO:teuthology.orchestra.run.smithi123.stdout:(40/140): jq-1.6-6.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-03-08T15:46:35.829 INFO:teuthology.orchestra.run.smithi182.stdout:(65/140): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-03-08T15:46:35.845 INFO:teuthology.orchestra.run.smithi123.stdout:(41/140): libpq-13.5-1.el8.x86_64.rpm 7.8 MB/s | 198 kB 00:00 2023-03-08T15:46:35.863 INFO:teuthology.orchestra.run.smithi182.stdout:(66/140): socat-1.7.4.1-1.el8.x86_64.rpm 9.5 MB/s | 323 kB 00:00 2023-03-08T15:46:35.879 INFO:teuthology.orchestra.run.smithi123.stdout:(42/140): librdkafka-0.11.4-3.el8.x86_64.rpm 10 MB/s | 354 kB 00:00 2023-03-08T15:46:35.888 INFO:teuthology.orchestra.run.smithi182.stdout:(67/140): uuid-1.6.2-43.el8.x86_64.rpm 2.5 MB/s | 64 kB 00:00 2023-03-08T15:46:35.930 INFO:teuthology.orchestra.run.smithi182.stdout:(68/140): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2023-03-08T15:46:35.956 INFO:teuthology.orchestra.run.smithi182.stdout:(69/140): elfutils-libelf-devel-0.188-3.el8.x86 2.4 MB/s | 61 kB 00:00 2023-03-08T15:46:35.968 INFO:teuthology.orchestra.run.smithi123.stdout:(43/140): libtool-2.4.6-25.el8.x86_64.rpm 7.7 MB/s | 709 kB 00:00 2023-03-08T15:46:35.981 INFO:teuthology.orchestra.run.smithi182.stdout:(70/140): fuse-2.9.7-16.el8.x86_64.rpm 3.3 MB/s | 83 kB 00:00 2023-03-08T15:46:36.004 INFO:teuthology.orchestra.run.smithi123.stdout:(44/140): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.1 MB/s | 259 kB 00:00 2023-03-08T15:46:36.006 INFO:teuthology.orchestra.run.smithi182.stdout:(71/140): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.9 MB/s | 48 kB 00:00 2023-03-08T15:46:36.030 INFO:teuthology.orchestra.run.smithi123.stdout:(45/140): oniguruma-6.8.2-2.el8.x86_64.rpm 7.4 MB/s | 187 kB 00:00 2023-03-08T15:46:36.048 INFO:teuthology.orchestra.run.smithi182.stdout:(72/140): krb5-devel-1.18.2-22.el8.x86_64.rpm 13 MB/s | 561 kB 00:00 2023-03-08T15:46:36.074 INFO:teuthology.orchestra.run.smithi182.stdout:(73/140): libaio-devel-0.3.112-1.el8.x86_64.rpm 751 kB/s | 19 kB 00:00 2023-03-08T15:46:36.108 INFO:teuthology.orchestra.run.smithi182.stdout:(74/140): libcom_err-devel-1.45.6-5.el8.x86_64. 1.1 MB/s | 39 kB 00:00 2023-03-08T15:46:36.150 INFO:teuthology.orchestra.run.smithi182.stdout:(75/140): libgfortran-8.5.0-18.el8.x86_64.rpm 15 MB/s | 645 kB 00:00 2023-03-08T15:46:36.222 INFO:teuthology.orchestra.run.smithi123.stdout:(46/140): openblas-0.3.15-4.el8.x86_64.rpm 25 MB/s | 4.7 MB 00:00 2023-03-08T15:46:36.250 INFO:teuthology.orchestra.run.smithi182.stdout:(76/140): ceph-mgr-diskprediction-local-18.0.0- 2.1 MB/s | 7.4 MB 00:03 2023-03-08T15:46:36.275 INFO:teuthology.orchestra.run.smithi182.stdout:(77/140): libquadmath-8.5.0-18.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2023-03-08T15:46:36.325 INFO:teuthology.orchestra.run.smithi182.stdout:(78/140): libselinux-devel-2.9-6.el8.x86_64.rpm 4.3 MB/s | 200 kB 00:00 2023-03-08T15:46:36.351 INFO:teuthology.orchestra.run.smithi182.stdout:(79/140): libsepol-devel-2.9-3.el8.x86_64.rpm 3.4 MB/s | 87 kB 00:00 2023-03-08T15:46:36.376 INFO:teuthology.orchestra.run.smithi182.stdout:(80/140): libuuid-devel-2.32.1-40.el8.x86_64.rp 3.9 MB/s | 99 kB 00:00 2023-03-08T15:46:36.397 INFO:teuthology.orchestra.run.smithi123.stdout:(47/140): openblas-threads-0.3.15-4.el8.x86_64. 28 MB/s | 4.9 MB 00:00 2023-03-08T15:46:36.410 INFO:teuthology.orchestra.run.smithi182.stdout:(81/140): libverto-devel-0.3.2-2.el8.x86_64.rpm 539 kB/s | 18 kB 00:00 2023-03-08T15:46:36.464 INFO:teuthology.orchestra.run.smithi123.stdout:(48/140): postgresql-10.19-1.module_el8.6.0+104 23 MB/s | 1.5 MB 00:00 2023-03-08T15:46:36.468 INFO:teuthology.orchestra.run.smithi182.stdout:(82/140): librabbitmq-0.9.0-3.el8.x86_64.rpm 215 kB/s | 47 kB 00:00 2023-03-08T15:46:36.514 INFO:teuthology.orchestra.run.smithi123.stdout:(49/140): postgresql-contrib-10.19-1.module_el8 16 MB/s | 807 kB 00:00 2023-03-08T15:46:36.527 INFO:teuthology.orchestra.run.smithi182.stdout:(83/140): openssl-devel-1.1.1k-7.el8.x86_64.rpm 20 MB/s | 2.3 MB 00:00 2023-03-08T15:46:36.577 INFO:teuthology.orchestra.run.smithi182.stdout:(84/140): pcre2-utf16-10.32-3.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-03-08T15:46:36.611 INFO:teuthology.orchestra.run.smithi182.stdout:(85/140): pcre2-devel-10.32-3.el8.x86_64.rpm 4.2 MB/s | 605 kB 00:00 2023-03-08T15:46:36.645 INFO:teuthology.orchestra.run.smithi182.stdout:(86/140): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-03-08T15:46:36.678 INFO:teuthology.orchestra.run.smithi182.stdout:(87/140): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.4 MB/s | 237 kB 00:00 2023-03-08T15:46:36.681 INFO:teuthology.orchestra.run.smithi123.stdout:(50/140): postgresql-server-10.19-1.module_el8. 30 MB/s | 5.1 MB 00:00 2023-03-08T15:46:36.704 INFO:teuthology.orchestra.run.smithi182.stdout:(88/140): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2023-03-08T15:46:36.746 INFO:teuthology.orchestra.run.smithi182.stdout:(89/140): python3-cryptography-3.2.1-5.el8.x86_ 5.4 MB/s | 559 kB 00:00 2023-03-08T15:46:36.771 INFO:teuthology.orchestra.run.smithi182.stdout:(90/140): python3-oauthlib-2.1.0-1.el8.noarch.r 2.3 MB/s | 155 kB 00:00 2023-03-08T15:46:36.796 INFO:teuthology.orchestra.run.smithi182.stdout:(91/140): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-03-08T15:46:36.822 INFO:teuthology.orchestra.run.smithi182.stdout:(92/140): python3-requests-oauthlib-1.0.0-1.el8 849 kB/s | 43 kB 00:00 2023-03-08T15:46:36.847 INFO:teuthology.orchestra.run.smithi182.stdout:(93/140): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-03-08T15:46:36.848 INFO:teuthology.orchestra.run.smithi123.stdout:(51/140): python3-babel-2.5.1-7.el8.noarch.rpm 29 MB/s | 4.8 MB 00:00 2023-03-08T15:46:36.872 INFO:teuthology.orchestra.run.smithi182.stdout:(94/140): zlib-devel-1.2.11-19.el8.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-03-08T15:46:36.940 INFO:teuthology.orchestra.run.smithi123.stdout:(52/140): ceph-mgr-diskprediction-local-18.0.0- 2.7 MB/s | 7.4 MB 00:02 2023-03-08T15:46:36.965 INFO:teuthology.orchestra.run.smithi123.stdout:(53/140): python3-jinja2-2.10.1-3.el8.noarch.rp 4.5 MB/s | 538 kB 00:00 2023-03-08T15:46:36.991 INFO:teuthology.orchestra.run.smithi123.stdout:(54/140): python3-jsonpointer-1.10-11.el8.noarc 958 kB/s | 20 kB 00:00 2023-03-08T15:46:37.006 INFO:teuthology.orchestra.run.smithi182.stdout:(95/140): liboath-2.6.2-3.el8.x86_64.rpm 441 kB/s | 59 kB 00:00 2023-03-08T15:46:37.016 INFO:teuthology.orchestra.run.smithi123.stdout:(55/140): python3-mako-1.0.6-14.el8.noarch.rpm 6.2 MB/s | 157 kB 00:00 2023-03-08T15:46:37.021 INFO:teuthology.orchestra.run.smithi175.stdout:(140/140): ceph-test-18.0.0-2861.ga2b8f27f.el8. 3.4 MB/s | 47 MB 00:13 2023-03-08T15:46:37.026 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2023-03-08T15:46:37.026 INFO:teuthology.orchestra.run.smithi175.stdout:Total 9.3 MB/s | 206 MB 00:22 2023-03-08T15:46:37.033 INFO:teuthology.orchestra.run.smithi123.stdout:(56/140): python3-markupsafe-0.23-19.el8.x86_64 2.3 MB/s | 39 kB 00:00 2023-03-08T15:46:37.056 INFO:teuthology.orchestra.run.smithi182.stdout:(96/140): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-03-08T15:46:37.082 INFO:teuthology.orchestra.run.smithi182.stdout:(97/140): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2023-03-08T15:46:37.125 INFO:teuthology.orchestra.run.smithi123.stdout:(57/140): python3-jsonpatch-1.21-2.el8.noarch.r 144 kB/s | 27 kB 00:00 2023-03-08T15:46:37.132 INFO:teuthology.orchestra.run.smithi182.stdout:(98/140): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 873 kB/s | 44 kB 00:00 2023-03-08T15:46:37.166 INFO:teuthology.orchestra.run.smithi182.stdout:(99/140): python3-asyncssh-2.7.0-2.el8.noarch.r 4.3 MB/s | 476 kB 00:00 2023-03-08T15:46:37.208 INFO:teuthology.orchestra.run.smithi182.stdout:(100/140): python3-beautifulsoup4-4.6.3-2.el8.1 2.4 MB/s | 185 kB 00:00 2023-03-08T15:46:37.225 INFO:teuthology.orchestra.run.smithi123.stdout:(58/140): python3-numpy-1.14.3-10.el8.x86_64.rp 19 MB/s | 3.7 MB 00:00 2023-03-08T15:46:37.233 INFO:teuthology.orchestra.run.smithi182.stdout:(101/140): python3-cachetools-3.1.1-4.el8.noarc 495 kB/s | 33 kB 00:00 2023-03-08T15:46:37.250 INFO:teuthology.orchestra.run.smithi123.stdout:(59/140): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.8 MB/s | 225 kB 00:00 2023-03-08T15:46:37.258 INFO:teuthology.orchestra.run.smithi182.stdout:(102/140): python3-certifi-2018.10.15-7.el8.noa 324 kB/s | 16 kB 00:00 2023-03-08T15:46:37.276 INFO:teuthology.orchestra.run.smithi123.stdout:(60/140): python3-prettytable-0.7.2-14.el8.noar 874 kB/s | 44 kB 00:00 2023-03-08T15:46:37.292 INFO:teuthology.orchestra.run.smithi182.stdout:(103/140): python3-cheroot-8.5.2-1.el8.noarch.r 2.9 MB/s | 173 kB 00:00 2023-03-08T15:46:37.301 INFO:teuthology.orchestra.run.smithi123.stdout:(61/140): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-03-08T15:46:37.326 INFO:teuthology.orchestra.run.smithi123.stdout:(62/140): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-03-08T15:46:37.342 INFO:teuthology.orchestra.run.smithi182.stdout:(104/140): python3-google-auth-1.1.1-10.el8.noa 1.6 MB/s | 81 kB 00:00 2023-03-08T15:46:37.351 INFO:teuthology.orchestra.run.smithi123.stdout:(63/140): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-03-08T15:46:37.376 INFO:teuthology.orchestra.run.smithi182.stdout:(105/140): python3-cherrypy-18.4.0-1.el8.noarch 3.2 MB/s | 384 kB 00:00 2023-03-08T15:46:37.377 INFO:teuthology.orchestra.run.smithi123.stdout:(64/140): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-03-08T15:46:37.401 INFO:teuthology.orchestra.run.smithi182.stdout:(106/140): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2023-03-08T15:46:37.426 INFO:teuthology.orchestra.run.smithi182.stdout:(107/140): python3-jaraco-functools-2.0-4.el8.n 350 kB/s | 18 kB 00:00 2023-03-08T15:46:37.435 INFO:teuthology.orchestra.run.smithi123.stdout:(65/140): python3-werkzeug-0.12.2-4.el8.noarch. 7.7 MB/s | 457 kB 00:00 2023-03-08T15:46:37.477 INFO:teuthology.orchestra.run.smithi182.stdout:(108/140): python3-logutils-0.3.5-11.el8.noarch 978 kB/s | 49 kB 00:00 2023-03-08T15:46:37.486 INFO:teuthology.orchestra.run.smithi123.stdout:(66/140): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-03-08T15:46:37.511 INFO:teuthology.orchestra.run.smithi123.stdout:(67/140): uuid-1.6.2-43.el8.x86_64.rpm 2.5 MB/s | 64 kB 00:00 2023-03-08T15:46:37.527 INFO:teuthology.orchestra.run.smithi182.stdout:(109/140): python3-more-itertools-7.2.0-3.el8.n 1.2 MB/s | 59 kB 00:00 2023-03-08T15:46:37.544 INFO:teuthology.orchestra.run.smithi123.stdout:(68/140): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 71 kB 00:00 2023-03-08T15:46:37.578 INFO:teuthology.orchestra.run.smithi182.stdout:(110/140): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2023-03-08T15:46:37.603 INFO:teuthology.orchestra.run.smithi123.stdout:(69/140): elfutils-libelf-devel-0.188-3.el8.x86 1.0 MB/s | 61 kB 00:00 2023-03-08T15:46:37.620 INFO:teuthology.orchestra.run.smithi182.stdout:(111/140): python3-kubernetes-11.0.0-6.el8.noar 5.3 MB/s | 1.2 MB 00:00 2023-03-08T15:46:37.645 INFO:teuthology.orchestra.run.smithi123.stdout:(70/140): fuse-2.9.7-16.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-03-08T15:46:37.670 INFO:teuthology.orchestra.run.smithi182.stdout:(112/140): python3-portend-2.6-1.el8.noarch.rpm 313 kB/s | 16 kB 00:00 2023-03-08T15:46:37.678 INFO:teuthology.orchestra.run.smithi123.stdout:(71/140): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.4 MB/s | 48 kB 00:00 2023-03-08T15:46:37.695 INFO:teuthology.orchestra.run.smithi182.stdout:(113/140): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-03-08T15:46:37.713 INFO:teuthology.orchestra.run.smithi182.stdout:(114/140): python3-repoze-lru-0.7-6.el8.noarch. 802 kB/s | 34 kB 00:00 2023-03-08T15:46:37.746 INFO:teuthology.orchestra.run.smithi123.stdout:(72/140): krb5-devel-1.18.2-22.el8.x86_64.rpm 8.2 MB/s | 561 kB 00:00 2023-03-08T15:46:37.754 INFO:teuthology.orchestra.run.smithi182.stdout:(115/140): python3-rsa-4.8-1.el8.noarch.rpm 1.5 MB/s | 61 kB 00:00 2023-03-08T15:46:37.771 INFO:teuthology.orchestra.run.smithi123.stdout:(73/140): libaio-devel-0.3.112-1.el8.x86_64.rpm 744 kB/s | 19 kB 00:00 2023-03-08T15:46:37.780 INFO:teuthology.orchestra.run.smithi182.stdout:(116/140): python3-routes-2.4.1-12.el8.noarch.r 2.3 MB/s | 196 kB 00:00 2023-03-08T15:46:37.796 INFO:teuthology.orchestra.run.smithi123.stdout:(74/140): libcom_err-devel-1.45.6-5.el8.x86_64. 1.5 MB/s | 39 kB 00:00 2023-03-08T15:46:37.797 INFO:teuthology.orchestra.run.smithi182.stdout:(117/140): python3-simplegeneric-0.8.1-17.el8.n 447 kB/s | 19 kB 00:00 2023-03-08T15:46:37.822 INFO:teuthology.orchestra.run.smithi182.stdout:(118/140): python3-singledispatch-3.4.0.3-18.el 572 kB/s | 24 kB 00:00 2023-03-08T15:46:37.847 INFO:teuthology.orchestra.run.smithi182.stdout:(119/140): python3-tempora-1.14.1-5.el8.noarch. 582 kB/s | 29 kB 00:00 2023-03-08T15:46:37.855 INFO:teuthology.orchestra.run.smithi123.stdout:(75/140): libgfortran-8.5.0-18.el8.x86_64.rpm 11 MB/s | 645 kB 00:00 2023-03-08T15:46:37.873 INFO:teuthology.orchestra.run.smithi182.stdout:(120/140): python3-trustme-0.6.0-4.el8.noarch.r 544 kB/s | 27 kB 00:00 2023-03-08T15:46:37.889 INFO:teuthology.orchestra.run.smithi123.stdout:(76/140): libquadmath-8.5.0-18.el8.x86_64.rpm 5.0 MB/s | 172 kB 00:00 2023-03-08T15:46:37.914 INFO:teuthology.orchestra.run.smithi123.stdout:(77/140): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2023-03-08T15:46:37.927 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2023-03-08T15:46:37.931 INFO:teuthology.orchestra.run.smithi182.stdout:(121/140): python3-waitress-1.2.1-2.el8.1.noarc 2.8 MB/s | 241 kB 00:00 2023-03-08T15:46:37.948 INFO:teuthology.orchestra.run.smithi123.stdout:(78/140): libselinux-devel-2.9-6.el8.x86_64.rpm 5.8 MB/s | 200 kB 00:00 2023-03-08T15:46:37.957 INFO:teuthology.orchestra.run.smithi182.stdout:(122/140): python3-webob-1.8.5-1.el8.1.noarch.r 2.9 MB/s | 251 kB 00:00 2023-03-08T15:46:37.982 INFO:teuthology.orchestra.run.smithi182.stdout:(123/140): python3-websocket-client-0.56.0-5.el 1.2 MB/s | 61 kB 00:00 2023-03-08T15:46:38.007 INFO:teuthology.orchestra.run.smithi182.stdout:(124/140): python3-webtest-2.0.33-1.el8.noarch. 1.7 MB/s | 85 kB 00:00 2023-03-08T15:46:38.015 INFO:teuthology.orchestra.run.smithi123.stdout:(79/140): libsepol-devel-2.9-3.el8.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2023-03-08T15:46:38.033 INFO:teuthology.orchestra.run.smithi182.stdout:(125/140): python3-zc-lockfile-2.0-2.el8.noarch 456 kB/s | 23 kB 00:00 2023-03-08T15:46:38.040 INFO:teuthology.orchestra.run.smithi123.stdout:(80/140): libuuid-devel-2.32.1-40.el8.x86_64.rp 3.9 MB/s | 99 kB 00:00 2023-03-08T15:46:38.065 INFO:teuthology.orchestra.run.smithi123.stdout:(81/140): libverto-devel-0.3.2-2.el8.x86_64.rpm 723 kB/s | 18 kB 00:00 2023-03-08T15:46:38.158 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2023-03-08T15:46:38.158 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2023-03-08T15:46:38.207 INFO:teuthology.orchestra.run.smithi123.stdout:(82/140): python3-scipy-1.0.0-21.module_el8.5.0 16 MB/s | 14 MB 00:00 2023-03-08T15:46:38.249 INFO:teuthology.orchestra.run.smithi123.stdout:(83/140): pcre2-devel-10.32-3.el8.x86_64.rpm 14 MB/s | 605 kB 00:00 2023-03-08T15:46:38.258 INFO:teuthology.orchestra.run.smithi182.stdout:(126/140): thrift-0.13.0-2.el8.x86_64.rpm 6.9 MB/s | 1.7 MB 00:00 2023-03-08T15:46:38.283 INFO:teuthology.orchestra.run.smithi123.stdout:(84/140): pcre2-utf16-10.32-3.el8.x86_64.rpm 6.7 MB/s | 229 kB 00:00 2023-03-08T15:46:38.317 INFO:teuthology.orchestra.run.smithi123.stdout:(85/140): pcre2-utf32-10.32-3.el8.x86_64.rpm 6.5 MB/s | 220 kB 00:00 2023-03-08T15:46:38.396 INFO:teuthology.orchestra.run.smithi123.stdout:(86/140): openssl-devel-1.1.1k-7.el8.x86_64.rpm 7.0 MB/s | 2.3 MB 00:00 2023-03-08T15:46:38.434 INFO:teuthology.orchestra.run.smithi123.stdout:(87/140): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.0 MB/s | 237 kB 00:00 2023-03-08T15:46:38.459 INFO:teuthology.orchestra.run.smithi123.stdout:(88/140): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2023-03-08T15:46:38.484 INFO:teuthology.orchestra.run.smithi123.stdout:(89/140): python3-cryptography-3.2.1-5.el8.x86_ 6.2 MB/s | 559 kB 00:00 2023-03-08T15:46:38.510 INFO:teuthology.orchestra.run.smithi123.stdout:(90/140): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-03-08T15:46:38.535 INFO:teuthology.orchestra.run.smithi123.stdout:(91/140): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-03-08T15:46:38.552 INFO:teuthology.orchestra.run.smithi123.stdout:(92/140): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2023-03-08T15:46:38.585 INFO:teuthology.orchestra.run.smithi123.stdout:(93/140): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-03-08T15:46:38.602 INFO:teuthology.orchestra.run.smithi123.stdout:(94/140): zlib-devel-1.2.11-19.el8.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-03-08T15:46:38.728 INFO:teuthology.orchestra.run.smithi123.stdout:(95/140): liboath-2.6.2-3.el8.x86_64.rpm 471 kB/s | 59 kB 00:00 2023-03-08T15:46:38.828 INFO:teuthology.orchestra.run.smithi123.stdout:(96/140): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-03-08T15:46:38.850 INFO:teuthology.orchestra.run.smithi182.stdout:(127/140): librados2-18.0.0-2861.ga2b8f27f.el8. 4.5 MB/s | 3.7 MB 00:00 2023-03-08T15:46:38.853 INFO:teuthology.orchestra.run.smithi123.stdout:(97/140): libunwind-1.3.1-3.el8.x86_64.rpm 599 kB/s | 75 kB 00:00 2023-03-08T15:46:38.895 INFO:teuthology.orchestra.run.smithi123.stdout:(98/140): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2023-03-08T15:46:38.917 INFO:teuthology.orchestra.run.smithi182.stdout:(128/140): NetworkManager-initscripts-updown-1. 2.1 MB/s | 142 kB 00:00 2023-03-08T15:46:38.937 INFO:teuthology.orchestra.run.smithi123.stdout:(99/140): python3-asyncssh-2.7.0-2.el8.noarch.r 4.3 MB/s | 476 kB 00:00 2023-03-08T15:46:38.984 INFO:teuthology.orchestra.run.smithi182.stdout:(129/140): librbd1-18.0.0-2861.ga2b8f27f.el8.x8 4.9 MB/s | 3.6 MB 00:00 2023-03-08T15:46:38.987 INFO:teuthology.orchestra.run.smithi123.stdout:(100/140): python3-beautifulsoup4-4.6.3-2.el8.1 2.0 MB/s | 185 kB 00:00 2023-03-08T15:46:39.012 INFO:teuthology.orchestra.run.smithi123.stdout:(101/140): python3-cachetools-3.1.1-4.el8.noarc 437 kB/s | 33 kB 00:00 2023-03-08T15:46:39.018 INFO:teuthology.orchestra.run.smithi182.stdout:(130/140): elfutils-debuginfod-client-0.188-3.e 751 kB/s | 75 kB 00:00 2023-03-08T15:46:39.038 INFO:teuthology.orchestra.run.smithi123.stdout:(102/140): python3-certifi-2018.10.15-7.el8.noa 324 kB/s | 16 kB 00:00 2023-03-08T15:46:39.059 INFO:teuthology.orchestra.run.smithi182.stdout:(131/140): elfutils-libelf-0.188-3.el8.x86_64.r 3.0 MB/s | 231 kB 00:00 2023-03-08T15:46:39.063 INFO:teuthology.orchestra.run.smithi123.stdout:(103/140): python3-cheroot-8.5.2-1.el8.noarch.r 3.4 MB/s | 173 kB 00:00 2023-03-08T15:46:39.110 INFO:teuthology.orchestra.run.smithi182.stdout:(132/140): libblkid-2.32.1-40.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-03-08T15:46:39.113 INFO:teuthology.orchestra.run.smithi123.stdout:(104/140): python3-google-auth-1.1.1-10.el8.noa 1.6 MB/s | 81 kB 00:00 2023-03-08T15:46:39.138 INFO:teuthology.orchestra.run.smithi123.stdout:(105/140): python3-cherrypy-18.4.0-1.el8.noarch 3.7 MB/s | 384 kB 00:00 2023-03-08T15:46:39.143 INFO:teuthology.orchestra.run.smithi182.stdout:(133/140): libfdisk-2.32.1-40.el8.x86_64.rpm 7.5 MB/s | 253 kB 00:00 2023-03-08T15:46:39.177 INFO:teuthology.orchestra.run.smithi182.stdout:(134/140): libmount-2.32.1-40.el8.x86_64.rpm 7.0 MB/s | 236 kB 00:00 2023-03-08T15:46:39.196 INFO:teuthology.orchestra.run.smithi123.stdout:(106/140): python3-jaraco-6.2-6.el8.noarch.rpm 134 kB/s | 11 kB 00:00 2023-03-08T15:46:39.211 INFO:teuthology.orchestra.run.smithi182.stdout:(135/140): elfutils-libs-0.188-3.el8.x86_64.rpm 1.5 MB/s | 299 kB 00:00 2023-03-08T15:46:39.231 INFO:teuthology.orchestra.run.smithi123.stdout:(107/140): python3-jaraco-functools-2.0-4.el8.n 190 kB/s | 18 kB 00:00 2023-03-08T15:46:39.236 INFO:teuthology.orchestra.run.smithi182.stdout:(136/140): libsmartcols-2.32.1-40.el8.x86_64.rp 3.0 MB/s | 179 kB 00:00 2023-03-08T15:46:39.261 INFO:teuthology.orchestra.run.smithi182.stdout:(137/140): libuuid-2.32.1-40.el8.x86_64.rpm 1.9 MB/s | 98 kB 00:00 2023-03-08T15:46:39.281 INFO:teuthology.orchestra.run.smithi123.stdout:(108/140): python3-logutils-0.3.5-11.el8.noarch 974 kB/s | 49 kB 00:00 2023-03-08T15:46:39.312 INFO:teuthology.orchestra.run.smithi182.stdout:(138/140): util-linux-user-2.32.1-40.el8.x86_64 2.0 MB/s | 102 kB 00:00 2023-03-08T15:46:39.396 INFO:teuthology.orchestra.run.smithi182.stdout:(139/140): util-linux-2.32.1-40.el8.x86_64.rpm 16 MB/s | 2.5 MB 00:00 2023-03-08T15:46:39.635 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2023-03-08T15:46:39.638 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2023-03-08T15:46:39.732 INFO:teuthology.orchestra.run.smithi123.stdout:(109/140): ceph-test-18.0.0-2861.ga2b8f27f.el8. 4.1 MB/s | 47 MB 00:11 2023-03-08T15:46:39.757 INFO:teuthology.orchestra.run.smithi123.stdout:(110/140): python3-more-itertools-7.2.0-3.el8.n 123 kB/s | 59 kB 00:00 2023-03-08T15:46:39.790 INFO:teuthology.orchestra.run.smithi123.stdout:(111/140): python3-kubernetes-11.0.0-6.el8.noar 2.0 MB/s | 1.2 MB 00:00 2023-03-08T15:46:39.857 INFO:teuthology.orchestra.run.smithi123.stdout:(112/140): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-03-08T15:46:39.908 INFO:teuthology.orchestra.run.smithi123.stdout:(113/140): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-03-08T15:46:39.933 INFO:teuthology.orchestra.run.smithi123.stdout:(114/140): python3-natsort-7.1.1-2.el8.noarch.r 300 kB/s | 60 kB 00:00 2023-03-08T15:46:39.958 INFO:teuthology.orchestra.run.smithi123.stdout:(115/140): python3-repoze-lru-0.7-6.el8.noarch. 334 kB/s | 34 kB 00:00 2023-03-08T15:46:39.962 INFO:teuthology.orchestra.run.smithi182.stdout:(140/140): ceph-test-18.0.0-2861.ga2b8f27f.el8. 3.6 MB/s | 47 MB 00:12 2023-03-08T15:46:39.968 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2023-03-08T15:46:39.968 INFO:teuthology.orchestra.run.smithi182.stdout:Total 9.1 MB/s | 206 MB 00:22 2023-03-08T15:46:39.983 INFO:teuthology.orchestra.run.smithi123.stdout:(116/140): python3-routes-2.4.1-12.el8.noarch.r 2.5 MB/s | 196 kB 00:00 2023-03-08T15:46:40.017 INFO:teuthology.orchestra.run.smithi123.stdout:(117/140): python3-rsa-4.8-1.el8.noarch.rpm 731 kB/s | 61 kB 00:00 2023-03-08T15:46:40.042 INFO:teuthology.orchestra.run.smithi123.stdout:(118/140): python3-simplegeneric-0.8.1-17.el8.n 224 kB/s | 19 kB 00:00 2023-03-08T15:46:40.067 INFO:teuthology.orchestra.run.smithi123.stdout:(119/140): python3-singledispatch-3.4.0.3-18.el 285 kB/s | 24 kB 00:00 2023-03-08T15:46:40.122 INFO:teuthology.orchestra.run.smithi123.stdout:(120/140): python3-tempora-1.14.1-5.el8.noarch. 281 kB/s | 29 kB 00:00 2023-03-08T15:46:40.151 INFO:teuthology.orchestra.run.smithi123.stdout:(121/140): python3-trustme-0.6.0-4.el8.noarch.r 330 kB/s | 27 kB 00:00 2023-03-08T15:46:40.202 INFO:teuthology.orchestra.run.smithi123.stdout:(122/140): python3-waitress-1.2.1-2.el8.1.noarc 1.8 MB/s | 241 kB 00:00 2023-03-08T15:46:40.227 INFO:teuthology.orchestra.run.smithi123.stdout:(123/140): python3-websocket-client-0.56.0-5.el 814 kB/s | 61 kB 00:00 2023-03-08T15:46:40.311 INFO:teuthology.orchestra.run.smithi123.stdout:(124/140): python3-webob-1.8.5-1.el8.1.noarch.r 1.3 MB/s | 251 kB 00:00 2023-03-08T15:46:40.370 INFO:teuthology.orchestra.run.smithi123.stdout:(125/140): python3-zc-lockfile-2.0-2.el8.noarch 161 kB/s | 23 kB 00:00 2023-03-08T15:46:40.394 INFO:teuthology.orchestra.run.smithi123.stdout:(126/140): python3-webtest-2.0.33-1.el8.noarch. 443 kB/s | 85 kB 00:00 2023-03-08T15:46:40.637 INFO:teuthology.orchestra.run.smithi123.stdout:(127/140): thrift-0.13.0-2.el8.x86_64.rpm 5.3 MB/s | 1.7 MB 00:00 2023-03-08T15:46:40.670 INFO:teuthology.orchestra.run.smithi123.stdout:(128/140): NetworkManager-initscripts-updown-1. 4.2 MB/s | 142 kB 00:00 2023-03-08T15:46:40.695 INFO:teuthology.orchestra.run.smithi123.stdout:(129/140): elfutils-debuginfod-client-0.188-3.e 3.0 MB/s | 75 kB 00:00 2023-03-08T15:46:40.739 INFO:teuthology.orchestra.run.smithi123.stdout:(130/140): elfutils-libelf-0.188-3.el8.x86_64.r 5.2 MB/s | 231 kB 00:00 2023-03-08T15:46:40.798 INFO:teuthology.orchestra.run.smithi123.stdout:(131/140): librados2-18.0.0-2861.ga2b8f27f.el8. 8.5 MB/s | 3.7 MB 00:00 2023-03-08T15:46:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:(132/140): libblkid-2.32.1-40.el8.x86_64.rpm 6.5 MB/s | 220 kB 00:00 2023-03-08T15:46:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:(133/140): elfutils-libs-0.188-3.el8.x86_64.rpm 2.5 MB/s | 299 kB 00:00 2023-03-08T15:46:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:(134/140): libfdisk-2.32.1-40.el8.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2023-03-08T15:46:40.957 INFO:teuthology.orchestra.run.smithi123.stdout:(135/140): libsmartcols-2.32.1-40.el8.x86_64.rp 2.6 MB/s | 179 kB 00:00 2023-03-08T15:46:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:(136/140): libuuid-2.32.1-40.el8.x86_64.rpm 2.9 MB/s | 98 kB 00:00 2023-03-08T15:46:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:(137/140): libmount-2.32.1-40.el8.x86_64.rpm 1.4 MB/s | 236 kB 00:00 2023-03-08T15:46:41.049 INFO:teuthology.orchestra.run.smithi123.stdout:(138/140): util-linux-user-2.32.1-40.el8.x86_64 3.0 MB/s | 102 kB 00:00 2023-03-08T15:46:41.125 INFO:teuthology.orchestra.run.smithi123.stdout:(139/140): util-linux-2.32.1-40.el8.x86_64.rpm 19 MB/s | 2.5 MB 00:00 2023-03-08T15:46:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:(140/140): librbd1-18.0.0-2861.ga2b8f27f.el8.x8 4.5 MB/s | 3.6 MB 00:00 2023-03-08T15:46:41.196 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-03-08T15:46:41.196 INFO:teuthology.orchestra.run.smithi123.stdout:Total 8.1 MB/s | 206 MB 00:25 2023-03-08T15:46:42.089 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-03-08T15:46:42.320 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-03-08T15:46:42.320 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-03-08T15:46:43.096 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2023-03-08T15:46:43.385 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction check succeeded. 2023-03-08T15:46:43.385 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2023-03-08T15:46:43.772 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-03-08T15:46:43.776 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-03-08T15:46:45.034 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded. 2023-03-08T15:46:45.038 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2023-03-08T15:46:45.295 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2023-03-08T15:46:45.488 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-03-08T15:46:45.691 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/153 2023-03-08T15:46:45.879 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : libuuid-2.32.1-40.el8.x86_64 2/153 2023-03-08T15:46:45.946 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libuuid-2.32.1-40.el8.x86_64 2/153 2023-03-08T15:46:46.162 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : libblkid-2.32.1-40.el8.x86_64 3/153 2023-03-08T15:46:46.231 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libblkid-2.32.1-40.el8.x86_64 3/153 2023-03-08T15:46:46.400 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/153 2023-03-08T15:46:46.605 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 5/153 2023-03-08T15:46:46.779 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/153 2023-03-08T15:46:47.209 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/153 2023-03-08T15:46:47.429 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 7/153 2023-03-08T15:46:47.854 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 7/153 2023-03-08T15:46:48.078 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:18.0.0-2861.ga2b8f27f.el8.x86_64 8/153 2023-03-08T15:46:48.203 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:18.0.0-2861.ga2b8f27f.el8.x86_64 8/153 2023-03-08T15:46:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 9/153 2023-03-08T15:46:48.476 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 9/153 2023-03-08T15:46:48.719 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:18.0.0-2861.ga2b8f27f.el8.x86_64 10/153 2023-03-08T15:46:48.854 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 11/153 2023-03-08T15:46:48.989 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 11/153 2023-03-08T15:46:49.223 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : elfutils-libelf-0.188-3.el8.x86_64 12/153 2023-03-08T15:46:49.390 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-03-08T15:46:49.482 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/153 2023-03-08T15:46:49.592 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-03-08T15:46:49.718 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/153 2023-03-08T15:46:49.829 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/153 2023-03-08T15:46:50.011 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libuuid-2.32.1-40.el8.x86_64 2/153 2023-03-08T15:46:50.089 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libuuid-2.32.1-40.el8.x86_64 2/153 2023-03-08T15:46:50.158 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpq-13.5-1.el8.x86_64 15/153 2023-03-08T15:46:50.286 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libblkid-2.32.1-40.el8.x86_64 3/153 2023-03-08T15:46:50.344 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libblkid-2.32.1-40.el8.x86_64 3/153 2023-03-08T15:46:50.353 INFO:teuthology.orchestra.run.smithi182.stdout: Preparing : 1/1 2023-03-08T15:46:50.415 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-10.19-1.module_el8.6.0+1047+4202cf9a. 16/153 2023-03-08T15:46:50.524 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/153 2023-03-08T15:46:50.570 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:18.0.0-2861.ga2b8f27f.el8.x86_64 17/153 2023-03-08T15:46:50.606 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-03-08T15:46:50.666 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2861.ga2b8f27f.el8.x86_64 17/153 2023-03-08T15:46:50.755 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 5/153 2023-03-08T15:46:50.821 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/153 2023-03-08T15:46:50.840 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:18.0.0-2861.ga2b8f27f.el8.x86 18/153 2023-03-08T15:46:50.928 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/153 2023-03-08T15:46:50.958 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2861.ga2b8f27f.el8.x86 18/153 2023-03-08T15:46:50.987 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : libuuid-2.32.1-40.el8.x86_64 2/153 2023-03-08T15:46:51.114 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libuuid-2.32.1-40.el8.x86_64 2/153 2023-03-08T15:46:51.234 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/153 2023-03-08T15:46:51.296 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : libblkid-2.32.1-40.el8.x86_64 3/153 2023-03-08T15:46:51.369 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/153 2023-03-08T15:46:51.439 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libblkid-2.32.1-40.el8.x86_64 3/153 2023-03-08T15:46:51.458 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-19.el8.x86_64 20/153 2023-03-08T15:46:51.569 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librados2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 7/153 2023-03-08T15:46:51.611 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-8.5.0-18.el8.x86_64 21/153 2023-03-08T15:46:51.634 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/153 2023-03-08T15:46:51.783 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libquadmath-8.5.0-18.el8.x86_64 21/153 2023-03-08T15:46:51.859 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 5/153 2023-03-08T15:46:51.928 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-8.5.0-18.el8.x86_64 22/153 2023-03-08T15:46:51.974 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 7/153 2023-03-08T15:46:52.054 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/153 2023-03-08T15:46:52.194 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librbd1-2:18.0.0-2861.ga2b8f27f.el8.x86_64 8/153 2023-03-08T15:46:52.324 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:18.0.0-2861.ga2b8f27f.el8.x86_64 8/153 2023-03-08T15:46:52.519 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 9/153 2023-03-08T15:46:52.522 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libgfortran-8.5.0-18.el8.x86_64 22/153 2023-03-08T15:46:52.552 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/153 2023-03-08T15:46:52.637 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 9/153 2023-03-08T15:46:52.678 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/153 2023-03-08T15:46:52.787 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : librados2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 7/153 2023-03-08T15:46:52.851 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-2:18.0.0-2861.ga2b8f27f.el8.x86_64 10/153 2023-03-08T15:46:53.036 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 11/153 2023-03-08T15:46:53.123 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 11/153 2023-03-08T15:46:53.288 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librados2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 7/153 2023-03-08T15:46:53.296 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/153 2023-03-08T15:46:53.348 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : elfutils-libelf-0.188-3.el8.x86_64 12/153 2023-03-08T15:46:53.478 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/153 2023-03-08T15:46:53.487 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : librbd1-2:18.0.0-2861.ga2b8f27f.el8.x86_64 8/153 2023-03-08T15:46:53.600 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/153 2023-03-08T15:46:53.658 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librbd1-2:18.0.0-2861.ga2b8f27f.el8.x86_64 8/153 2023-03-08T15:46:53.854 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libcephfs2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 9/153 2023-03-08T15:46:53.858 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/153 2023-03-08T15:46:53.992 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libcephfs2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 9/153 2023-03-08T15:46:54.146 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/153 2023-03-08T15:46:54.250 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-rados-2:18.0.0-2861.ga2b8f27f.el8.x86_64 10/153 2023-03-08T15:46:54.270 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libpq-13.5-1.el8.x86_64 15/153 2023-03-08T15:46:54.395 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 11/153 2023-03-08T15:46:54.514 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-10.19-1.module_el8.6.0+1047+4202cf9a. 16/153 2023-03-08T15:46:54.551 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 11/153 2023-03-08T15:46:54.563 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/153 2023-03-08T15:46:54.711 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephsqlite-2:18.0.0-2861.ga2b8f27f.el8.x86_64 17/153 2023-03-08T15:46:54.802 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : elfutils-libelf-0.188-3.el8.x86_64 12/153 2023-03-08T15:46:54.814 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2861.ga2b8f27f.el8.x86_64 17/153 2023-03-08T15:46:54.833 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/153 2023-03-08T15:46:55.015 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libradosstriper1-2:18.0.0-2861.ga2b8f27f.el8.x86 18/153 2023-03-08T15:46:55.033 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/153 2023-03-08T15:46:55.047 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 27/153 2023-03-08T15:46:55.120 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2861.ga2b8f27f.el8.x86 18/153 2023-03-08T15:46:55.273 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/153 2023-03-08T15:46:55.303 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/153 2023-03-08T15:46:55.366 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/153 2023-03-08T15:46:55.500 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:18.0.0-2861.ga2b8f27f.el8. 29/153 2023-03-08T15:46:55.545 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : zlib-devel-1.2.11-19.el8.x86_64 20/153 2023-03-08T15:46:55.688 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:18.0.0-2861.ga2b8f27f.el 30/153 2023-03-08T15:46:55.702 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libquadmath-8.5.0-18.el8.x86_64 21/153 2023-03-08T15:46:55.833 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libquadmath-8.5.0-18.el8.x86_64 21/153 2023-03-08T15:46:55.860 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libpq-13.5-1.el8.x86_64 15/153 2023-03-08T15:46:55.914 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:18.0.0-2861.ga2b8f27f.el8.x86_6 31/153 2023-03-08T15:46:56.010 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libgfortran-8.5.0-18.el8.x86_64 22/153 2023-03-08T15:46:56.108 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : postgresql-10.19-1.module_el8.6.0+1047+4202cf9a. 16/153 2023-03-08T15:46:56.287 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libcephsqlite-2:18.0.0-2861.ga2b8f27f.el8.x86_64 17/153 2023-03-08T15:46:56.435 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2861.ga2b8f27f.el8.x86_64 17/153 2023-03-08T15:46:56.610 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libgfortran-8.5.0-18.el8.x86_64 22/153 2023-03-08T15:46:56.631 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libradosstriper1-2:18.0.0-2861.ga2b8f27f.el8.x86 18/153 2023-03-08T15:46:56.794 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/153 2023-03-08T15:46:56.802 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2861.ga2b8f27f.el8.x86 18/153 2023-03-08T15:46:56.872 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/153 2023-03-08T15:46:57.029 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/153 2023-03-08T15:46:57.199 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : zlib-devel-1.2.11-19.el8.x86_64 20/153 2023-03-08T15:46:57.324 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/153 2023-03-08T15:46:57.378 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libquadmath-8.5.0-18.el8.x86_64 21/153 2023-03-08T15:46:57.412 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/153 2023-03-08T15:46:57.557 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libquadmath-8.5.0-18.el8.x86_64 21/153 2023-03-08T15:46:57.594 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/153 2023-03-08T15:46:57.672 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/153 2023-03-08T15:46:57.728 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libgfortran-8.5.0-18.el8.x86_64 22/153 2023-03-08T15:46:57.918 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/153 2023-03-08T15:46:58.289 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/153 2023-03-08T15:46:58.476 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libgfortran-8.5.0-18.el8.x86_64 22/153 2023-03-08T15:46:58.661 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/153 2023-03-08T15:46:58.678 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/153 2023-03-08T15:46:58.924 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/153 2023-03-08T15:46:59.121 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 27/153 2023-03-08T15:46:59.336 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/153 2023-03-08T15:46:59.430 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/153 2023-03-08T15:46:59.574 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-common-2:18.0.0-2861.ga2b8f27f.el8. 29/153 2023-03-08T15:46:59.620 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/153 2023-03-08T15:46:59.697 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/153 2023-03-08T15:46:59.745 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-argparse-2:18.0.0-2861.ga2b8f27f.el 30/153 2023-03-08T15:47:00.005 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-2:18.0.0-2861.ga2b8f27f.el8.x86_6 31/153 2023-03-08T15:47:00.055 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/153 2023-03-08T15:47:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/153 2023-03-08T15:47:00.530 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.8-1.el8.noarch 38/153 2023-03-08T15:47:00.544 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/153 2023-03-08T15:47:00.707 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : elfutils-libs-0.188-3.el8.x86_64 39/153 2023-03-08T15:47:00.928 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : elfutils-debuginfod-client-0.188-3.el8.x86_64 40/153 2023-03-08T15:47:00.955 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/153 2023-03-08T15:47:00.971 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/153 2023-03-08T15:47:01.165 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 41/153 2023-03-08T15:47:01.214 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/153 2023-03-08T15:47:01.351 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_6 42/153 2023-03-08T15:47:01.394 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 27/153 2023-03-08T15:47:01.593 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : libfdisk-2.32.1-40.el8.x86_64 43/153 2023-03-08T15:47:01.595 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/153 2023-03-08T15:47:01.652 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/153 2023-03-08T15:47:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libfdisk-2.32.1-40.el8.x86_64 43/153 2023-03-08T15:47:01.868 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : libmount-2.32.1-40.el8.x86_64 44/153 2023-03-08T15:47:01.868 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-ceph-common-2:18.0.0-2861.ga2b8f27f.el8. 29/153 2023-03-08T15:47:01.923 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/153 2023-03-08T15:47:01.932 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libmount-2.32.1-40.el8.x86_64 44/153 2023-03-08T15:47:02.016 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-ceph-argparse-2:18.0.0-2861.ga2b8f27f.el 30/153 2023-03-08T15:47:02.071 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.32.1-40.el8.x86_64 45/153 2023-03-08T15:47:02.168 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/153 2023-03-08T15:47:02.267 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cephfs-2:18.0.0-2861.ga2b8f27f.el8.x86_6 31/153 2023-03-08T15:47:02.276 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : libsmartcols-2.32.1-40.el8.x86_64 46/153 2023-03-08T15:47:02.827 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libsmartcols-2.32.1-40.el8.x86_64 46/153 2023-03-08T15:47:03.177 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : util-linux-2.32.1-40.el8.x86_64 47/153 2023-03-08T15:47:03.191 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: util-linux-2.32.1-40.el8.x86_64 47/153 2023-03-08T15:47:03.435 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/153 2023-03-08T15:47:03.470 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 48/153 2023-03-08T15:47:03.892 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/153 2023-03-08T15:47:03.919 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 49/153 2023-03-08T15:47:03.925 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/153 2023-03-08T15:47:04.219 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/153 2023-03-08T15:47:04.257 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 50/153 2023-03-08T15:47:04.288 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/153 2023-03-08T15:47:04.463 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 51/153 2023-03-08T15:47:04.493 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/153 2023-03-08T15:47:04.561 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/153 2023-03-08T15:47:04.678 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 52/153 2023-03-08T15:47:04.842 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rsa-4.8-1.el8.noarch 38/153 2023-03-08T15:47:04.933 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 53/153 2023-03-08T15:47:05.023 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : elfutils-libs-0.188-3.el8.x86_64 39/153 2023-03-08T15:47:05.186 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 54/153 2023-03-08T15:47:05.269 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : elfutils-debuginfod-client-0.188-3.el8.x86_64 40/153 2023-03-08T15:47:05.427 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 55/153 2023-03-08T15:47:05.498 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 41/153 2023-03-08T15:47:05.620 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/153 2023-03-08T15:47:05.728 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_6 42/153 2023-03-08T15:47:05.823 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/153 2023-03-08T15:47:05.934 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libfdisk-2.32.1-40.el8.x86_64 43/153 2023-03-08T15:47:06.052 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libfdisk-2.32.1-40.el8.x86_64 43/153 2023-03-08T15:47:06.061 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/153 2023-03-08T15:47:06.234 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libmount-2.32.1-40.el8.x86_64 44/153 2023-03-08T15:47:06.255 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 59/153 2023-03-08T15:47:06.285 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libmount-2.32.1-40.el8.x86_64 44/153 2023-03-08T15:47:06.444 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libuuid-devel-2.32.1-40.el8.x86_64 45/153 2023-03-08T15:47:06.482 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-2.6-1.el8.noarch 60/153 2023-03-08T15:47:06.642 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libsmartcols-2.32.1-40.el8.x86_64 46/153 2023-03-08T15:47:06.698 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 61/153 2023-03-08T15:47:06.739 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/153 2023-03-08T15:47:06.997 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 62/153 2023-03-08T15:47:07.126 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/153 2023-03-08T15:47:07.171 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libsmartcols-2.32.1-40.el8.x86_64 46/153 2023-03-08T15:47:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 63/153 2023-03-08T15:47:07.347 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/153 2023-03-08T15:47:07.526 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : util-linux-2.32.1-40.el8.x86_64 47/153 2023-03-08T15:47:07.540 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: util-linux-2.32.1-40.el8.x86_64 47/153 2023-03-08T15:47:07.567 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 64/153 2023-03-08T15:47:07.656 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-rsa-4.8-1.el8.noarch 38/153 2023-03-08T15:47:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 48/153 2023-03-08T15:47:07.893 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : elfutils-libs-0.188-3.el8.x86_64 39/153 2023-03-08T15:47:07.952 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 65/153 2023-03-08T15:47:08.022 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 49/153 2023-03-08T15:47:08.133 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : elfutils-debuginfod-client-0.188-3.el8.x86_64 40/153 2023-03-08T15:47:08.273 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 50/153 2023-03-08T15:47:08.279 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 66/153 2023-03-08T15:47:08.351 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-rbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 41/153 2023-03-08T15:47:08.463 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 51/153 2023-03-08T15:47:08.566 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 67/153 2023-03-08T15:47:08.569 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : librados-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_6 42/153 2023-03-08T15:47:08.677 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 52/153 2023-03-08T15:47:08.768 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : libfdisk-2.32.1-40.el8.x86_64 43/153 2023-03-08T15:47:08.878 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libfdisk-2.32.1-40.el8.x86_64 43/153 2023-03-08T15:47:08.990 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 53/153 2023-03-08T15:47:09.068 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : libmount-2.32.1-40.el8.x86_64 44/153 2023-03-08T15:47:09.188 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libmount-2.32.1-40.el8.x86_64 44/153 2023-03-08T15:47:09.227 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 54/153 2023-03-08T15:47:09.340 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libuuid-devel-2.32.1-40.el8.x86_64 45/153 2023-03-08T15:47:09.386 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 68/153 2023-03-08T15:47:09.492 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 55/153 2023-03-08T15:47:09.518 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : libsmartcols-2.32.1-40.el8.x86_64 46/153 2023-03-08T15:47:09.616 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 69/153 2023-03-08T15:47:09.686 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/153 2023-03-08T15:47:09.694 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 69/153 2023-03-08T15:47:09.913 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/153 2023-03-08T15:47:09.953 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 70/153 2023-03-08T15:47:10.161 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/153 2023-03-08T15:47:10.183 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libsmartcols-2.32.1-40.el8.x86_64 46/153 2023-03-08T15:47:10.193 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 71/153 2023-03-08T15:47:10.363 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 59/153 2023-03-08T15:47:10.477 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : util-linux-2.32.1-40.el8.x86_64 47/153 2023-03-08T15:47:10.527 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: util-linux-2.32.1-40.el8.x86_64 47/153 2023-03-08T15:47:10.573 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-portend-2.6-1.el8.noarch 60/153 2023-03-08T15:47:10.648 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 72/153 2023-03-08T15:47:10.786 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 48/153 2023-03-08T15:47:10.798 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 61/153 2023-03-08T15:47:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 73/153 2023-03-08T15:47:11.088 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 62/153 2023-03-08T15:47:11.119 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 49/153 2023-03-08T15:47:11.230 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 74/153 2023-03-08T15:47:11.376 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 50/153 2023-03-08T15:47:11.396 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 63/153 2023-03-08T15:47:11.528 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 75/153 2023-03-08T15:47:11.573 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 51/153 2023-03-08T15:47:11.641 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 64/153 2023-03-08T15:47:11.782 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 52/153 2023-03-08T15:47:11.812 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 76/153 2023-03-08T15:47:12.066 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 65/153 2023-03-08T15:47:12.068 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 53/153 2023-03-08T15:47:12.328 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 54/153 2023-03-08T15:47:12.401 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 66/153 2023-03-08T15:47:12.585 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 55/153 2023-03-08T15:47:12.707 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 67/153 2023-03-08T15:47:12.805 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/153 2023-03-08T15:47:12.939 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/153 2023-03-08T15:47:13.010 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/153 2023-03-08T15:47:13.234 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/153 2023-03-08T15:47:13.374 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/153 2023-03-08T15:47:13.450 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 59/153 2023-03-08T15:47:13.533 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 68/153 2023-03-08T15:47:13.662 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-portend-2.6-1.el8.noarch 60/153 2023-03-08T15:47:13.715 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 79/153 2023-03-08T15:47:13.757 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librgw2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 69/153 2023-03-08T15:47:13.832 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librgw2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 69/153 2023-03-08T15:47:13.923 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 61/153 2023-03-08T15:47:14.032 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 80/153 2023-03-08T15:47:14.053 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 70/153 2023-03-08T15:47:14.199 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 62/153 2023-03-08T15:47:14.327 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 71/153 2023-03-08T15:47:14.438 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/153 2023-03-08T15:47:14.470 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 63/153 2023-03-08T15:47:14.720 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 64/153 2023-03-08T15:47:14.724 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/153 2023-03-08T15:47:14.766 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 72/153 2023-03-08T15:47:15.009 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/153 2023-03-08T15:47:15.094 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 73/153 2023-03-08T15:47:15.143 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 65/153 2023-03-08T15:47:15.218 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 84/153 2023-03-08T15:47:15.342 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 74/153 2023-03-08T15:47:15.470 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 66/153 2023-03-08T15:47:15.553 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 85/153 2023-03-08T15:47:15.662 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 75/153 2023-03-08T15:47:15.724 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 67/153 2023-03-08T15:47:15.842 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 86/153 2023-03-08T15:47:15.912 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 76/153 2023-03-08T15:47:16.010 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/153 2023-03-08T15:47:16.310 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/153 2023-03-08T15:47:16.569 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libselinux-devel-2.9-6.el8.x86_64 89/153 2023-03-08T15:47:16.599 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 68/153 2023-03-08T15:47:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/153 2023-03-08T15:47:16.792 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : librgw2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 69/153 2023-03-08T15:47:16.907 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librgw2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 69/153 2023-03-08T15:47:16.961 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/153 2023-03-08T15:47:16.999 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/153 2023-03-08T15:47:17.189 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-rgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 70/153 2023-03-08T15:47:17.199 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/153 2023-03-08T15:47:17.424 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.7-16.el8.x86_64 93/153 2023-03-08T15:47:17.435 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 71/153 2023-03-08T15:47:17.449 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/153 2023-03-08T15:47:17.657 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/153 2023-03-08T15:47:17.749 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 79/153 2023-03-08T15:47:17.848 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-43.el8.x86_64 95/153 2023-03-08T15:47:17.924 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 72/153 2023-03-08T15:47:17.964 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 95/153 2023-03-08T15:47:18.075 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 80/153 2023-03-08T15:47:18.165 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 96/153 2023-03-08T15:47:18.301 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 73/153 2023-03-08T15:47:18.365 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 97/153 2023-03-08T15:47:18.466 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/153 2023-03-08T15:47:18.592 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 74/153 2023-03-08T15:47:18.791 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/153 2023-03-08T15:47:18.919 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 75/153 2023-03-08T15:47:19.084 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/153 2023-03-08T15:47:19.196 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 76/153 2023-03-08T15:47:19.293 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 84/153 2023-03-08T15:47:19.664 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 85/153 2023-03-08T15:47:19.926 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 86/153 2023-03-08T15:47:20.119 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/153 2023-03-08T15:47:20.455 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/153 2023-03-08T15:47:20.617 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/153 2023-03-08T15:47:20.718 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libselinux-devel-2.9-6.el8.x86_64 89/153 2023-03-08T15:47:20.868 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/153 2023-03-08T15:47:21.070 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/153 2023-03-08T15:47:21.079 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/153 2023-03-08T15:47:21.299 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/153 2023-03-08T15:47:21.485 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 79/153 2023-03-08T15:47:21.541 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fuse-2.9.7-16.el8.x86_64 93/153 2023-03-08T15:47:21.729 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/153 2023-03-08T15:47:21.782 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 80/153 2023-03-08T15:47:21.973 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : uuid-1.6.2-43.el8.x86_64 95/153 2023-03-08T15:47:22.061 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 95/153 2023-03-08T15:47:22.157 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/153 2023-03-08T15:47:22.437 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/153 2023-03-08T15:47:22.551 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 96/153 2023-03-08T15:47:22.705 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/153 2023-03-08T15:47:22.932 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 97/153 2023-03-08T15:47:22.939 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 84/153 2023-03-08T15:47:23.233 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 98/153 2023-03-08T15:47:23.311 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 85/153 2023-03-08T15:47:23.523 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 98/153 2023-03-08T15:47:23.577 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 86/153 2023-03-08T15:47:23.795 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/153 2023-03-08T15:47:24.100 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 98/153 2023-03-08T15:47:24.181 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/153 2023-03-08T15:47:24.412 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libselinux-devel-2.9-6.el8.x86_64 89/153 2023-03-08T15:47:24.445 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:18.0.0-2861.ga2b8f27f.el8.x86_64 99/153 2023-03-08T15:47:24.550 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:18.0.0-2861.ga2b8f27f.el8.x86_64 99/153 2023-03-08T15:47:24.565 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/153 2023-03-08T15:47:24.780 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:18.0.0-2861.ga2b8f27f.el8.x86_64 100/153 2023-03-08T15:47:24.852 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/153 2023-03-08T15:47:25.111 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/153 2023-03-08T15:47:25.352 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : fuse-2.9.7-16.el8.x86_64 93/153 2023-03-08T15:47:25.572 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/153 2023-03-08T15:47:25.781 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : uuid-1.6.2-43.el8.x86_64 95/153 2023-03-08T15:47:25.945 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 95/153 2023-03-08T15:47:26.151 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 96/153 2023-03-08T15:47:26.533 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 98/153 2023-03-08T15:47:26.798 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 98/153 2023-03-08T15:47:26.887 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 97/153 2023-03-08T15:47:27.374 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 98/153 2023-03-08T15:47:27.762 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-2:18.0.0-2861.ga2b8f27f.el8.x86_64 99/153 2023-03-08T15:47:27.868 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-base-2:18.0.0-2861.ga2b8f27f.el8.x86_64 99/153 2023-03-08T15:47:28.626 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-selinux-2:18.0.0-2861.ga2b8f27f.el8.x86_64 100/153 2023-03-08T15:47:32.620 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 98/153 2023-03-08T15:47:32.882 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 98/153 2023-03-08T15:47:33.629 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 98/153 2023-03-08T15:47:34.000 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-base-2:18.0.0-2861.ga2b8f27f.el8.x86_64 99/153 2023-03-08T15:47:34.268 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-base-2:18.0.0-2861.ga2b8f27f.el8.x86_64 99/153 2023-03-08T15:47:34.472 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-selinux-2:18.0.0-2861.ga2b8f27f.el8.x86_64 100/153 2023-03-08T15:47:43.694 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2861.ga2b8f27f.el8.x86_64 100/153 2023-03-08T15:47:43.694 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2023-03-08T15:47:43.694 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2023-03-08T15:47:43.694 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /dev 2023-03-08T15:47:43.695 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /run 2023-03-08T15:47:43.695 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2023-03-08T15:47:43.695 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2023-03-08T15:47:43.695 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2023-03-08T15:47:43.695 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2023-03-08T15:47:43.695 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /dev 2023-03-08T15:47:43.695 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:47:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:18.0.0-2861.ga2b8f27f.el8.noarch 101/153 2023-03-08T15:47:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:18.0.0-2861.ga2b8f27f.el8.noarch 101/153 2023-03-08T15:47:45.966 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 102/153 2023-03-08T15:47:46.184 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 102/153 2023-03-08T15:47:46.426 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:18.0.0-2861.ga2b8f27f.el8.x86_64 103/153 2023-03-08T15:47:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:18.0.0-2861.ga2b8f27f.el8.x86_64 103/153 2023-03-08T15:47:47.110 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:18.0.0-2861.ga2b8f27f.el8.x86_64 104/153 2023-03-08T15:47:47.133 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:18.0.0-2861.ga2b8f27f.el8.x86_64 104/153 2023-03-08T15:47:47.391 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 105/153 2023-03-08T15:47:47.541 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2861.ga2b8f27f.el8.x86_64 100/153 2023-03-08T15:47:47.541 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /sys 2023-03-08T15:47:47.541 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /proc 2023-03-08T15:47:47.541 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /dev 2023-03-08T15:47:47.541 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /run 2023-03-08T15:47:47.542 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /mnt 2023-03-08T15:47:47.542 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /var/tmp 2023-03-08T15:47:47.542 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /home 2023-03-08T15:47:47.542 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /tmp 2023-03-08T15:47:47.542 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /dev 2023-03-08T15:47:47.542 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:47:47.603 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 106/153 2023-03-08T15:47:47.792 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 107/153 2023-03-08T15:47:47.865 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 107/153 2023-03-08T15:47:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-volume-2:18.0.0-2861.ga2b8f27f.el8.noarch 101/153 2023-03-08T15:47:48.176 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : jq-1.6-6.el8.x86_64 108/153 2023-03-08T15:47:48.459 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.1-7.el8.noarch 109/153 2023-03-08T15:47:49.531 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-volume-2:18.0.0-2861.ga2b8f27f.el8.noarch 101/153 2023-03-08T15:47:49.800 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 102/153 2023-03-08T15:47:49.946 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:18.0.0-2861.ga2b8f27f.el8.noarch 110/153 2023-03-08T15:47:50.017 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-osd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 102/153 2023-03-08T15:47:50.135 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:18.0.0-2861.ga2b8f27f.el8.noarch 110/153 2023-03-08T15:47:50.243 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-2:18.0.0-2861.ga2b8f27f.el8.x86_64 103/153 2023-03-08T15:47:50.248 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2861.ga2b8f27f.e 111/153 2023-03-08T15:47:50.447 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2861.ga2b8f27f. 112/153 2023-03-08T15:47:50.642 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2861.ga2b8f27f.el8.noa 113/153 2023-03-08T15:47:50.692 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mds-2:18.0.0-2861.ga2b8f27f.el8.x86_64 103/153 2023-03-08T15:47:50.860 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2861.ga2b8f27f.el8.noa 113/153 2023-03-08T15:47:50.894 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-2:18.0.0-2861.ga2b8f27f.el8.x86_64 104/153 2023-03-08T15:47:50.917 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mon-2:18.0.0-2861.ga2b8f27f.el8.x86_64 104/153 2023-03-08T15:47:51.175 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 105/153 2023-03-08T15:47:51.265 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2861.ga2b8f27f.el8.n 114/153 2023-03-08T15:47:51.437 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 106/153 2023-03-08T15:47:51.610 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 107/153 2023-03-08T15:47:51.691 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 107/153 2023-03-08T15:47:51.985 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : jq-1.6-6.el8.x86_64 108/153 2023-03-08T15:47:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2861.ga2b8f27f.el8.n 114/153 2023-03-08T15:47:52.285 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : automake-1.16.1-7.el8.noarch 109/153 2023-03-08T15:47:52.442 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2861.ga2b 115/153 2023-03-08T15:47:52.532 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2861.ga2b 115/153 2023-03-08T15:47:52.934 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2861.ga2b8f27f.el 116/153 2023-03-08T15:47:53.208 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:18.0.0-2861.ga2b8f27f.el8.x86_64 117/153 2023-03-08T15:47:53.243 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2861.ga2b8f27f.el8.x86_64 117/153 2023-03-08T15:47:53.433 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:18.0.0-2861.ga2b8f27f.el8.noarch 118/153 2023-03-08T15:47:53.443 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2861.ga2b8f27f.el8.noarch 118/153 2023-03-08T15:47:53.664 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:18.0.0-2861.ga2b8f27f.el8.x86_64 119/153 2023-03-08T15:47:53.866 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/153 2023-03-08T15:47:53.931 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:18.0.0-2861.ga2b8f27f.el8.noarch 110/153 2023-03-08T15:47:54.118 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephadm-2:18.0.0-2861.ga2b8f27f.el8.noarch 110/153 2023-03-08T15:47:54.282 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2861.ga2b8f27f.e 111/153 2023-03-08T15:47:54.500 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2861.ga2b8f27f. 112/153 2023-03-08T15:47:54.726 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2861.ga2b8f27f.el8.noa 113/153 2023-03-08T15:47:54.940 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2861.ga2b8f27f.el8.noa 113/153 2023-03-08T15:47:55.224 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2861.ga2b8f27f.el8.n 114/153 2023-03-08T15:47:56.183 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2861.ga2b8f27f.el8.n 114/153 2023-03-08T15:47:56.303 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2861.ga2b8f27f.el8.x86_64 100/153 2023-03-08T15:47:56.303 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /sys 2023-03-08T15:47:56.303 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /proc 2023-03-08T15:47:56.304 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /dev 2023-03-08T15:47:56.304 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /run 2023-03-08T15:47:56.304 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /mnt 2023-03-08T15:47:56.305 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /var/tmp 2023-03-08T15:47:56.305 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /home 2023-03-08T15:47:56.305 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /tmp 2023-03-08T15:47:56.305 INFO:teuthology.orchestra.run.smithi182.stdout:skipping the directory /dev 2023-03-08T15:47:56.305 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:47:56.400 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2861.ga2b 115/153 2023-03-08T15:47:56.490 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2861.ga2b 115/153 2023-03-08T15:47:56.744 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-volume-2:18.0.0-2861.ga2b8f27f.el8.noarch 101/153 2023-03-08T15:47:56.901 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2861.ga2b8f27f.el 116/153 2023-03-08T15:47:57.209 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-2:18.0.0-2861.ga2b8f27f.el8.x86_64 117/153 2023-03-08T15:47:57.244 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2861.ga2b8f27f.el8.x86_64 117/153 2023-03-08T15:47:57.434 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-rook-2:18.0.0-2861.ga2b8f27f.el8.noarch 118/153 2023-03-08T15:47:57.445 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2861.ga2b8f27f.el8.noarch 118/153 2023-03-08T15:47:57.659 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-2:18.0.0-2861.ga2b8f27f.el8.x86_64 119/153 2023-03-08T15:47:57.858 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/153 2023-03-08T15:47:58.277 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/153 2023-03-08T15:47:58.585 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-volume-2:18.0.0-2861.ga2b8f27f.el8.noarch 101/153 2023-03-08T15:47:58.804 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-osd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 102/153 2023-03-08T15:47:59.114 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-osd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 102/153 2023-03-08T15:47:59.343 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mds-2:18.0.0-2861.ga2b8f27f.el8.x86_64 103/153 2023-03-08T15:47:59.757 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:18.0.0-2861.ga2b8f27f.el8.x86_64 121/153 2023-03-08T15:47:59.926 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mds-2:18.0.0-2861.ga2b8f27f.el8.x86_64 103/153 2023-03-08T15:48:00.056 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 122/153 2023-03-08T15:48:00.090 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 122/153 2023-03-08T15:48:00.143 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mon-2:18.0.0-2861.ga2b8f27f.el8.x86_64 104/153 2023-03-08T15:48:00.224 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mon-2:18.0.0-2861.ga2b8f27f.el8.x86_64 104/153 2023-03-08T15:48:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2861.ga2b8f 123/153 2023-03-08T15:48:00.357 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2861.ga2b8f 123/153 2023-03-08T15:48:00.485 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 105/153 2023-03-08T15:48:00.607 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 124/153 2023-03-08T15:48:00.749 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 106/153 2023-03-08T15:48:00.926 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 107/153 2023-03-08T15:48:00.952 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 124/153 2023-03-08T15:48:01.046 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 107/153 2023-03-08T15:48:01.165 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 125/153 2023-03-08T15:48:01.368 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : jq-1.6-6.el8.x86_64 108/153 2023-03-08T15:48:01.405 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 125/153 2023-03-08T15:48:01.651 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : automake-1.16.1-7.el8.noarch 109/153 2023-03-08T15:48:01.805 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-10.19-1.module_el8.6.0+1047+4 126/153 2023-03-08T15:48:02.259 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/153 2023-03-08T15:48:02.710 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 127/153 2023-03-08T15:48:03.053 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:1.1.1k-7.el8.x86_64 128/153 2023-03-08T15:48:03.259 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : util-linux-user-2.32.1-40.el8.x86_64 129/153 2023-03-08T15:48:03.494 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 130/153 2023-03-08T15:48:03.719 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_ 131/153 2023-03-08T15:48:03.746 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-2:18.0.0-2861.ga2b8f27f.el8.x86_64 121/153 2023-03-08T15:48:03.899 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.188-3.el8.x86_64 132/153 2023-03-08T15:48:04.048 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 122/153 2023-03-08T15:48:04.081 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 122/153 2023-03-08T15:48:04.283 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2861.ga2b8f 123/153 2023-03-08T15:48:04.324 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2861.ga2b8f 123/153 2023-03-08T15:48:04.558 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 124/153 2023-03-08T15:48:04.838 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: cephadm-2:18.0.0-2861.ga2b8f27f.el8.noarch 110/153 2023-03-08T15:48:04.904 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 124/153 2023-03-08T15:48:05.040 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : cephadm-2:18.0.0-2861.ga2b8f27f.el8.noarch 110/153 2023-03-08T15:48:05.116 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 125/153 2023-03-08T15:48:05.176 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2861.ga2b8f27f.e 111/153 2023-03-08T15:48:05.319 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 125/153 2023-03-08T15:48:05.416 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2861.ga2b8f27f. 112/153 2023-03-08T15:48:05.641 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2861.ga2b8f27f.el8.noa 113/153 2023-03-08T15:48:05.730 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-contrib-10.19-1.module_el8.6.0+1047+4 126/153 2023-03-08T15:48:05.942 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2861.ga2b8f27f.el8.noa 113/153 2023-03-08T15:48:06.057 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-10.19-1.module_el8.6.0+1047+42 133/153 2023-03-08T15:48:06.219 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2861.ga2b8f27f.el8.n 114/153 2023-03-08T15:48:06.356 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-10.19-1.module_el8.6.0+1047+42 133/153 2023-03-08T15:48:06.375 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-10.19-1.module_el8.6.0+1047+42 133/153 2023-03-08T15:48:06.606 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 127/153 2023-03-08T15:48:06.682 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:18.0.0-2861.ga2b8f27f.el8.noarch 134/153 2023-03-08T15:48:06.930 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openssl-devel-1:1.1.1k-7.el8.x86_64 128/153 2023-03-08T15:48:06.930 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 135/153 2023-03-08T15:48:07.158 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 136/153 2023-03-08T15:48:07.159 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : util-linux-user-2.32.1-40.el8.x86_64 129/153 2023-03-08T15:48:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.12-1.el 137/153 2023-03-08T15:48:07.374 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.12-1.el 137/153 2023-03-08T15:48:07.386 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 130/153 2023-03-08T15:48:07.436 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2861.ga2b8f27f.el8.n 114/153 2023-03-08T15:48:07.578 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_ 131/153 2023-03-08T15:48:07.603 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 138/153 2023-03-08T15:48:07.649 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2861.ga2b 115/153 2023-03-08T15:48:07.805 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.1-9.el8.x86_64 139/153 2023-03-08T15:48:07.808 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : elfutils-libelf-devel-0.188-3.el8.x86_64 132/153 2023-03-08T15:48:07.811 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2861.ga2b 115/153 2023-03-08T15:48:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 139/153 2023-03-08T15:48:08.130 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.0.4-10.el8.x86_64 140/153 2023-03-08T15:48:08.142 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 140/153 2023-03-08T15:48:08.241 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2861.ga2b8f27f.el 116/153 2023-03-08T15:48:08.365 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : elfutils-debuginfod-client-0.187-4.el8.x86_64 141/153 2023-03-08T15:48:08.509 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-2:18.0.0-2861.ga2b8f27f.el8.x86_64 117/153 2023-03-08T15:48:08.556 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : elfutils-libs-0.187-4.el8.x86_64 142/153 2023-03-08T15:48:08.556 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 143/153 2023-03-08T15:48:08.607 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2861.ga2b8f27f.el8.x86_64 117/153 2023-03-08T15:48:08.808 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-mgr-rook-2:18.0.0-2861.ga2b8f27f.el8.noarch 118/153 2023-03-08T15:48:08.840 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 143/153 2023-03-08T15:48:08.846 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.39.12-1.el 144/153 2023-03-08T15:48:08.859 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2861.ga2b8f27f.el8.noarch 118/153 2023-03-08T15:48:09.025 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.39.12-1.el 144/153 2023-03-08T15:48:09.025 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 145/153 2023-03-08T15:48:09.105 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-2:18.0.0-2861.ga2b8f27f.el8.x86_64 119/153 2023-03-08T15:48:09.308 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 145/153 2023-03-08T15:48:09.316 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/153 2023-03-08T15:48:09.498 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : util-linux-user-2.32.1-38.el8.x86_64 146/153 2023-03-08T15:48:09.798 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : util-linux-2.32.1-38.el8.x86_64 147/153 2023-03-08T15:48:09.799 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : libfdisk-2.32.1-38.el8.x86_64 148/153 2023-03-08T15:48:09.892 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-10.19-1.module_el8.6.0+1047+42 133/153 2023-03-08T15:48:10.066 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libfdisk-2.32.1-38.el8.x86_64 148/153 2023-03-08T15:48:10.066 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : libmount-2.32.1-38.el8.x86_64 149/153 2023-03-08T15:48:10.232 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-server-10.19-1.module_el8.6.0+1047+42 133/153 2023-03-08T15:48:10.249 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-10.19-1.module_el8.6.0+1047+42 133/153 2023-03-08T15:48:10.308 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libmount-2.32.1-38.el8.x86_64 149/153 2023-03-08T15:48:10.308 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : libblkid-2.32.1-38.el8.x86_64 150/153 2023-03-08T15:48:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libblkid-2.32.1-38.el8.x86_64 150/153 2023-03-08T15:48:10.558 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : libuuid-2.32.1-38.el8.x86_64 151/153 2023-03-08T15:48:10.574 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-top-2:18.0.0-2861.ga2b8f27f.el8.noarch 134/153 2023-03-08T15:48:10.789 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 135/153 2023-03-08T15:48:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libuuid-2.32.1-38.el8.x86_64 151/153 2023-03-08T15:48:10.824 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : libsmartcols-2.32.1-38.el8.x86_64 152/153 2023-03-08T15:48:11.009 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 136/153 2023-03-08T15:48:11.041 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libsmartcols-2.32.1-38.el8.x86_64 152/153 2023-03-08T15:48:11.173 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.12-1.el 137/153 2023-03-08T15:48:11.189 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.12-1.el 137/153 2023-03-08T15:48:11.287 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : elfutils-libelf-0.187-4.el8.x86_64 153/153 2023-03-08T15:48:11.401 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 138/153 2023-03-08T15:48:11.615 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flex-2.6.1-9.el8.x86_64 139/153 2023-03-08T15:48:11.727 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 139/153 2023-03-08T15:48:11.827 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: elfutils-libelf-0.187-4.el8.x86_64 153/153 2023-03-08T15:48:11.827 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:18.0.0-2861.ga2b8f27f.el8.x86_64 1/153 2023-03-08T15:48:11.828 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2/153 2023-03-08T15:48:11.828 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 3/153 2023-03-08T15:48:11.828 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 4/153 2023-03-08T15:48:11.828 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2861.ga2b8f 5/153 2023-03-08T15:48:11.828 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:18.0.0-2861.ga2b8f27f.el8.x86_64 6/153 2023-03-08T15:48:11.828 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:18.0.0-2861.ga2b8f27f.el8.x86_64 7/153 2023-03-08T15:48:11.828 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:18.0.0-2861.ga2b8f27f.el8.x86_64 8/153 2023-03-08T15:48:11.828 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 9/153 2023-03-08T15:48:11.829 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 10/153 2023-03-08T15:48:11.829 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:18.0.0-2861.ga2b8f27f.el8.x86_64 11/153 2023-03-08T15:48:11.829 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:18.0.0-2861.ga2b8f27f.el8.x86_64 12/153 2023-03-08T15:48:11.829 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 13/153 2023-03-08T15:48:11.829 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_ 14/153 2023-03-08T15:48:11.829 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 15/153 2023-03-08T15:48:11.829 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:18.0.0-2861.ga2b8f27f.el8.x86_64 16/153 2023-03-08T15:48:11.830 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_6 17/153 2023-03-08T15:48:11.830 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:18.0.0-2861.ga2b8f27f.el8.x86 18/153 2023-03-08T15:48:11.830 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 19/153 2023-03-08T15:48:11.830 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2861.ga2b8f27f.el 20/153 2023-03-08T15:48:11.830 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:18.0.0-2861.ga2b8f27f.el8. 21/153 2023-03-08T15:48:11.830 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:18.0.0-2861.ga2b8f27f.el8.x86_6 22/153 2023-03-08T15:48:11.830 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:18.0.0-2861.ga2b8f27f.el8.x86_64 23/153 2023-03-08T15:48:11.830 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 24/153 2023-03-08T15:48:11.831 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 25/153 2023-03-08T15:48:11.831 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 26/153 2023-03-08T15:48:11.831 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 27/153 2023-03-08T15:48:11.839 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 28/153 2023-03-08T15:48:11.839 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2861.ga2b8f27f. 29/153 2023-03-08T15:48:11.839 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2861.ga2b8f27f.el8.noa 30/153 2023-03-08T15:48:11.839 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2861.ga2b8f27f.el8.n 31/153 2023-03-08T15:48:11.839 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2861.ga2b 32/153 2023-03-08T15:48:11.840 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2861.ga2b8f27f.el 33/153 2023-03-08T15:48:11.840 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2861.ga2b8f27f.el8.noarch 34/153 2023-03-08T15:48:11.840 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2861.ga2b8f27f.e 35/153 2023-03-08T15:48:11.840 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:18.0.0-2861.ga2b8f27f.el8.noarch 36/153 2023-03-08T15:48:11.840 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:18.0.0-2861.ga2b8f27f.el8.noarch 37/153 2023-03-08T15:48:11.840 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:18.0.0-2861.ga2b8f27f.el8.noarch 38/153 2023-03-08T15:48:11.840 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/153 2023-03-08T15:48:11.840 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/153 2023-03-08T15:48:11.841 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/153 2023-03-08T15:48:11.841 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : jq-1.6-6.el8.x86_64 42/153 2023-03-08T15:48:11.841 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/153 2023-03-08T15:48:11.841 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/153 2023-03-08T15:48:11.841 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/153 2023-03-08T15:48:11.841 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/153 2023-03-08T15:48:11.841 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/153 2023-03-08T15:48:11.842 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/153 2023-03-08T15:48:11.842 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/153 2023-03-08T15:48:11.842 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-10.19-1.module_el8.6.0+1047+4202cf9a. 50/153 2023-03-08T15:48:11.842 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-10.19-1.module_el8.6.0+1047+4 51/153 2023-03-08T15:48:11.842 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-10.19-1.module_el8.6.0+1047+42 52/153 2023-03-08T15:48:11.842 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/153 2023-03-08T15:48:11.842 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/153 2023-03-08T15:48:11.842 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/153 2023-03-08T15:48:11.843 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/153 2023-03-08T15:48:11.843 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/153 2023-03-08T15:48:11.843 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/153 2023-03-08T15:48:11.843 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/153 2023-03-08T15:48:11.843 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/153 2023-03-08T15:48:11.843 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/153 2023-03-08T15:48:11.843 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/153 2023-03-08T15:48:11.844 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/153 2023-03-08T15:48:11.844 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/153 2023-03-08T15:48:11.844 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/153 2023-03-08T15:48:11.844 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/153 2023-03-08T15:48:11.844 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/153 2023-03-08T15:48:11.844 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/153 2023-03-08T15:48:11.844 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/153 2023-03-08T15:48:11.844 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/153 2023-03-08T15:48:11.845 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.188-3.el8.x86_64 71/153 2023-03-08T15:48:11.845 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 72/153 2023-03-08T15:48:11.845 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/153 2023-03-08T15:48:11.845 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/153 2023-03-08T15:48:11.845 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/153 2023-03-08T15:48:11.845 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/153 2023-03-08T15:48:11.845 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-8.5.0-18.el8.x86_64 77/153 2023-03-08T15:48:11.845 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-8.5.0-18.el8.x86_64 78/153 2023-03-08T15:48:11.846 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/153 2023-03-08T15:48:11.846 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libselinux-devel-2.9-6.el8.x86_64 80/153 2023-03-08T15:48:11.846 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/153 2023-03-08T15:48:11.846 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.32.1-40.el8.x86_64 82/153 2023-03-08T15:48:11.846 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/153 2023-03-08T15:48:11.846 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8.x86_64 84/153 2023-03-08T15:48:11.846 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 85/153 2023-03-08T15:48:11.846 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 86/153 2023-03-08T15:48:11.847 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 87/153 2023-03-08T15:48:11.847 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 88/153 2023-03-08T15:48:11.847 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 89/153 2023-03-08T15:48:11.847 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 90/153 2023-03-08T15:48:11.847 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 91/153 2023-03-08T15:48:11.847 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 92/153 2023-03-08T15:48:11.847 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 93/153 2023-03-08T15:48:11.848 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 94/153 2023-03-08T15:48:11.848 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-19.el8.x86_64 95/153 2023-03-08T15:48:11.848 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 96/153 2023-03-08T15:48:11.848 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 97/153 2023-03-08T15:48:11.848 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 98/153 2023-03-08T15:48:11.848 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 99/153 2023-03-08T15:48:11.848 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 100/153 2023-03-08T15:48:11.848 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 101/153 2023-03-08T15:48:11.849 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 102/153 2023-03-08T15:48:11.849 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 103/153 2023-03-08T15:48:11.849 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 104/153 2023-03-08T15:48:11.849 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 105/153 2023-03-08T15:48:11.849 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 106/153 2023-03-08T15:48:11.849 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 107/153 2023-03-08T15:48:11.849 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 108/153 2023-03-08T15:48:11.849 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 109/153 2023-03-08T15:48:11.850 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 110/153 2023-03-08T15:48:11.850 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 111/153 2023-03-08T15:48:11.850 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 112/153 2023-03-08T15:48:11.850 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 113/153 2023-03-08T15:48:11.850 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-2.6-1.el8.noarch 114/153 2023-03-08T15:48:11.850 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 115/153 2023-03-08T15:48:11.850 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 116/153 2023-03-08T15:48:11.850 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 117/153 2023-03-08T15:48:11.851 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 118/153 2023-03-08T15:48:11.851 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 119/153 2023-03-08T15:48:11.851 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 120/153 2023-03-08T15:48:11.851 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 121/153 2023-03-08T15:48:11.851 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 122/153 2023-03-08T15:48:11.851 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 123/153 2023-03-08T15:48:11.851 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 124/153 2023-03-08T15:48:11.852 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 125/153 2023-03-08T15:48:11.852 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 126/153 2023-03-08T15:48:11.852 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 127/153 2023-03-08T15:48:11.852 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 128/153 2023-03-08T15:48:11.852 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/153 2023-03-08T15:48:11.852 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:18.0.0-2861.ga2b8f27f.el8.x86_64 130/153 2023-03-08T15:48:11.852 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/153 2023-03-08T15:48:11.852 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.12-1.el 132/153 2023-03-08T15:48:11.853 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-initscripts-updown-1:1.39.12-1.el 133/153 2023-03-08T15:48:11.853 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-debuginfod-client-0.188-3.el8.x86_64 134/153 2023-03-08T15:48:11.853 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-debuginfod-client-0.187-4.el8.x86_64 135/153 2023-03-08T15:48:11.853 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-0.188-3.el8.x86_64 136/153 2023-03-08T15:48:11.853 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-0.187-4.el8.x86_64 137/153 2023-03-08T15:48:11.853 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libs-0.188-3.el8.x86_64 138/153 2023-03-08T15:48:11.853 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libs-0.187-4.el8.x86_64 139/153 2023-03-08T15:48:11.853 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libblkid-2.32.1-40.el8.x86_64 140/153 2023-03-08T15:48:11.854 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libblkid-2.32.1-38.el8.x86_64 141/153 2023-03-08T15:48:11.854 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libfdisk-2.32.1-40.el8.x86_64 142/153 2023-03-08T15:48:11.854 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libfdisk-2.32.1-38.el8.x86_64 143/153 2023-03-08T15:48:11.854 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libmount-2.32.1-40.el8.x86_64 144/153 2023-03-08T15:48:11.854 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libmount-2.32.1-38.el8.x86_64 145/153 2023-03-08T15:48:11.854 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libsmartcols-2.32.1-40.el8.x86_64 146/153 2023-03-08T15:48:11.854 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libsmartcols-2.32.1-38.el8.x86_64 147/153 2023-03-08T15:48:11.854 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-2.32.1-40.el8.x86_64 148/153 2023-03-08T15:48:11.855 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-2.32.1-38.el8.x86_64 149/153 2023-03-08T15:48:11.855 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : util-linux-2.32.1-40.el8.x86_64 150/153 2023-03-08T15:48:11.855 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : util-linux-2.32.1-38.el8.x86_64 151/153 2023-03-08T15:48:11.855 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : util-linux-user-2.32.1-40.el8.x86_64 152/153 2023-03-08T15:48:11.940 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : bison-3.0.4-10.el8.x86_64 140/153 2023-03-08T15:48:11.951 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 140/153 2023-03-08T15:48:12.158 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : elfutils-debuginfod-client-0.187-4.el8.x86_64 141/153 2023-03-08T15:48:12.340 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : elfutils-libs-0.187-4.el8.x86_64 142/153 2023-03-08T15:48:12.340 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 143/153 2023-03-08T15:48:12.600 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 143/153 2023-03-08T15:48:12.605 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.39.12-1.el 144/153 2023-03-08T15:48:12.743 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.39.12-1.el 144/153 2023-03-08T15:48:12.743 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 145/153 2023-03-08T15:48:13.025 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 145/153 2023-03-08T15:48:13.221 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : util-linux-user-2.32.1-38.el8.x86_64 146/153 2023-03-08T15:48:13.508 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : util-linux-2.32.1-38.el8.x86_64 147/153 2023-03-08T15:48:13.508 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libfdisk-2.32.1-38.el8.x86_64 148/153 2023-03-08T15:48:13.742 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libfdisk-2.32.1-38.el8.x86_64 148/153 2023-03-08T15:48:13.742 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libmount-2.32.1-38.el8.x86_64 149/153 2023-03-08T15:48:13.992 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libmount-2.32.1-38.el8.x86_64 149/153 2023-03-08T15:48:13.992 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libblkid-2.32.1-38.el8.x86_64 150/153 2023-03-08T15:48:14.118 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : util-linux-user-2.32.1-38.el8.x86_64 153/153 2023-03-08T15:48:14.119 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:14.119 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2023-03-08T15:48:14.119 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-initscripts-updown-1:1.40.12-1.el8.noarch 2023-03-08T15:48:14.119 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-debuginfod-client-0.188-3.el8.x86_64 2023-03-08T15:48:14.119 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-0.188-3.el8.x86_64 2023-03-08T15:48:14.119 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libs-0.188-3.el8.x86_64 2023-03-08T15:48:14.119 INFO:teuthology.orchestra.run.smithi175.stdout: libblkid-2.32.1-40.el8.x86_64 2023-03-08T15:48:14.120 INFO:teuthology.orchestra.run.smithi175.stdout: libfdisk-2.32.1-40.el8.x86_64 2023-03-08T15:48:14.120 INFO:teuthology.orchestra.run.smithi175.stdout: libmount-2.32.1-40.el8.x86_64 2023-03-08T15:48:14.120 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.120 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.120 INFO:teuthology.orchestra.run.smithi175.stdout: libsmartcols-2.32.1-40.el8.x86_64 2023-03-08T15:48:14.120 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-2.32.1-40.el8.x86_64 2023-03-08T15:48:14.120 INFO:teuthology.orchestra.run.smithi175.stdout: util-linux-2.32.1-40.el8.x86_64 2023-03-08T15:48:14.121 INFO:teuthology.orchestra.run.smithi175.stdout: util-linux-user-2.32.1-40.el8.x86_64 2023-03-08T15:48:14.121 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2023-03-08T15:48:14.121 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.1-7.el8.noarch 2023-03-08T15:48:14.121 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.0.4-10.el8.x86_64 2023-03-08T15:48:14.121 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.121 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.121 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.121 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.122 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:14.122 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.122 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.122 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.122 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:14.122 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:14.122 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:14.123 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:14.123 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:14.123 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.123 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.123 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:14.123 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.123 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.123 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.124 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:14.124 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:14.124 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.124 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:14.124 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.188-3.el8.x86_64 2023-03-08T15:48:14.124 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.1-9.el8.x86_64 2023-03-08T15:48:14.124 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.7-16.el8.x86_64 2023-03-08T15:48:14.124 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-08T15:48:14.125 INFO:teuthology.orchestra.run.smithi175.stdout: jq-1.6-6.el8.x86_64 2023-03-08T15:48:14.125 INFO:teuthology.orchestra.run.smithi175.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-08T15:48:14.125 INFO:teuthology.orchestra.run.smithi175.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-03-08T15:48:14.125 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-08T15:48:14.125 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.125 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.125 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.126 INFO:teuthology.orchestra.run.smithi175.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-03-08T15:48:14.126 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-8.5.0-18.el8.x86_64 2023-03-08T15:48:14.126 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-08T15:48:14.126 INFO:teuthology.orchestra.run.smithi175.stdout: libpq-13.5-1.el8.x86_64 2023-03-08T15:48:14.126 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-8.5.0-18.el8.x86_64 2023-03-08T15:48:14.126 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-08T15:48:14.126 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.126 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.127 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-08T15:48:14.127 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.127 INFO:teuthology.orchestra.run.smithi175.stdout: libselinux-devel-2.9-6.el8.x86_64 2023-03-08T15:48:14.127 INFO:teuthology.orchestra.run.smithi175.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-08T15:48:14.127 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-08T15:48:14.127 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-08T15:48:14.127 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.32.1-40.el8.x86_64 2023-03-08T15:48:14.127 INFO:teuthology.orchestra.run.smithi175.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-03-08T15:48:14.128 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-08T15:48:14.128 INFO:teuthology.orchestra.run.smithi175.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-08T15:48:14.128 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.15-4.el8.x86_64 2023-03-08T15:48:14.128 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-03-08T15:48:14.128 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:1.1.1k-7.el8.x86_64 2023-03-08T15:48:14.128 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-03-08T15:48:14.128 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-03-08T15:48:14.129 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-03-08T15:48:14.129 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2023-03-08T15:48:14.129 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2023-03-08T15:48:14.129 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2023-03-08T15:48:14.129 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-08T15:48:14.129 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-08T15:48:14.129 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-08T15:48:14.129 INFO:teuthology.orchestra.run.smithi175.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-08T15:48:14.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-08T15:48:14.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-08T15:48:14.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-08T15:48:14.130 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-08T15:48:14.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-08T15:48:14.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-08T15:48:14.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-08T15:48:14.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-08T15:48:14.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-08T15:48:14.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-08T15:48:14.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-08T15:48:14.131 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-08T15:48:14.132 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-08T15:48:14.132 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-08T15:48:14.132 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-08T15:48:14.132 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.0.6-14.el8.noarch 2023-03-08T15:48:14.132 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-08T15:48:14.132 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-08T15:48:14.132 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-08T15:48:14.132 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-08T15:48:14.133 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-08T15:48:14.133 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-08T15:48:14.133 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-08T15:48:14.133 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-2.6-1.el8.noarch 2023-03-08T15:48:14.133 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-08T15:48:14.133 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-08T15:48:14.133 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-08T15:48:14.134 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-08T15:48:14.134 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-08T15:48:14.134 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-08T15:48:14.134 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.134 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.134 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-08T15:48:14.134 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-08T15:48:14.134 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.135 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-08T15:48:14.135 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-08T15:48:14.135 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-03-08T15:48:14.135 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-08T15:48:14.135 INFO:teuthology.orchestra.run.smithi175.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-08T15:48:14.135 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-08T15:48:14.135 INFO:teuthology.orchestra.run.smithi175.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-08T15:48:14.135 INFO:teuthology.orchestra.run.smithi175.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-08T15:48:14.136 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-08T15:48:14.136 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-08T15:48:14.136 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-08T15:48:14.136 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-08T15:48:14.136 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-08T15:48:14.136 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.136 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.136 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:14.137 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-08T15:48:14.137 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-08T15:48:14.137 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-08T15:48:14.137 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-08T15:48:14.137 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-08T15:48:14.138 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-19.el8.x86_64 2023-03-08T15:48:14.138 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:14.138 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2023-03-08T15:48:14.267 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libblkid-2.32.1-38.el8.x86_64 150/153 2023-03-08T15:48:14.267 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libuuid-2.32.1-38.el8.x86_64 151/153 2023-03-08T15:48:14.303 DEBUG:teuthology.parallel:result is None 2023-03-08T15:48:14.419 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/153 2023-03-08T15:48:14.525 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libuuid-2.32.1-38.el8.x86_64 151/153 2023-03-08T15:48:14.525 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libsmartcols-2.32.1-38.el8.x86_64 152/153 2023-03-08T15:48:14.750 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libsmartcols-2.32.1-38.el8.x86_64 152/153 2023-03-08T15:48:14.988 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : elfutils-libelf-0.187-4.el8.x86_64 153/153 2023-03-08T15:48:15.523 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: elfutils-libelf-0.187-4.el8.x86_64 153/153 2023-03-08T15:48:15.524 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-2:18.0.0-2861.ga2b8f27f.el8.x86_64 1/153 2023-03-08T15:48:15.524 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2/153 2023-03-08T15:48:15.524 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 3/153 2023-03-08T15:48:15.524 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 4/153 2023-03-08T15:48:15.524 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2861.ga2b8f 5/153 2023-03-08T15:48:15.525 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-2:18.0.0-2861.ga2b8f27f.el8.x86_64 6/153 2023-03-08T15:48:15.525 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-2:18.0.0-2861.ga2b8f27f.el8.x86_64 7/153 2023-03-08T15:48:15.525 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-2:18.0.0-2861.ga2b8f27f.el8.x86_64 8/153 2023-03-08T15:48:15.525 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 9/153 2023-03-08T15:48:15.525 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 10/153 2023-03-08T15:48:15.525 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-selinux-2:18.0.0-2861.ga2b8f27f.el8.x86_64 11/153 2023-03-08T15:48:15.525 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-2:18.0.0-2861.ga2b8f27f.el8.x86_64 12/153 2023-03-08T15:48:15.526 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 13/153 2023-03-08T15:48:15.526 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_ 14/153 2023-03-08T15:48:15.526 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 15/153 2023-03-08T15:48:15.526 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephsqlite-2:18.0.0-2861.ga2b8f27f.el8.x86_64 16/153 2023-03-08T15:48:15.526 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_6 17/153 2023-03-08T15:48:15.526 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libradosstriper1-2:18.0.0-2861.ga2b8f27f.el8.x86 18/153 2023-03-08T15:48:15.526 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librgw2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 19/153 2023-03-08T15:48:15.526 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2861.ga2b8f27f.el 20/153 2023-03-08T15:48:15.527 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-common-2:18.0.0-2861.ga2b8f27f.el8. 21/153 2023-03-08T15:48:15.527 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-2:18.0.0-2861.ga2b8f27f.el8.x86_6 22/153 2023-03-08T15:48:15.527 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-2:18.0.0-2861.ga2b8f27f.el8.x86_64 23/153 2023-03-08T15:48:15.527 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 24/153 2023-03-08T15:48:15.527 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 25/153 2023-03-08T15:48:15.527 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 26/153 2023-03-08T15:48:15.527 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 27/153 2023-03-08T15:48:15.527 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 28/153 2023-03-08T15:48:15.528 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2861.ga2b8f27f. 29/153 2023-03-08T15:48:15.528 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2861.ga2b8f27f.el8.noa 30/153 2023-03-08T15:48:15.528 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2861.ga2b8f27f.el8.n 31/153 2023-03-08T15:48:15.528 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2861.ga2b 32/153 2023-03-08T15:48:15.535 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2861.ga2b8f27f.el 33/153 2023-03-08T15:48:15.536 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2861.ga2b8f27f.el8.noarch 34/153 2023-03-08T15:48:15.536 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2861.ga2b8f27f.e 35/153 2023-03-08T15:48:15.536 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-volume-2:18.0.0-2861.ga2b8f27f.el8.noarch 36/153 2023-03-08T15:48:15.536 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephadm-2:18.0.0-2861.ga2b8f27f.el8.noarch 37/153 2023-03-08T15:48:15.536 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-top-2:18.0.0-2861.ga2b8f27f.el8.noarch 38/153 2023-03-08T15:48:15.536 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/153 2023-03-08T15:48:15.536 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/153 2023-03-08T15:48:15.537 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/153 2023-03-08T15:48:15.537 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : jq-1.6-6.el8.x86_64 42/153 2023-03-08T15:48:15.537 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/153 2023-03-08T15:48:15.537 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/153 2023-03-08T15:48:15.537 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/153 2023-03-08T15:48:15.537 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/153 2023-03-08T15:48:15.537 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/153 2023-03-08T15:48:15.538 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/153 2023-03-08T15:48:15.538 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/153 2023-03-08T15:48:15.538 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-10.19-1.module_el8.6.0+1047+4202cf9a. 50/153 2023-03-08T15:48:15.538 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-contrib-10.19-1.module_el8.6.0+1047+4 51/153 2023-03-08T15:48:15.538 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-server-10.19-1.module_el8.6.0+1047+42 52/153 2023-03-08T15:48:15.538 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/153 2023-03-08T15:48:15.538 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/153 2023-03-08T15:48:15.539 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/153 2023-03-08T15:48:15.539 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/153 2023-03-08T15:48:15.539 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/153 2023-03-08T15:48:15.539 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/153 2023-03-08T15:48:15.539 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/153 2023-03-08T15:48:15.539 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/153 2023-03-08T15:48:15.539 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/153 2023-03-08T15:48:15.539 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/153 2023-03-08T15:48:15.540 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/153 2023-03-08T15:48:15.540 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/153 2023-03-08T15:48:15.540 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/153 2023-03-08T15:48:15.540 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/153 2023-03-08T15:48:15.540 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/153 2023-03-08T15:48:15.540 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/153 2023-03-08T15:48:15.540 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/153 2023-03-08T15:48:15.540 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/153 2023-03-08T15:48:15.541 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-devel-0.188-3.el8.x86_64 71/153 2023-03-08T15:48:15.541 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 72/153 2023-03-08T15:48:15.541 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/153 2023-03-08T15:48:15.541 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/153 2023-03-08T15:48:15.541 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/153 2023-03-08T15:48:15.541 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/153 2023-03-08T15:48:15.541 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libgfortran-8.5.0-18.el8.x86_64 77/153 2023-03-08T15:48:15.542 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libquadmath-8.5.0-18.el8.x86_64 78/153 2023-03-08T15:48:15.542 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/153 2023-03-08T15:48:15.542 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libselinux-devel-2.9-6.el8.x86_64 80/153 2023-03-08T15:48:15.542 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/153 2023-03-08T15:48:15.542 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-devel-2.32.1-40.el8.x86_64 82/153 2023-03-08T15:48:15.542 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/153 2023-03-08T15:48:15.542 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8.x86_64 84/153 2023-03-08T15:48:15.542 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 85/153 2023-03-08T15:48:15.543 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 86/153 2023-03-08T15:48:15.543 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 87/153 2023-03-08T15:48:15.543 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 88/153 2023-03-08T15:48:15.543 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 89/153 2023-03-08T15:48:15.543 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 90/153 2023-03-08T15:48:15.543 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 91/153 2023-03-08T15:48:15.543 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 92/153 2023-03-08T15:48:15.543 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 93/153 2023-03-08T15:48:15.544 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 94/153 2023-03-08T15:48:15.544 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : zlib-devel-1.2.11-19.el8.x86_64 95/153 2023-03-08T15:48:15.544 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 96/153 2023-03-08T15:48:15.544 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 97/153 2023-03-08T15:48:15.544 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 98/153 2023-03-08T15:48:15.544 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 99/153 2023-03-08T15:48:15.544 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 100/153 2023-03-08T15:48:15.545 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 101/153 2023-03-08T15:48:15.545 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 102/153 2023-03-08T15:48:15.545 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 103/153 2023-03-08T15:48:15.545 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 104/153 2023-03-08T15:48:15.545 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 105/153 2023-03-08T15:48:15.545 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 106/153 2023-03-08T15:48:15.545 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 107/153 2023-03-08T15:48:15.545 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 108/153 2023-03-08T15:48:15.546 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 109/153 2023-03-08T15:48:15.546 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 110/153 2023-03-08T15:48:15.546 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 111/153 2023-03-08T15:48:15.546 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 112/153 2023-03-08T15:48:15.546 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 113/153 2023-03-08T15:48:15.546 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-portend-2.6-1.el8.noarch 114/153 2023-03-08T15:48:15.546 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 115/153 2023-03-08T15:48:15.546 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 116/153 2023-03-08T15:48:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 117/153 2023-03-08T15:48:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 118/153 2023-03-08T15:48:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 119/153 2023-03-08T15:48:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 120/153 2023-03-08T15:48:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 121/153 2023-03-08T15:48:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 122/153 2023-03-08T15:48:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 123/153 2023-03-08T15:48:15.548 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 124/153 2023-03-08T15:48:15.548 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 125/153 2023-03-08T15:48:15.548 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 126/153 2023-03-08T15:48:15.548 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 127/153 2023-03-08T15:48:15.548 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 128/153 2023-03-08T15:48:15.548 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/153 2023-03-08T15:48:15.548 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:18.0.0-2861.ga2b8f27f.el8.x86_64 130/153 2023-03-08T15:48:15.548 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/153 2023-03-08T15:48:15.549 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.12-1.el 132/153 2023-03-08T15:48:15.549 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-initscripts-updown-1:1.39.12-1.el 133/153 2023-03-08T15:48:15.549 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-debuginfod-client-0.188-3.el8.x86_64 134/153 2023-03-08T15:48:15.549 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-debuginfod-client-0.187-4.el8.x86_64 135/153 2023-03-08T15:48:15.549 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-0.188-3.el8.x86_64 136/153 2023-03-08T15:48:15.549 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-0.187-4.el8.x86_64 137/153 2023-03-08T15:48:15.549 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libs-0.188-3.el8.x86_64 138/153 2023-03-08T15:48:15.549 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libs-0.187-4.el8.x86_64 139/153 2023-03-08T15:48:15.550 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libblkid-2.32.1-40.el8.x86_64 140/153 2023-03-08T15:48:15.550 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libblkid-2.32.1-38.el8.x86_64 141/153 2023-03-08T15:48:15.550 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libfdisk-2.32.1-40.el8.x86_64 142/153 2023-03-08T15:48:15.550 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libfdisk-2.32.1-38.el8.x86_64 143/153 2023-03-08T15:48:15.550 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libmount-2.32.1-40.el8.x86_64 144/153 2023-03-08T15:48:15.550 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libmount-2.32.1-38.el8.x86_64 145/153 2023-03-08T15:48:15.550 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libsmartcols-2.32.1-40.el8.x86_64 146/153 2023-03-08T15:48:15.551 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libsmartcols-2.32.1-38.el8.x86_64 147/153 2023-03-08T15:48:15.551 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-2.32.1-40.el8.x86_64 148/153 2023-03-08T15:48:15.551 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-2.32.1-38.el8.x86_64 149/153 2023-03-08T15:48:15.551 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-2.32.1-40.el8.x86_64 150/153 2023-03-08T15:48:15.551 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-2.32.1-38.el8.x86_64 151/153 2023-03-08T15:48:15.551 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-user-2.32.1-40.el8.x86_64 152/153 2023-03-08T15:48:16.032 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-test-2:18.0.0-2861.ga2b8f27f.el8.x86_64 121/153 2023-03-08T15:48:16.287 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-radosgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 122/153 2023-03-08T15:48:16.380 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 122/153 2023-03-08T15:48:16.624 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2861.ga2b8f 123/153 2023-03-08T15:48:16.728 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2861.ga2b8f 123/153 2023-03-08T15:48:16.957 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : cephfs-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 124/153 2023-03-08T15:48:17.415 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 124/153 2023-03-08T15:48:17.640 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : rbd-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 125/153 2023-03-08T15:48:17.709 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-user-2.32.1-38.el8.x86_64 153/153 2023-03-08T15:48:17.709 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:17.709 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2023-03-08T15:48:17.709 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-initscripts-updown-1:1.40.12-1.el8.noarch 2023-03-08T15:48:17.710 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-debuginfod-client-0.188-3.el8.x86_64 2023-03-08T15:48:17.710 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-0.188-3.el8.x86_64 2023-03-08T15:48:17.710 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libs-0.188-3.el8.x86_64 2023-03-08T15:48:17.710 INFO:teuthology.orchestra.run.smithi123.stdout: libblkid-2.32.1-40.el8.x86_64 2023-03-08T15:48:17.710 INFO:teuthology.orchestra.run.smithi123.stdout: libfdisk-2.32.1-40.el8.x86_64 2023-03-08T15:48:17.710 INFO:teuthology.orchestra.run.smithi123.stdout: libmount-2.32.1-40.el8.x86_64 2023-03-08T15:48:17.710 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.710 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.711 INFO:teuthology.orchestra.run.smithi123.stdout: libsmartcols-2.32.1-40.el8.x86_64 2023-03-08T15:48:17.711 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-2.32.1-40.el8.x86_64 2023-03-08T15:48:17.711 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-2.32.1-40.el8.x86_64 2023-03-08T15:48:17.711 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-user-2.32.1-40.el8.x86_64 2023-03-08T15:48:17.711 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-03-08T15:48:17.711 INFO:teuthology.orchestra.run.smithi123.stdout: automake-1.16.1-7.el8.noarch 2023-03-08T15:48:17.711 INFO:teuthology.orchestra.run.smithi123.stdout: bison-3.0.4-10.el8.x86_64 2023-03-08T15:48:17.712 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.712 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.712 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.712 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.712 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:17.712 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.712 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.712 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.713 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:17.713 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:17.713 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:17.713 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:17.713 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:17.713 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.713 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.714 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:17.714 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.714 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.714 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.714 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:17.714 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:17.714 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.714 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:17.715 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel-0.188-3.el8.x86_64 2023-03-08T15:48:17.715 INFO:teuthology.orchestra.run.smithi123.stdout: flex-2.6.1-9.el8.x86_64 2023-03-08T15:48:17.715 INFO:teuthology.orchestra.run.smithi123.stdout: fuse-2.9.7-16.el8.x86_64 2023-03-08T15:48:17.715 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-08T15:48:17.715 INFO:teuthology.orchestra.run.smithi123.stdout: jq-1.6-6.el8.x86_64 2023-03-08T15:48:17.715 INFO:teuthology.orchestra.run.smithi123.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-08T15:48:17.715 INFO:teuthology.orchestra.run.smithi123.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-03-08T15:48:17.716 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-08T15:48:17.716 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.716 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.716 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.716 INFO:teuthology.orchestra.run.smithi123.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-03-08T15:48:17.716 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran-8.5.0-18.el8.x86_64 2023-03-08T15:48:17.716 INFO:teuthology.orchestra.run.smithi123.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-08T15:48:17.716 INFO:teuthology.orchestra.run.smithi123.stdout: libpq-13.5-1.el8.x86_64 2023-03-08T15:48:17.717 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath-8.5.0-18.el8.x86_64 2023-03-08T15:48:17.717 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-08T15:48:17.717 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.717 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.717 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-08T15:48:17.717 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.717 INFO:teuthology.orchestra.run.smithi123.stdout: libselinux-devel-2.9-6.el8.x86_64 2023-03-08T15:48:17.718 INFO:teuthology.orchestra.run.smithi123.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-08T15:48:17.718 INFO:teuthology.orchestra.run.smithi123.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-08T15:48:17.718 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-08T15:48:17.718 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel-2.32.1-40.el8.x86_64 2023-03-08T15:48:17.718 INFO:teuthology.orchestra.run.smithi123.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-03-08T15:48:17.718 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-08T15:48:17.718 INFO:teuthology.orchestra.run.smithi123.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-08T15:48:17.718 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-0.3.15-4.el8.x86_64 2023-03-08T15:48:17.719 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-03-08T15:48:17.719 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel-1:1.1.1k-7.el8.x86_64 2023-03-08T15:48:17.719 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-03-08T15:48:17.719 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-03-08T15:48:17.719 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-03-08T15:48:17.719 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2023-03-08T15:48:17.719 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2023-03-08T15:48:17.719 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2023-03-08T15:48:17.720 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-08T15:48:17.720 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-08T15:48:17.720 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-08T15:48:17.720 INFO:teuthology.orchestra.run.smithi123.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-08T15:48:17.720 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-08T15:48:17.720 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.720 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.720 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.721 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-08T15:48:17.721 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-08T15:48:17.721 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-08T15:48:17.721 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-08T15:48:17.721 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-08T15:48:17.721 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-08T15:48:17.721 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-08T15:48:17.722 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-08T15:48:17.722 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-08T15:48:17.722 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-08T15:48:17.722 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-08T15:48:17.722 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-08T15:48:17.722 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-08T15:48:17.722 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-08T15:48:17.722 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako-1.0.6-14.el8.noarch 2023-03-08T15:48:17.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-08T15:48:17.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-08T15:48:17.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-08T15:48:17.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-08T15:48:17.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-08T15:48:17.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-08T15:48:17.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-08T15:48:17.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend-2.6-1.el8.noarch 2023-03-08T15:48:17.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-08T15:48:17.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-08T15:48:17.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-08T15:48:17.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-08T15:48:17.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-08T15:48:17.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-08T15:48:17.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-08T15:48:17.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-08T15:48:17.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-08T15:48:17.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-08T15:48:17.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-03-08T15:48:17.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-08T15:48:17.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-08T15:48:17.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-08T15:48:17.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-08T15:48:17.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-08T15:48:17.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-08T15:48:17.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-08T15:48:17.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-08T15:48:17.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-08T15:48:17.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-08T15:48:17.727 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.727 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.727 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:17.727 INFO:teuthology.orchestra.run.smithi123.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-08T15:48:17.727 INFO:teuthology.orchestra.run.smithi123.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-08T15:48:17.727 INFO:teuthology.orchestra.run.smithi123.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-08T15:48:17.728 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-08T15:48:17.728 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-08T15:48:17.728 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel-1.2.11-19.el8.x86_64 2023-03-08T15:48:17.728 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:17.729 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-03-08T15:48:17.862 DEBUG:teuthology.parallel:result is None 2023-03-08T15:48:17.981 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 125/153 2023-03-08T15:48:18.373 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : postgresql-contrib-10.19-1.module_el8.6.0+1047+4 126/153 2023-03-08T15:48:19.865 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ceph-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 127/153 2023-03-08T15:48:20.214 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : openssl-devel-1:1.1.1k-7.el8.x86_64 128/153 2023-03-08T15:48:20.421 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : util-linux-user-2.32.1-40.el8.x86_64 129/153 2023-03-08T15:48:20.612 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 130/153 2023-03-08T15:48:20.837 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libcephfs-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_ 131/153 2023-03-08T15:48:21.040 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : elfutils-libelf-devel-0.188-3.el8.x86_64 132/153 2023-03-08T15:48:24.940 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: postgresql-server-10.19-1.module_el8.6.0+1047+42 133/153 2023-03-08T15:48:25.356 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : postgresql-server-10.19-1.module_el8.6.0+1047+42 133/153 2023-03-08T15:48:25.417 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: postgresql-server-10.19-1.module_el8.6.0+1047+42 133/153 2023-03-08T15:48:25.666 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : cephfs-top-2:18.0.0-2861.ga2b8f27f.el8.noarch 134/153 2023-03-08T15:48:25.916 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : rbd-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 135/153 2023-03-08T15:48:26.150 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : rbd-nbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 136/153 2023-03-08T15:48:26.313 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.12-1.el 137/153 2023-03-08T15:48:26.367 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.12-1.el 137/153 2023-03-08T15:48:26.559 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 138/153 2023-03-08T15:48:26.788 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : flex-2.6.1-9.el8.x86_64 139/153 2023-03-08T15:48:26.926 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 139/153 2023-03-08T15:48:27.171 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : bison-3.0.4-10.el8.x86_64 140/153 2023-03-08T15:48:27.220 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 140/153 2023-03-08T15:48:27.432 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : elfutils-debuginfod-client-0.187-4.el8.x86_64 141/153 2023-03-08T15:48:27.664 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : elfutils-libs-0.187-4.el8.x86_64 142/153 2023-03-08T15:48:27.664 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 143/153 2023-03-08T15:48:27.949 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 143/153 2023-03-08T15:48:27.986 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.39.12-1.el 144/153 2023-03-08T15:48:28.122 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.39.12-1.el 144/153 2023-03-08T15:48:28.122 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 145/153 2023-03-08T15:48:28.441 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 145/153 2023-03-08T15:48:28.626 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : util-linux-user-2.32.1-38.el8.x86_64 146/153 2023-03-08T15:48:30.023 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : util-linux-2.32.1-38.el8.x86_64 147/153 2023-03-08T15:48:30.024 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : libfdisk-2.32.1-38.el8.x86_64 148/153 2023-03-08T15:48:30.308 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libfdisk-2.32.1-38.el8.x86_64 148/153 2023-03-08T15:48:30.308 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : libmount-2.32.1-38.el8.x86_64 149/153 2023-03-08T15:48:30.591 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libmount-2.32.1-38.el8.x86_64 149/153 2023-03-08T15:48:30.591 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : libblkid-2.32.1-38.el8.x86_64 150/153 2023-03-08T15:48:30.857 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libblkid-2.32.1-38.el8.x86_64 150/153 2023-03-08T15:48:30.858 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : libuuid-2.32.1-38.el8.x86_64 151/153 2023-03-08T15:48:31.124 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libuuid-2.32.1-38.el8.x86_64 151/153 2023-03-08T15:48:31.124 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : libsmartcols-2.32.1-38.el8.x86_64 152/153 2023-03-08T15:48:31.390 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libsmartcols-2.32.1-38.el8.x86_64 152/153 2023-03-08T15:48:31.646 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : elfutils-libelf-0.187-4.el8.x86_64 153/153 2023-03-08T15:48:32.002 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: elfutils-libelf-0.187-4.el8.x86_64 153/153 2023-03-08T15:48:32.002 INFO:teuthology.orchestra.run.smithi182.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-03-08T15:48:32.003 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:32.895 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-2:18.0.0-2861.ga2b8f27f.el8.x86_64 1/153 2023-03-08T15:48:32.895 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-base-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2/153 2023-03-08T15:48:32.895 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 3/153 2023-03-08T15:48:32.895 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 4/153 2023-03-08T15:48:32.896 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2861.ga2b8f 5/153 2023-03-08T15:48:32.896 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mds-2:18.0.0-2861.ga2b8f27f.el8.x86_64 6/153 2023-03-08T15:48:32.896 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-2:18.0.0-2861.ga2b8f27f.el8.x86_64 7/153 2023-03-08T15:48:32.896 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mon-2:18.0.0-2861.ga2b8f27f.el8.x86_64 8/153 2023-03-08T15:48:32.896 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-osd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 9/153 2023-03-08T15:48:32.896 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-radosgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 10/153 2023-03-08T15:48:32.896 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-selinux-2:18.0.0-2861.ga2b8f27f.el8.x86_64 11/153 2023-03-08T15:48:32.897 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-test-2:18.0.0-2861.ga2b8f27f.el8.x86_64 12/153 2023-03-08T15:48:32.897 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : cephfs-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 13/153 2023-03-08T15:48:32.897 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libcephfs-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_ 14/153 2023-03-08T15:48:32.897 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libcephfs2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 15/153 2023-03-08T15:48:32.897 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libcephsqlite-2:18.0.0-2861.ga2b8f27f.el8.x86_64 16/153 2023-03-08T15:48:32.897 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librados-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_6 17/153 2023-03-08T15:48:32.897 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libradosstriper1-2:18.0.0-2861.ga2b8f27f.el8.x86 18/153 2023-03-08T15:48:32.898 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librgw2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 19/153 2023-03-08T15:48:32.898 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2861.ga2b8f27f.el 20/153 2023-03-08T15:48:32.898 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-ceph-common-2:18.0.0-2861.ga2b8f27f.el8. 21/153 2023-03-08T15:48:32.898 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cephfs-2:18.0.0-2861.ga2b8f27f.el8.x86_6 22/153 2023-03-08T15:48:32.898 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-rados-2:18.0.0-2861.ga2b8f27f.el8.x86_64 23/153 2023-03-08T15:48:32.898 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-rbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 24/153 2023-03-08T15:48:32.898 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-rgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 25/153 2023-03-08T15:48:32.898 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : rbd-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 26/153 2023-03-08T15:48:32.899 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : rbd-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 27/153 2023-03-08T15:48:32.899 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : rbd-nbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 28/153 2023-03-08T15:48:32.899 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2861.ga2b8f27f. 29/153 2023-03-08T15:48:32.899 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2861.ga2b8f27f.el8.noa 30/153 2023-03-08T15:48:32.899 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2861.ga2b8f27f.el8.n 31/153 2023-03-08T15:48:32.899 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2861.ga2b 32/153 2023-03-08T15:48:32.899 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2861.ga2b8f27f.el 33/153 2023-03-08T15:48:32.899 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2861.ga2b8f27f.el8.noarch 34/153 2023-03-08T15:48:32.900 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2861.ga2b8f27f.e 35/153 2023-03-08T15:48:32.900 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ceph-volume-2:18.0.0-2861.ga2b8f27f.el8.noarch 36/153 2023-03-08T15:48:32.900 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : cephadm-2:18.0.0-2861.ga2b8f27f.el8.noarch 37/153 2023-03-08T15:48:32.900 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : cephfs-top-2:18.0.0-2861.ga2b8f27f.el8.noarch 38/153 2023-03-08T15:48:32.900 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/153 2023-03-08T15:48:32.900 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/153 2023-03-08T15:48:32.900 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/153 2023-03-08T15:48:32.901 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : jq-1.6-6.el8.x86_64 42/153 2023-03-08T15:48:32.901 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/153 2023-03-08T15:48:32.901 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/153 2023-03-08T15:48:32.901 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/153 2023-03-08T15:48:32.901 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/153 2023-03-08T15:48:32.901 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/153 2023-03-08T15:48:32.901 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/153 2023-03-08T15:48:32.901 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/153 2023-03-08T15:48:32.902 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : postgresql-10.19-1.module_el8.6.0+1047+4202cf9a. 50/153 2023-03-08T15:48:32.902 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : postgresql-contrib-10.19-1.module_el8.6.0+1047+4 51/153 2023-03-08T15:48:32.902 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : postgresql-server-10.19-1.module_el8.6.0+1047+42 52/153 2023-03-08T15:48:32.902 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/153 2023-03-08T15:48:32.902 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/153 2023-03-08T15:48:32.902 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/153 2023-03-08T15:48:32.902 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/153 2023-03-08T15:48:32.902 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/153 2023-03-08T15:48:32.903 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/153 2023-03-08T15:48:32.903 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/153 2023-03-08T15:48:32.903 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/153 2023-03-08T15:48:32.903 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/153 2023-03-08T15:48:32.903 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/153 2023-03-08T15:48:32.903 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/153 2023-03-08T15:48:32.903 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/153 2023-03-08T15:48:32.904 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/153 2023-03-08T15:48:32.904 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/153 2023-03-08T15:48:32.904 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/153 2023-03-08T15:48:32.904 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/153 2023-03-08T15:48:32.904 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/153 2023-03-08T15:48:32.904 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/153 2023-03-08T15:48:32.904 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : elfutils-libelf-devel-0.188-3.el8.x86_64 71/153 2023-03-08T15:48:32.904 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 72/153 2023-03-08T15:48:32.905 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/153 2023-03-08T15:48:32.905 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/153 2023-03-08T15:48:32.905 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/153 2023-03-08T15:48:32.905 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/153 2023-03-08T15:48:32.905 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libgfortran-8.5.0-18.el8.x86_64 77/153 2023-03-08T15:48:32.905 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libquadmath-8.5.0-18.el8.x86_64 78/153 2023-03-08T15:48:32.905 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/153 2023-03-08T15:48:32.905 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libselinux-devel-2.9-6.el8.x86_64 80/153 2023-03-08T15:48:32.906 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/153 2023-03-08T15:48:32.906 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libuuid-devel-2.32.1-40.el8.x86_64 82/153 2023-03-08T15:48:32.906 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/153 2023-03-08T15:48:32.906 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8.x86_64 84/153 2023-03-08T15:48:32.906 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 85/153 2023-03-08T15:48:32.906 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 86/153 2023-03-08T15:48:32.906 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 87/153 2023-03-08T15:48:32.906 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 88/153 2023-03-08T15:48:32.907 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 89/153 2023-03-08T15:48:32.907 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 90/153 2023-03-08T15:48:32.907 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 91/153 2023-03-08T15:48:32.907 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 92/153 2023-03-08T15:48:32.907 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 93/153 2023-03-08T15:48:32.907 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 94/153 2023-03-08T15:48:32.907 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : zlib-devel-1.2.11-19.el8.x86_64 95/153 2023-03-08T15:48:32.908 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 96/153 2023-03-08T15:48:32.908 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 97/153 2023-03-08T15:48:32.908 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 98/153 2023-03-08T15:48:32.908 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 99/153 2023-03-08T15:48:32.908 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 100/153 2023-03-08T15:48:32.908 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 101/153 2023-03-08T15:48:32.908 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 102/153 2023-03-08T15:48:32.908 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 103/153 2023-03-08T15:48:32.909 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 104/153 2023-03-08T15:48:32.909 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 105/153 2023-03-08T15:48:32.909 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 106/153 2023-03-08T15:48:32.909 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 107/153 2023-03-08T15:48:32.909 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 108/153 2023-03-08T15:48:32.909 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 109/153 2023-03-08T15:48:32.909 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 110/153 2023-03-08T15:48:32.910 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 111/153 2023-03-08T15:48:32.910 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 112/153 2023-03-08T15:48:32.910 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 113/153 2023-03-08T15:48:32.910 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-portend-2.6-1.el8.noarch 114/153 2023-03-08T15:48:32.910 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 115/153 2023-03-08T15:48:32.910 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 116/153 2023-03-08T15:48:32.910 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 117/153 2023-03-08T15:48:32.910 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 118/153 2023-03-08T15:48:32.911 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 119/153 2023-03-08T15:48:32.911 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 120/153 2023-03-08T15:48:32.911 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 121/153 2023-03-08T15:48:32.911 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 122/153 2023-03-08T15:48:32.911 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 123/153 2023-03-08T15:48:32.911 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 124/153 2023-03-08T15:48:32.911 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 125/153 2023-03-08T15:48:32.911 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 126/153 2023-03-08T15:48:32.912 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 127/153 2023-03-08T15:48:32.912 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librados2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 128/153 2023-03-08T15:48:32.912 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/153 2023-03-08T15:48:32.912 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librbd1-2:18.0.0-2861.ga2b8f27f.el8.x86_64 130/153 2023-03-08T15:48:32.912 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/153 2023-03-08T15:48:32.912 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.12-1.el 132/153 2023-03-08T15:48:32.912 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : NetworkManager-initscripts-updown-1:1.39.12-1.el 133/153 2023-03-08T15:48:32.912 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : elfutils-debuginfod-client-0.188-3.el8.x86_64 134/153 2023-03-08T15:48:32.913 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : elfutils-debuginfod-client-0.187-4.el8.x86_64 135/153 2023-03-08T15:48:32.913 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : elfutils-libelf-0.188-3.el8.x86_64 136/153 2023-03-08T15:48:32.913 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : elfutils-libelf-0.187-4.el8.x86_64 137/153 2023-03-08T15:48:32.913 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : elfutils-libs-0.188-3.el8.x86_64 138/153 2023-03-08T15:48:32.913 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : elfutils-libs-0.187-4.el8.x86_64 139/153 2023-03-08T15:48:32.913 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libblkid-2.32.1-40.el8.x86_64 140/153 2023-03-08T15:48:32.913 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libblkid-2.32.1-38.el8.x86_64 141/153 2023-03-08T15:48:32.913 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libfdisk-2.32.1-40.el8.x86_64 142/153 2023-03-08T15:48:32.914 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libfdisk-2.32.1-38.el8.x86_64 143/153 2023-03-08T15:48:32.914 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libmount-2.32.1-40.el8.x86_64 144/153 2023-03-08T15:48:32.914 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libmount-2.32.1-38.el8.x86_64 145/153 2023-03-08T15:48:32.914 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libsmartcols-2.32.1-40.el8.x86_64 146/153 2023-03-08T15:48:32.914 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libsmartcols-2.32.1-38.el8.x86_64 147/153 2023-03-08T15:48:32.914 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libuuid-2.32.1-40.el8.x86_64 148/153 2023-03-08T15:48:32.914 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libuuid-2.32.1-38.el8.x86_64 149/153 2023-03-08T15:48:32.915 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : util-linux-2.32.1-40.el8.x86_64 150/153 2023-03-08T15:48:32.915 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : util-linux-2.32.1-38.el8.x86_64 151/153 2023-03-08T15:48:32.915 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : util-linux-user-2.32.1-40.el8.x86_64 152/153 2023-03-08T15:48:34.985 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : util-linux-user-2.32.1-38.el8.x86_64 153/153 2023-03-08T15:48:34.986 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:34.986 INFO:teuthology.orchestra.run.smithi182.stdout:Upgraded: 2023-03-08T15:48:34.987 INFO:teuthology.orchestra.run.smithi182.stdout: NetworkManager-initscripts-updown-1:1.40.12-1.el8.noarch 2023-03-08T15:48:34.987 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-debuginfod-client-0.188-3.el8.x86_64 2023-03-08T15:48:34.987 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-libelf-0.188-3.el8.x86_64 2023-03-08T15:48:34.987 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-libs-0.188-3.el8.x86_64 2023-03-08T15:48:34.988 INFO:teuthology.orchestra.run.smithi182.stdout: libblkid-2.32.1-40.el8.x86_64 2023-03-08T15:48:34.988 INFO:teuthology.orchestra.run.smithi182.stdout: libfdisk-2.32.1-40.el8.x86_64 2023-03-08T15:48:34.988 INFO:teuthology.orchestra.run.smithi182.stdout: libmount-2.32.1-40.el8.x86_64 2023-03-08T15:48:34.989 INFO:teuthology.orchestra.run.smithi182.stdout: librados2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:34.989 INFO:teuthology.orchestra.run.smithi182.stdout: librbd1-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:34.989 INFO:teuthology.orchestra.run.smithi182.stdout: libsmartcols-2.32.1-40.el8.x86_64 2023-03-08T15:48:34.989 INFO:teuthology.orchestra.run.smithi182.stdout: libuuid-2.32.1-40.el8.x86_64 2023-03-08T15:48:34.990 INFO:teuthology.orchestra.run.smithi182.stdout: util-linux-2.32.1-40.el8.x86_64 2023-03-08T15:48:34.990 INFO:teuthology.orchestra.run.smithi182.stdout: util-linux-user-2.32.1-40.el8.x86_64 2023-03-08T15:48:34.990 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2023-03-08T15:48:34.991 INFO:teuthology.orchestra.run.smithi182.stdout: automake-1.16.1-7.el8.noarch 2023-03-08T15:48:34.991 INFO:teuthology.orchestra.run.smithi182.stdout: bison-3.0.4-10.el8.x86_64 2023-03-08T15:48:34.991 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:34.991 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-base-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:34.992 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:34.992 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:34.992 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-grafana-dashboards-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:34.993 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-immutable-object-cache-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:34.993 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mds-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:34.993 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:34.993 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-cephadm-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:34.994 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-dashboard-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:34.994 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:34.994 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-modules-core-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:34.995 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-rook-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:34.995 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mon-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:34.995 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-osd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:34.995 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-prometheus-alerts-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:34.996 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-radosgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:34.996 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-selinux-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:34.996 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-test-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:34.996 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-volume-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:34.997 INFO:teuthology.orchestra.run.smithi182.stdout: cephadm-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:34.997 INFO:teuthology.orchestra.run.smithi182.stdout: cephfs-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:34.997 INFO:teuthology.orchestra.run.smithi182.stdout: cephfs-top-2:18.0.0-2861.ga2b8f27f.el8.noarch 2023-03-08T15:48:34.997 INFO:teuthology.orchestra.run.smithi182.stdout: elfutils-libelf-devel-0.188-3.el8.x86_64 2023-03-08T15:48:34.998 INFO:teuthology.orchestra.run.smithi182.stdout: flex-2.6.1-9.el8.x86_64 2023-03-08T15:48:34.998 INFO:teuthology.orchestra.run.smithi182.stdout: fuse-2.9.7-16.el8.x86_64 2023-03-08T15:48:34.998 INFO:teuthology.orchestra.run.smithi182.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-08T15:48:34.999 INFO:teuthology.orchestra.run.smithi182.stdout: jq-1.6-6.el8.x86_64 2023-03-08T15:48:34.999 INFO:teuthology.orchestra.run.smithi182.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-08T15:48:34.999 INFO:teuthology.orchestra.run.smithi182.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-03-08T15:48:34.999 INFO:teuthology.orchestra.run.smithi182.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-08T15:48:35.000 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:35.000 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:35.000 INFO:teuthology.orchestra.run.smithi182.stdout: libcephsqlite-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:35.000 INFO:teuthology.orchestra.run.smithi182.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-03-08T15:48:35.001 INFO:teuthology.orchestra.run.smithi182.stdout: libgfortran-8.5.0-18.el8.x86_64 2023-03-08T15:48:35.001 INFO:teuthology.orchestra.run.smithi182.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-08T15:48:35.001 INFO:teuthology.orchestra.run.smithi182.stdout: libpq-13.5-1.el8.x86_64 2023-03-08T15:48:35.001 INFO:teuthology.orchestra.run.smithi182.stdout: libquadmath-8.5.0-18.el8.x86_64 2023-03-08T15:48:35.002 INFO:teuthology.orchestra.run.smithi182.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-08T15:48:35.002 INFO:teuthology.orchestra.run.smithi182.stdout: librados-devel-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:35.002 INFO:teuthology.orchestra.run.smithi182.stdout: libradosstriper1-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:35.002 INFO:teuthology.orchestra.run.smithi182.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-08T15:48:35.003 INFO:teuthology.orchestra.run.smithi182.stdout: librgw2-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:35.003 INFO:teuthology.orchestra.run.smithi182.stdout: libselinux-devel-2.9-6.el8.x86_64 2023-03-08T15:48:35.003 INFO:teuthology.orchestra.run.smithi182.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-08T15:48:35.004 INFO:teuthology.orchestra.run.smithi182.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-08T15:48:35.004 INFO:teuthology.orchestra.run.smithi182.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-08T15:48:35.004 INFO:teuthology.orchestra.run.smithi182.stdout: libuuid-devel-2.32.1-40.el8.x86_64 2023-03-08T15:48:35.004 INFO:teuthology.orchestra.run.smithi182.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-03-08T15:48:35.005 INFO:teuthology.orchestra.run.smithi182.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-08T15:48:35.005 INFO:teuthology.orchestra.run.smithi182.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-08T15:48:35.005 INFO:teuthology.orchestra.run.smithi182.stdout: openblas-0.3.15-4.el8.x86_64 2023-03-08T15:48:35.005 INFO:teuthology.orchestra.run.smithi182.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-03-08T15:48:35.006 INFO:teuthology.orchestra.run.smithi182.stdout: openssl-devel-1:1.1.1k-7.el8.x86_64 2023-03-08T15:48:35.006 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-03-08T15:48:35.006 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-03-08T15:48:35.006 INFO:teuthology.orchestra.run.smithi182.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-03-08T15:48:35.007 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2023-03-08T15:48:35.007 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql-contrib-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2023-03-08T15:48:35.007 INFO:teuthology.orchestra.run.smithi182.stdout: postgresql-server-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2023-03-08T15:48:35.007 INFO:teuthology.orchestra.run.smithi182.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-08T15:48:35.008 INFO:teuthology.orchestra.run.smithi182.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-08T15:48:35.008 INFO:teuthology.orchestra.run.smithi182.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-08T15:48:35.008 INFO:teuthology.orchestra.run.smithi182.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-08T15:48:35.009 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-08T15:48:35.009 INFO:teuthology.orchestra.run.smithi182.stdout: python3-ceph-argparse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:35.009 INFO:teuthology.orchestra.run.smithi182.stdout: python3-ceph-common-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:35.009 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cephfs-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:35.010 INFO:teuthology.orchestra.run.smithi182.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-08T15:48:35.010 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-08T15:48:35.010 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-08T15:48:35.010 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-08T15:48:35.011 INFO:teuthology.orchestra.run.smithi182.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-08T15:48:35.011 INFO:teuthology.orchestra.run.smithi182.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-08T15:48:35.011 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-08T15:48:35.011 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-08T15:48:35.012 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-08T15:48:35.012 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-08T15:48:35.012 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-08T15:48:35.012 INFO:teuthology.orchestra.run.smithi182.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-08T15:48:35.013 INFO:teuthology.orchestra.run.smithi182.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-08T15:48:35.013 INFO:teuthology.orchestra.run.smithi182.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-08T15:48:35.013 INFO:teuthology.orchestra.run.smithi182.stdout: python3-mako-1.0.6-14.el8.noarch 2023-03-08T15:48:35.014 INFO:teuthology.orchestra.run.smithi182.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-08T15:48:35.014 INFO:teuthology.orchestra.run.smithi182.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-08T15:48:35.014 INFO:teuthology.orchestra.run.smithi182.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-08T15:48:35.014 INFO:teuthology.orchestra.run.smithi182.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-08T15:48:35.015 INFO:teuthology.orchestra.run.smithi182.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-08T15:48:35.015 INFO:teuthology.orchestra.run.smithi182.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-08T15:48:35.015 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-08T15:48:35.015 INFO:teuthology.orchestra.run.smithi182.stdout: python3-portend-2.6-1.el8.noarch 2023-03-08T15:48:35.016 INFO:teuthology.orchestra.run.smithi182.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-08T15:48:35.016 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-08T15:48:35.016 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-08T15:48:35.016 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-08T15:48:35.017 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-08T15:48:35.017 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-08T15:48:35.017 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rados-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:35.018 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:35.018 INFO:teuthology.orchestra.run.smithi182.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-08T15:48:35.018 INFO:teuthology.orchestra.run.smithi182.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-08T15:48:35.018 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rgw-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:35.019 INFO:teuthology.orchestra.run.smithi182.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-08T15:48:35.019 INFO:teuthology.orchestra.run.smithi182.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-08T15:48:35.019 INFO:teuthology.orchestra.run.smithi182.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-03-08T15:48:35.019 INFO:teuthology.orchestra.run.smithi182.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-08T15:48:35.020 INFO:teuthology.orchestra.run.smithi182.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-08T15:48:35.020 INFO:teuthology.orchestra.run.smithi182.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-08T15:48:35.020 INFO:teuthology.orchestra.run.smithi182.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-08T15:48:35.020 INFO:teuthology.orchestra.run.smithi182.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-08T15:48:35.021 INFO:teuthology.orchestra.run.smithi182.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-08T15:48:35.021 INFO:teuthology.orchestra.run.smithi182.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-08T15:48:35.021 INFO:teuthology.orchestra.run.smithi182.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-08T15:48:35.022 INFO:teuthology.orchestra.run.smithi182.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-08T15:48:35.022 INFO:teuthology.orchestra.run.smithi182.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-08T15:48:35.022 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-fuse-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:35.022 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-mirror-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:35.023 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-nbd-2:18.0.0-2861.ga2b8f27f.el8.x86_64 2023-03-08T15:48:35.023 INFO:teuthology.orchestra.run.smithi182.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-08T15:48:35.023 INFO:teuthology.orchestra.run.smithi182.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-08T15:48:35.023 INFO:teuthology.orchestra.run.smithi182.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-08T15:48:35.024 INFO:teuthology.orchestra.run.smithi182.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-08T15:48:35.024 INFO:teuthology.orchestra.run.smithi182.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-08T15:48:35.025 INFO:teuthology.orchestra.run.smithi182.stdout: zlib-devel-1.2.11-19.el8.x86_64 2023-03-08T15:48:35.025 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:35.025 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2023-03-08T15:48:35.354 DEBUG:teuthology.parallel:result is None 2023-03-08T15:48:35.355 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a2b8f27f8eef4b6c46c66813a64c178fb019988a 2023-03-08T15:48:35.497 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-08T15:48:35.527 INFO:teuthology.orchestra.run.smithi123.stdout:18.0.0-2861.ga2b8f27f.el8 2023-03-08T15:48:35.528 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2861.ga2b8f27f.el8 2023-03-08T15:48:35.528 INFO:teuthology.task.install:The correct ceph version 18.0.0-2861.ga2b8f27f is installed. 2023-03-08T15:48:35.529 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a2b8f27f8eef4b6c46c66813a64c178fb019988a 2023-03-08T15:48:35.665 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-08T15:48:35.690 INFO:teuthology.orchestra.run.smithi175.stdout:18.0.0-2861.ga2b8f27f.el8 2023-03-08T15:48:35.690 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2861.ga2b8f27f.el8 2023-03-08T15:48:35.691 INFO:teuthology.task.install:The correct ceph version 18.0.0-2861.ga2b8f27f is installed. 2023-03-08T15:48:35.691 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a2b8f27f8eef4b6c46c66813a64c178fb019988a 2023-03-08T15:48:35.825 DEBUG:teuthology.orchestra.run.smithi182:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-08T15:48:35.908 INFO:teuthology.orchestra.run.smithi182.stdout:18.0.0-2861.ga2b8f27f.el8 2023-03-08T15:48:35.909 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2861.ga2b8f27f.el8 2023-03-08T15:48:35.910 INFO:teuthology.task.install:The correct ceph version 18.0.0-2861.ga2b8f27f is installed. 2023-03-08T15:48:35.910 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-03-08T15:48:35.911 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:48:35.911 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-08T15:48:35.946 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:48:35.947 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-08T15:48:35.978 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:48:35.979 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-08T15:48:36.093 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-03-08T15:48:36.093 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:48:36.094 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2023-03-08T15:48:36.123 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-08T15:48:36.191 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:48:36.192 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2023-03-08T15:48:36.220 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-08T15:48:36.287 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:48:36.288 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/usr/bin/daemon-helper 2023-03-08T15:48:36.389 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-08T15:48:36.492 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-03-08T15:48:36.492 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:48:36.493 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-08T15:48:36.521 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-08T15:48:36.590 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:48:36.590 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-08T15:48:36.618 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-08T15:48:36.686 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:48:36.687 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-08T15:48:36.789 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-08T15:48:36.932 INFO:teuthology.run_tasks:Running task ceph... 2023-03-08T15:48:36.999 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-03-08T15:48:37.000 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /var/log/ceph 2023-03-08T15:48:37.002 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2023-03-08T15:48:37.004 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod 777 /var/log/ceph 2023-03-08T15:48:37.106 INFO:tasks.ceph:Disabling ceph logrotate... 2023-03-08T15:48:37.107 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/logrotate.d/ceph 2023-03-08T15:48:37.109 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2023-03-08T15:48:37.111 DEBUG:teuthology.orchestra.run.smithi182:> sudo rm -f -- /etc/logrotate.d/ceph 2023-03-08T15:48:37.217 INFO:tasks.ceph:Creating extra log directories... 2023-03-08T15:48:37.218 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-03-08T15:48:37.220 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-03-08T15:48:37.222 DEBUG:teuthology.orchestra.run.smithi182:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-03-08T15:48:37.333 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-03-08T15:48:37.333 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-03-08T15:48:37.334 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-03-08T15:48:37.334 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:48:37.334 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-03-08T15:48:37.353 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-03-08T15:48:37.469 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-03-08T15:48:37.497 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:48:37.497 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-03-08T15:48:37.518 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-03-08T15:48:37.639 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-03-08T15:48:37.668 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:48:37.669 DEBUG:teuthology.orchestra.run.smithi182:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-03-08T15:48:37.742 DEBUG:teuthology.orchestra.run.smithi182:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-03-08T15:48:38.009 DEBUG:teuthology.orchestra.run.smithi182:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-03-08T15:48:38.117 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-03-08T15:48:38.117 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-03-08T15:48:38.118 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-03-08_15:12:36-fs-wip-vshankar-testing-20230308.112059-testing-default-smithi/7197048', 'branch': 'wip-vshankar-testing-20230308.112059', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7197048', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-03-08_15:12:36-fs-wip-vshankar-testing-20230308.112059-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230308.112059'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a2b8f27f8eef4b6c46c66813a64c178fb019988a'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2b8f27f8eef4b6c46c66813a64c178fb019988a'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230308.112059', 'sha1': 'a2b8f27f8eef4b6c46c66813a64c178fb019988a'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'sha1': 'a2b8f27f8eef4b6c46c66813a64c178fb019988a', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230308.112059', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a2b8f27f8eef4b6c46c66813a64c178fb019988a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a2b8f27f8eef4b6c46c66813a64c178fb019988a', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi123.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCRgFZlAspQVUpR3W3EeiMRNhVKmkhrJEgl8dIzt2ImDxHQcwXHOSXN61/e7Zmfr0UC5I6lyRV0V1XT3r/C5PxVeOyqLeqU2VlTZB2CitPlk0kOUfrYoR8YGbOjwhY5Xz0H02+1DKygdwQ88tl0sDGz2fVveBOw/8vairNBVFRdvQFJ2CyO1dZHEI15bJLuMX3u9ol1hpIybFoie0tqgShQH5JZOeeEqakCqpJISNV1E6Hen7ZTcoawEjberlQm7cNbrdZrJsuSNLasOF7BNUJGnMuS2MqkTl6gscWDifINPQxzMaBbkWbIUBeqyrYVU3JqlQA+WRwyDXIUsdz3GbJIGoh60fvj053J5cx5stlo4m8f4b/WcopOAVg37oQINq85vp+o4/8w/cYFQdoLNg5fANkMFROl6nPN3NuvyxCFWUOXW1E4mQ2/TDBxNqdCJDA1KkybBjRMPzZImxnntXzgVd6pi11+0Iyh40ERIKx4VB7EOKePTOks3Wg/vqOJadk=', 'smithi175.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDyuYbLgv62G0J/d1BABWUaa+iKT6UFDexa1sjbn4BYC1qMqpwJqMPfmKnne5XcuwU3LNIPQkzA74CUJd9fdY4qhEFAxD1qKijh5dO9HDpGCWhGrZUzLDFMau13QL8H4SjxwurHPU91sVa7nC/uCR96IqPCkwfQ6fJ17+7CHETkKippRjDcYxsHdw9Puo75icqweE9OJ3hRorgO5rSW+U/sOYcKcYuuKwwWoQgnn5gWDYQTMIn0rsOVLA9DVjMrIwgJDQIZK+OaZnTASfIwxrVGSuSqHrq2oZF0VEUkjB4DAFTJtso/Gad8enZ6Fp5gSbmd914RJ83MOGph0yF8ZXo1FcnePKRMsfq18ETs/+ArQ5hKMzG9amWO0liapdwYLfq81j1QTWZhef2fBNsKfmxQUiDg18nr2UfpaM82tsrfzfl8MITYocDxKU58guKhQCoJ5hzbTVizoX6MDMJs93wDgdjbAR4GRMePR6OSb0iOoEGtXC2B19fMElaQV9fCY0=', 'smithi182.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPYhen9IMstjvYAdoHxygvnnwgxU/+L+pQPb3t8S2yyKTXSjDa2i57XVJdwDzTrm24E5gvjsorT96T0csg4Rmg0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a2b8f27f8eef4b6c46c66813a64c178fb019988a'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'a2dfb0599b24ec4a1585108a2792a4567ce0a378', 'timestamp': '2023-03-08_15:12:36', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.19450'} 2023-03-08T15:48:38.118 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-03-08T15:48:38.121 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-03-08T15:48:38.123 DEBUG:teuthology.orchestra.run.smithi182:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-03-08T15:48:38.191 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/run/ceph 2023-03-08T15:48:38.193 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2023-03-08T15:48:38.195 DEBUG:teuthology.orchestra.run.smithi182:> sudo install -d -m0777 -- /var/run/ceph 2023-03-08T15:48:38.298 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:48:38.299 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2023-03-08T15:48:38.317 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-08T15:48:38.317 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2023-03-08T15:48:38.374 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-08T15:48:38.374 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-08T15:48:38.375 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 407517 Links: 1 2023-03-08T15:48:38.375 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-08T15:48:38.375 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-03-08T15:48:38.375 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-03-08 15:48:15.197844790 +0000 2023-03-08T15:48:38.375 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-03-08 15:40:46.416103977 +0000 2023-03-08T15:48:38.375 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-03-08 15:40:46.416103977 +0000 2023-03-08T15:48:38.376 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-03-08T15:48:38.376 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-08T15:48:38.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-03-08T15:48:38.440 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-03-08T15:48:38.440 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000265816 s, 1.9 MB/s 2023-03-08T15:48:38.441 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-08T15:48:38.499 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2023-03-08T15:48:38.556 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-08T15:48:38.632 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-08T15:48:38.632 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 412554 Links: 1 2023-03-08T15:48:38.632 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-08T15:48:38.633 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-03-08T15:48:38.633 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-03-08 15:48:15.197844790 +0000 2023-03-08T15:48:38.633 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-03-08 15:40:47.114087474 +0000 2023-03-08T15:48:38.633 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-03-08 15:40:47.114087474 +0000 2023-03-08T15:48:38.633 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-03-08T15:48:38.634 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-08T15:48:38.659 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-03-08T15:48:38.659 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-03-08T15:48:38.659 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000193195 s, 2.7 MB/s 2023-03-08T15:48:38.660 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-08T15:48:38.718 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2023-03-08T15:48:38.775 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-08T15:48:38.775 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-08T15:48:38.775 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 415926 Links: 1 2023-03-08T15:48:38.775 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-08T15:48:38.775 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-03-08T15:48:38.776 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-03-08 15:48:15.197844790 +0000 2023-03-08T15:48:38.776 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-03-08 15:40:47.633075203 +0000 2023-03-08T15:48:38.776 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-03-08 15:40:47.633075203 +0000 2023-03-08T15:48:38.776 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-03-08T15:48:38.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-08T15:48:38.840 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-03-08T15:48:38.840 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-03-08T15:48:38.840 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000230731 s, 2.2 MB/s 2023-03-08T15:48:38.841 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-08T15:48:38.899 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2023-03-08T15:48:38.956 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-08T15:48:38.956 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-08T15:48:38.956 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 421332 Links: 1 2023-03-08T15:48:38.956 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-08T15:48:38.957 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-03-08T15:48:38.957 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-03-08 15:48:15.197844790 +0000 2023-03-08T15:48:38.957 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-03-08 15:40:48.154062885 +0000 2023-03-08T15:48:38.957 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-03-08 15:40:48.154062885 +0000 2023-03-08T15:48:38.957 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-03-08T15:48:38.957 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-08T15:48:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-03-08T15:48:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-03-08T15:48:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000171083 s, 3.0 MB/s 2023-03-08T15:48:39.022 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-08T15:48:39.080 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-08T15:48:39.081 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:48:39.081 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2023-03-08T15:48:39.101 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-08T15:48:39.101 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2023-03-08T15:48:39.160 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-08T15:48:39.161 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-08T15:48:39.161 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 394261 Links: 1 2023-03-08T15:48:39.161 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-08T15:48:39.161 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-03-08T15:48:39.161 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-03-08 15:48:11.491322953 +0000 2023-03-08T15:48:39.161 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-03-08 15:40:46.423736777 +0000 2023-03-08T15:48:39.161 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-03-08 15:40:46.423736777 +0000 2023-03-08T15:48:39.162 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-03-08T15:48:39.162 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-08T15:48:39.228 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-03-08T15:48:39.228 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-03-08T15:48:39.228 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000222948 s, 2.3 MB/s 2023-03-08T15:48:39.229 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-08T15:48:39.289 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2023-03-08T15:48:39.347 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-08T15:48:39.348 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-08T15:48:39.348 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 394338 Links: 1 2023-03-08T15:48:39.348 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-08T15:48:39.348 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-03-08T15:48:39.348 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-03-08 15:48:11.492322937 +0000 2023-03-08T15:48:39.348 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-03-08 15:40:46.937728599 +0000 2023-03-08T15:48:39.348 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-03-08 15:40:46.937728599 +0000 2023-03-08T15:48:39.349 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-03-08T15:48:39.349 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-08T15:48:39.414 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-03-08T15:48:39.414 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-03-08T15:48:39.414 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000199787 s, 2.6 MB/s 2023-03-08T15:48:39.415 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-08T15:48:39.474 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2023-03-08T15:48:39.532 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-08T15:48:39.533 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-08T15:48:39.533 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 389640 Links: 1 2023-03-08T15:48:39.533 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-08T15:48:39.533 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-03-08T15:48:39.533 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-03-08 15:48:11.492322937 +0000 2023-03-08T15:48:39.534 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-03-08 15:40:47.464720215 +0000 2023-03-08T15:48:39.534 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-03-08 15:40:47.464720215 +0000 2023-03-08T15:48:39.534 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-03-08T15:48:39.534 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-08T15:48:39.600 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-03-08T15:48:39.600 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-03-08T15:48:39.600 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000219282 s, 2.3 MB/s 2023-03-08T15:48:39.601 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-08T15:48:39.660 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2023-03-08T15:48:39.717 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-08T15:48:39.718 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-08T15:48:39.718 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 393547 Links: 1 2023-03-08T15:48:39.718 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-08T15:48:39.718 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-03-08T15:48:39.718 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-03-08 15:48:11.492322937 +0000 2023-03-08T15:48:39.718 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-03-08 15:40:47.975712084 +0000 2023-03-08T15:48:39.719 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-03-08 15:40:47.975712084 +0000 2023-03-08T15:48:39.719 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-03-08T15:48:39.719 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-08T15:48:39.782 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-03-08T15:48:39.782 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-03-08T15:48:39.782 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000202469 s, 2.5 MB/s 2023-03-08T15:48:39.783 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-08T15:48:39.841 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-08T15:48:39.841 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-03-08T15:48:39.842 INFO:tasks.ceph:Generating config... 2023-03-08T15:48:39.843 INFO:tasks.ceph:[client] client mount timeout = 600 2023-03-08T15:48:39.843 INFO:tasks.ceph:[client] debug client = 20 2023-03-08T15:48:39.843 INFO:tasks.ceph:[client] debug ms = 1 2023-03-08T15:48:39.843 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-03-08T15:48:39.844 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-03-08T15:48:39.844 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-03-08T15:48:39.844 INFO:tasks.ceph:[mds] debug mds = 20 2023-03-08T15:48:39.844 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-03-08T15:48:39.844 INFO:tasks.ceph:[mds] debug ms = 1 2023-03-08T15:48:39.845 INFO:tasks.ceph:[mds] mds debug frag = True 2023-03-08T15:48:39.845 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-03-08T15:48:39.845 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-03-08T15:48:39.845 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-03-08T15:48:39.845 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-03-08T15:48:39.846 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-03-08T15:48:39.846 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-03-08T15:48:39.846 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-03-08T15:48:39.846 INFO:tasks.ceph:[mgr] debug ms = 1 2023-03-08T15:48:39.846 INFO:tasks.ceph:[mon] debug mon = 20 2023-03-08T15:48:39.847 INFO:tasks.ceph:[mon] debug ms = 1 2023-03-08T15:48:39.847 INFO:tasks.ceph:[mon] debug paxos = 20 2023-03-08T15:48:39.847 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-03-08T15:48:39.847 INFO:tasks.ceph:[osd] bdev async discard = True 2023-03-08T15:48:39.847 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-03-08T15:48:39.848 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-03-08T15:48:39.848 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-03-08T15:48:39.848 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-03-08T15:48:39.848 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-03-08T15:48:39.848 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-03-08T15:48:39.848 INFO:tasks.ceph:[osd] debug ms = 1 2023-03-08T15:48:39.849 INFO:tasks.ceph:[osd] debug osd = 20 2023-03-08T15:48:39.849 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-03-08T15:48:39.849 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-03-08T15:48:39.849 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-03-08T15:48:39.849 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-03-08T15:48:39.850 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-03-08T15:48:39.850 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-03-08T15:48:39.850 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-03-08T15:48:39.850 INFO:tasks.ceph:Setting up mon.a... 2023-03-08T15:48:39.851 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-03-08T15:48:39.901 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.keyring 2023-03-08T15:48:39.904 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-03-08T15:48:39.948 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-08T15:48:40.015 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.123'), ('mon.b', '172.21.15.175'), ('mon.c', '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]')] 2023-03-08T15:48:40.016 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.123,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]', 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-03-08T15:48:40.017 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:48:40.017 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-03-08T15:48:40.072 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.123 --add b 172.21.15.175 --addv c '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-03-08T15:48:40.160 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-03-08T15:48:40.160 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: generated fsid 1b15c317-0b05-4434-b72b-9beacb9cbd31 2023-03-08T15:48:40.161 INFO:teuthology.orchestra.run.smithi123.stdout:setting min_mon_release = pacific 2023-03-08T15:48:40.161 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 0 2023-03-08T15:48:40.161 INFO:teuthology.orchestra.run.smithi123.stdout:fsid 1b15c317-0b05-4434-b72b-9beacb9cbd31 2023-03-08T15:48:40.161 INFO:teuthology.orchestra.run.smithi123.stdout:last_changed 2023-03-08T15:48:40.160332+0000 2023-03-08T15:48:40.161 INFO:teuthology.orchestra.run.smithi123.stdout:created 2023-03-08T15:48:40.160332+0000 2023-03-08T15:48:40.161 INFO:teuthology.orchestra.run.smithi123.stdout:min_mon_release 16 (pacific) 2023-03-08T15:48:40.161 INFO:teuthology.orchestra.run.smithi123.stdout:election_strategy: 1 2023-03-08T15:48:40.162 INFO:teuthology.orchestra.run.smithi123.stdout:0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2023-03-08T15:48:40.162 INFO:teuthology.orchestra.run.smithi123.stdout:1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.b 2023-03-08T15:48:40.162 INFO:teuthology.orchestra.run.smithi123.stdout:2: [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] mon.c 2023-03-08T15:48:40.162 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-03-08T15:48:40.163 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-03-08T15:48:40.180 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1b15c317-0b05-4434-b72b-9beacb9cbd31... 2023-03-08T15:48:40.181 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-03-08T15:48:40.222 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-03-08T15:48:40.224 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-03-08T15:48:40.264 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2023-03-08T15:48:40.264 INFO:teuthology.orchestra.run.smithi123.stdout: chdir = "" 2023-03-08T15:48:40.265 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-03-08T15:48:40.265 INFO:teuthology.orchestra.run.smithi123.stdout: auth supported = cephx 2023-03-08T15:48:40.265 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.265 INFO:teuthology.orchestra.run.smithi123.stdout: filestore xattr use omap = true 2023-03-08T15:48:40.265 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.265 INFO:teuthology.orchestra.run.smithi123.stdout: mon clock drift allowed = 1.000 2023-03-08T15:48:40.265 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.266 INFO:teuthology.orchestra.run.smithi123.stdout: osd crush chooseleaf type = 0 2023-03-08T15:48:40.266 INFO:teuthology.orchestra.run.smithi123.stdout: auth debug = true 2023-03-08T15:48:40.266 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.266 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on old message = true 2023-03-08T15:48:40.266 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on bug = true 2023-03-08T15:48:40.266 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.266 INFO:teuthology.orchestra.run.smithi123.stdout: mon max pg per osd = 10000 # >= luminous 2023-03-08T15:48:40.267 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn max object skew = 0 2023-03-08T15:48:40.267 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.267 INFO:teuthology.orchestra.run.smithi123.stdout: # disable pg_autoscaler by default for new pools 2023-03-08T15:48:40.267 INFO:teuthology.orchestra.run.smithi123.stdout: osd_pool_default_pg_autoscale_mode = off 2023-03-08T15:48:40.267 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.267 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default size = 2 2023-03-08T15:48:40.267 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.267 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow primary affinity = true 2023-03-08T15:48:40.268 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow pg remap = true 2023-03-08T15:48:40.268 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on legacy crush tunables = false 2023-03-08T15:48:40.268 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on crush straw calc version zero = false 2023-03-08T15:48:40.268 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on no sortbitwise = false 2023-03-08T15:48:40.268 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on osd down out interval zero = false 2023-03-08T15:48:40.268 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on too few osds = false 2023-03-08T15:48:40.268 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-03-08T15:48:40.268 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_no_redundancy = false 2023-03-08T15:48:40.269 INFO:teuthology.orchestra.run.smithi123.stdout: mon_allow_pool_size_one = true 2023-03-08T15:48:40.269 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.269 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-03-08T15:48:40.269 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.269 INFO:teuthology.orchestra.run.smithi123.stdout: osd default data pool replay window = 5 2023-03-08T15:48:40.269 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.269 INFO:teuthology.orchestra.run.smithi123.stdout: mon allow pool delete = true 2023-03-08T15:48:40.270 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.270 INFO:teuthology.orchestra.run.smithi123.stdout: mon cluster log file level = debug 2023-03-08T15:48:40.270 INFO:teuthology.orchestra.run.smithi123.stdout: debug asserts on shutdown = true 2023-03-08T15:48:40.270 INFO:teuthology.orchestra.run.smithi123.stdout: mon health detail to clog = false 2023-03-08T15:48:40.270 INFO:teuthology.orchestra.run.smithi123.stdout: mon host = "172.21.15.123,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2023-03-08T15:48:40.270 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn min per osd = 0 2023-03-08T15:48:40.270 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = 1b15c317-0b05-4434-b72b-9beacb9cbd31 2023-03-08T15:48:40.270 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.271 INFO:teuthology.orchestra.run.smithi123.stdout:[osd] 2023-03-08T15:48:40.271 INFO:teuthology.orchestra.run.smithi123.stdout: osd journal size = 100 2023-03-08T15:48:40.271 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.271 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub load threshold = 5.0 2023-03-08T15:48:40.271 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub max interval = 600 2023-03-08T15:48:40.271 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.271 INFO:teuthology.orchestra.run.smithi123.stdout: osd recover clone overlap = true 2023-03-08T15:48:40.271 INFO:teuthology.orchestra.run.smithi123.stdout: osd recovery max chunk = 1048576 2023-03-08T15:48:40.272 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.272 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug shutdown = true 2023-03-08T15:48:40.272 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug op order = true 2023-03-08T15:48:40.272 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug verify stray on activate = true 2023-03-08T15:48:40.272 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.272 INFO:teuthology.orchestra.run.smithi123.stdout: osd open classes on start = true 2023-03-08T15:48:40.272 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug pg log writeout = true 2023-03-08T15:48:40.273 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.273 INFO:teuthology.orchestra.run.smithi123.stdout: osd deep scrub update digest min age = 30 2023-03-08T15:48:40.273 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.273 INFO:teuthology.orchestra.run.smithi123.stdout: osd map max advance = 10 2023-03-08T15:48:40.273 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.273 INFO:teuthology.orchestra.run.smithi123.stdout: journal zero on create = true 2023-03-08T15:48:40.273 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.274 INFO:teuthology.orchestra.run.smithi123.stdout: filestore ondisk finisher threads = 3 2023-03-08T15:48:40.274 INFO:teuthology.orchestra.run.smithi123.stdout: filestore apply finisher threads = 3 2023-03-08T15:48:40.274 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.274 INFO:teuthology.orchestra.run.smithi123.stdout: bdev debug aio = true 2023-03-08T15:48:40.274 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug misdirected ops = true 2023-03-08T15:48:40.274 INFO:teuthology.orchestra.run.smithi123.stdout: bdev async discard = True 2023-03-08T15:48:40.274 INFO:teuthology.orchestra.run.smithi123.stdout: bdev enable discard = True 2023-03-08T15:48:40.274 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore allocator = bitmap 2023-03-08T15:48:40.275 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore block size = 96636764160 2023-03-08T15:48:40.275 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore fsck on mount = True 2023-03-08T15:48:40.275 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluefs = 1/20 2023-03-08T15:48:40.275 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluestore = 1/20 2023-03-08T15:48:40.275 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-03-08T15:48:40.275 INFO:teuthology.orchestra.run.smithi123.stdout: debug osd = 20 2023-03-08T15:48:40.275 INFO:teuthology.orchestra.run.smithi123.stdout: debug rocksdb = 4/10 2023-03-08T15:48:40.276 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd backfillfull_ratio = 0.85 2023-03-08T15:48:40.276 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd full ratio = 0.9 2023-03-08T15:48:40.276 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd nearfull ratio = 0.8 2023-03-08T15:48:40.276 INFO:teuthology.orchestra.run.smithi123.stdout: osd failsafe full ratio = 0.95 2023-03-08T15:48:40.276 INFO:teuthology.orchestra.run.smithi123.stdout: osd objectstore = bluestore 2023-03-08T15:48:40.276 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2023-03-08T15:48:40.276 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.276 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr] 2023-03-08T15:48:40.277 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-03-08T15:48:40.277 INFO:teuthology.orchestra.run.smithi123.stdout: debug mgr = 20 2023-03-08T15:48:40.277 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2023-03-08T15:48:40.277 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2023-03-08T15:48:40.277 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2023-03-08T15:48:40.277 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2023-03-08T15:48:40.277 INFO:teuthology.orchestra.run.smithi123.stdout: mgr/telemetry/nag = false 2023-03-08T15:48:40.277 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.278 INFO:teuthology.orchestra.run.smithi123.stdout:[mon] 2023-03-08T15:48:40.278 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-03-08T15:48:40.278 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2023-03-08T15:48:40.278 INFO:teuthology.orchestra.run.smithi123.stdout: debug paxos = 20 2023-03-08T15:48:40.278 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2023-03-08T15:48:40.278 INFO:teuthology.orchestra.run.smithi123.stdout: mon data avail warn = 5 2023-03-08T15:48:40.278 INFO:teuthology.orchestra.run.smithi123.stdout: mon mgr mkfs grace = 240 2023-03-08T15:48:40.278 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2023-03-08T15:48:40.279 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd reporter subtree level = osd 2023-03-08T15:48:40.279 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd prime pg temp = true 2023-03-08T15:48:40.279 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2023-03-08T15:48:40.279 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.279 INFO:teuthology.orchestra.run.smithi123.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-03-08T15:48:40.279 INFO:teuthology.orchestra.run.smithi123.stdout: auth mon ticket ttl = 660 # 11m 2023-03-08T15:48:40.279 INFO:teuthology.orchestra.run.smithi123.stdout: auth service ticket ttl = 240 # 4m 2023-03-08T15:48:40.280 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.280 INFO:teuthology.orchestra.run.smithi123.stdout: # don't complain about insecure global_id in the test suite 2023-03-08T15:48:40.280 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-03-08T15:48:40.280 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-03-08T15:48:40.280 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.280 INFO:teuthology.orchestra.run.smithi123.stdout: # 1m isn't quite enough 2023-03-08T15:48:40.280 INFO:teuthology.orchestra.run.smithi123.stdout: mon_down_mkfs_grace = 2m 2023-03-08T15:48:40.280 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.281 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_filestore_osds = false 2023-03-08T15:48:40.281 INFO:teuthology.orchestra.run.smithi123.stdout: mon op complaint time = 120 2023-03-08T15:48:40.281 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:48:40.281 INFO:teuthology.orchestra.run.smithi123.stdout:[client] 2023-03-08T15:48:40.281 INFO:teuthology.orchestra.run.smithi123.stdout: rgw cache enabled = true 2023-03-08T15:48:40.281 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable ops log = true 2023-03-08T15:48:40.281 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable usage log = true 2023-03-08T15:48:40.281 INFO:teuthology.orchestra.run.smithi123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-03-08T15:48:40.282 INFO:teuthology.orchestra.run.smithi123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-03-08T15:48:40.282 INFO:teuthology.orchestra.run.smithi123.stdout: client mount timeout = 600 2023-03-08T15:48:40.282 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2023-03-08T15:48:40.282 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-03-08T15:48:40.282 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2023-03-08T15:48:40.282 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2023-03-08T15:48:40.282 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.a] 2023-03-08T15:48:40.282 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.b] 2023-03-08T15:48:40.283 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.c] 2023-03-08T15:48:40.283 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2023-03-08T15:48:40.283 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2023-03-08T15:48:40.283 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2023-03-08T15:48:40.283 INFO:teuthology.orchestra.run.smithi123.stdout:[mds] 2023-03-08T15:48:40.283 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds = 20 2023-03-08T15:48:40.283 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds balancer = 20 2023-03-08T15:48:40.284 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-03-08T15:48:40.284 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug frag = True 2023-03-08T15:48:40.284 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug scatterstat = True 2023-03-08T15:48:40.284 INFO:teuthology.orchestra.run.smithi123.stdout: mds op complaint time = 180 2023-03-08T15:48:40.284 INFO:teuthology.orchestra.run.smithi123.stdout: mds verify scatter = True 2023-03-08T15:48:40.284 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2023-03-08T15:48:40.284 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2023-03-08T15:48:40.284 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2023-03-08T15:48:40.286 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2023-03-08T15:48:40.286 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2023-03-08T15:48:40.286 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-03-08T15:48:40.286 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2023-03-08T15:48:40.286 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.286 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2023-03-08T15:48:40.287 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.287 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2023-03-08T15:48:40.287 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.287 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2023-03-08T15:48:40.287 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2023-03-08T15:48:40.287 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.287 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2023-03-08T15:48:40.288 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2023-03-08T15:48:40.288 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.288 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2023-03-08T15:48:40.288 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2023-03-08T15:48:40.288 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.288 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2023-03-08T15:48:40.288 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2023-03-08T15:48:40.288 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.289 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2023-03-08T15:48:40.289 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.289 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2023-03-08T15:48:40.289 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2023-03-08T15:48:40.289 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2023-03-08T15:48:40.289 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2023-03-08T15:48:40.289 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2023-03-08T15:48:40.290 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2023-03-08T15:48:40.290 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2023-03-08T15:48:40.290 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-03-08T15:48:40.290 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2023-03-08T15:48:40.290 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2023-03-08T15:48:40.290 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.290 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-03-08T15:48:40.290 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.291 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2023-03-08T15:48:40.291 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.291 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2023-03-08T15:48:40.291 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.291 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2023-03-08T15:48:40.291 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2023-03-08T15:48:40.291 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2023-03-08T15:48:40.291 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.123,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2023-03-08T15:48:40.292 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn min per osd = 0 2023-03-08T15:48:40.292 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = 1b15c317-0b05-4434-b72b-9beacb9cbd31 2023-03-08T15:48:40.292 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.292 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2023-03-08T15:48:40.292 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2023-03-08T15:48:40.292 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.292 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2023-03-08T15:48:40.293 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2023-03-08T15:48:40.293 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.293 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2023-03-08T15:48:40.293 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2023-03-08T15:48:40.293 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.293 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2023-03-08T15:48:40.293 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2023-03-08T15:48:40.293 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2023-03-08T15:48:40.294 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.294 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2023-03-08T15:48:40.294 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2023-03-08T15:48:40.294 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.294 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2023-03-08T15:48:40.294 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.294 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2023-03-08T15:48:40.294 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.295 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2023-03-08T15:48:40.295 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.295 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2023-03-08T15:48:40.295 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2023-03-08T15:48:40.295 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.295 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2023-03-08T15:48:40.295 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2023-03-08T15:48:40.296 INFO:teuthology.orchestra.run.smithi175.stdout: bdev async discard = True 2023-03-08T15:48:40.296 INFO:teuthology.orchestra.run.smithi175.stdout: bdev enable discard = True 2023-03-08T15:48:40.296 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore allocator = bitmap 2023-03-08T15:48:40.296 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2023-03-08T15:48:40.296 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2023-03-08T15:48:40.296 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 1/20 2023-03-08T15:48:40.296 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 1/20 2023-03-08T15:48:40.296 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-03-08T15:48:40.297 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2023-03-08T15:48:40.297 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 4/10 2023-03-08T15:48:40.297 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2023-03-08T15:48:40.297 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2023-03-08T15:48:40.297 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2023-03-08T15:48:40.297 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2023-03-08T15:48:40.297 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2023-03-08T15:48:40.297 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2023-03-08T15:48:40.298 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.298 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2023-03-08T15:48:40.298 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-03-08T15:48:40.298 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2023-03-08T15:48:40.298 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2023-03-08T15:48:40.298 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2023-03-08T15:48:40.298 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2023-03-08T15:48:40.299 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2023-03-08T15:48:40.299 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2023-03-08T15:48:40.299 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.299 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2023-03-08T15:48:40.299 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-03-08T15:48:40.299 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2023-03-08T15:48:40.299 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2023-03-08T15:48:40.299 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2023-03-08T15:48:40.300 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2023-03-08T15:48:40.300 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2023-03-08T15:48:40.300 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2023-03-08T15:48:40.300 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2023-03-08T15:48:40.300 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2023-03-08T15:48:40.300 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2023-03-08T15:48:40.300 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.301 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-03-08T15:48:40.301 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2023-03-08T15:48:40.301 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2023-03-08T15:48:40.301 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.301 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2023-03-08T15:48:40.301 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-03-08T15:48:40.301 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-03-08T15:48:40.301 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.302 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2023-03-08T15:48:40.302 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2023-03-08T15:48:40.302 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.302 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2023-03-08T15:48:40.302 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2023-03-08T15:48:40.302 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-03-08T15:48:40.302 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2023-03-08T15:48:40.303 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2023-03-08T15:48:40.303 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2023-03-08T15:48:40.303 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2023-03-08T15:48:40.303 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-03-08T15:48:40.303 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-03-08T15:48:40.303 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2023-03-08T15:48:40.303 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2023-03-08T15:48:40.303 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-03-08T15:48:40.304 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2023-03-08T15:48:40.304 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2023-03-08T15:48:40.304 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2023-03-08T15:48:40.304 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2023-03-08T15:48:40.304 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2023-03-08T15:48:40.304 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2023-03-08T15:48:40.304 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2023-03-08T15:48:40.304 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2023-03-08T15:48:40.305 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2023-03-08T15:48:40.305 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2023-03-08T15:48:40.305 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds balancer = 20 2023-03-08T15:48:40.305 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-03-08T15:48:40.305 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2023-03-08T15:48:40.305 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = True 2023-03-08T15:48:40.305 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2023-03-08T15:48:40.306 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = True 2023-03-08T15:48:40.306 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2023-03-08T15:48:40.306 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2023-03-08T15:48:40.306 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2023-03-08T15:48:40.401 INFO:teuthology.orchestra.run.smithi182.stdout:[global] 2023-03-08T15:48:40.402 INFO:teuthology.orchestra.run.smithi182.stdout: chdir = "" 2023-03-08T15:48:40.402 INFO:teuthology.orchestra.run.smithi182.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-03-08T15:48:40.402 INFO:teuthology.orchestra.run.smithi182.stdout: auth supported = cephx 2023-03-08T15:48:40.402 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.402 INFO:teuthology.orchestra.run.smithi182.stdout: filestore xattr use omap = true 2023-03-08T15:48:40.402 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.402 INFO:teuthology.orchestra.run.smithi182.stdout: mon clock drift allowed = 1.000 2023-03-08T15:48:40.403 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.403 INFO:teuthology.orchestra.run.smithi182.stdout: osd crush chooseleaf type = 0 2023-03-08T15:48:40.403 INFO:teuthology.orchestra.run.smithi182.stdout: auth debug = true 2023-03-08T15:48:40.403 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.403 INFO:teuthology.orchestra.run.smithi182.stdout: ms die on old message = true 2023-03-08T15:48:40.403 INFO:teuthology.orchestra.run.smithi182.stdout: ms die on bug = true 2023-03-08T15:48:40.403 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.404 INFO:teuthology.orchestra.run.smithi182.stdout: mon max pg per osd = 10000 # >= luminous 2023-03-08T15:48:40.404 INFO:teuthology.orchestra.run.smithi182.stdout: mon pg warn max object skew = 0 2023-03-08T15:48:40.404 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.404 INFO:teuthology.orchestra.run.smithi182.stdout: # disable pg_autoscaler by default for new pools 2023-03-08T15:48:40.404 INFO:teuthology.orchestra.run.smithi182.stdout: osd_pool_default_pg_autoscale_mode = off 2023-03-08T15:48:40.404 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.404 INFO:teuthology.orchestra.run.smithi182.stdout: osd pool default size = 2 2023-03-08T15:48:40.404 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.405 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd allow primary affinity = true 2023-03-08T15:48:40.405 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd allow pg remap = true 2023-03-08T15:48:40.405 INFO:teuthology.orchestra.run.smithi182.stdout: mon warn on legacy crush tunables = false 2023-03-08T15:48:40.405 INFO:teuthology.orchestra.run.smithi182.stdout: mon warn on crush straw calc version zero = false 2023-03-08T15:48:40.405 INFO:teuthology.orchestra.run.smithi182.stdout: mon warn on no sortbitwise = false 2023-03-08T15:48:40.405 INFO:teuthology.orchestra.run.smithi182.stdout: mon warn on osd down out interval zero = false 2023-03-08T15:48:40.405 INFO:teuthology.orchestra.run.smithi182.stdout: mon warn on too few osds = false 2023-03-08T15:48:40.406 INFO:teuthology.orchestra.run.smithi182.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-03-08T15:48:40.406 INFO:teuthology.orchestra.run.smithi182.stdout: mon_warn_on_pool_no_redundancy = false 2023-03-08T15:48:40.406 INFO:teuthology.orchestra.run.smithi182.stdout: mon_allow_pool_size_one = true 2023-03-08T15:48:40.406 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.406 INFO:teuthology.orchestra.run.smithi182.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-03-08T15:48:40.406 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.406 INFO:teuthology.orchestra.run.smithi182.stdout: osd default data pool replay window = 5 2023-03-08T15:48:40.406 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.407 INFO:teuthology.orchestra.run.smithi182.stdout: mon allow pool delete = true 2023-03-08T15:48:40.407 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.407 INFO:teuthology.orchestra.run.smithi182.stdout: mon cluster log file level = debug 2023-03-08T15:48:40.407 INFO:teuthology.orchestra.run.smithi182.stdout: debug asserts on shutdown = true 2023-03-08T15:48:40.407 INFO:teuthology.orchestra.run.smithi182.stdout: mon health detail to clog = false 2023-03-08T15:48:40.407 INFO:teuthology.orchestra.run.smithi182.stdout: mon host = "172.21.15.123,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2023-03-08T15:48:40.407 INFO:teuthology.orchestra.run.smithi182.stdout: mon pg warn min per osd = 0 2023-03-08T15:48:40.407 INFO:teuthology.orchestra.run.smithi182.stdout: fsid = 1b15c317-0b05-4434-b72b-9beacb9cbd31 2023-03-08T15:48:40.408 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.408 INFO:teuthology.orchestra.run.smithi182.stdout:[osd] 2023-03-08T15:48:40.408 INFO:teuthology.orchestra.run.smithi182.stdout: osd journal size = 100 2023-03-08T15:48:40.408 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.408 INFO:teuthology.orchestra.run.smithi182.stdout: osd scrub load threshold = 5.0 2023-03-08T15:48:40.408 INFO:teuthology.orchestra.run.smithi182.stdout: osd scrub max interval = 600 2023-03-08T15:48:40.408 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.409 INFO:teuthology.orchestra.run.smithi182.stdout: osd recover clone overlap = true 2023-03-08T15:48:40.409 INFO:teuthology.orchestra.run.smithi182.stdout: osd recovery max chunk = 1048576 2023-03-08T15:48:40.409 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.409 INFO:teuthology.orchestra.run.smithi182.stdout: osd debug shutdown = true 2023-03-08T15:48:40.409 INFO:teuthology.orchestra.run.smithi182.stdout: osd debug op order = true 2023-03-08T15:48:40.409 INFO:teuthology.orchestra.run.smithi182.stdout: osd debug verify stray on activate = true 2023-03-08T15:48:40.409 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.409 INFO:teuthology.orchestra.run.smithi182.stdout: osd open classes on start = true 2023-03-08T15:48:40.410 INFO:teuthology.orchestra.run.smithi182.stdout: osd debug pg log writeout = true 2023-03-08T15:48:40.410 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.410 INFO:teuthology.orchestra.run.smithi182.stdout: osd deep scrub update digest min age = 30 2023-03-08T15:48:40.410 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.410 INFO:teuthology.orchestra.run.smithi182.stdout: osd map max advance = 10 2023-03-08T15:48:40.410 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.410 INFO:teuthology.orchestra.run.smithi182.stdout: journal zero on create = true 2023-03-08T15:48:40.411 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.411 INFO:teuthology.orchestra.run.smithi182.stdout: filestore ondisk finisher threads = 3 2023-03-08T15:48:40.411 INFO:teuthology.orchestra.run.smithi182.stdout: filestore apply finisher threads = 3 2023-03-08T15:48:40.411 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.411 INFO:teuthology.orchestra.run.smithi182.stdout: bdev debug aio = true 2023-03-08T15:48:40.411 INFO:teuthology.orchestra.run.smithi182.stdout: osd debug misdirected ops = true 2023-03-08T15:48:40.411 INFO:teuthology.orchestra.run.smithi182.stdout: bdev async discard = True 2023-03-08T15:48:40.411 INFO:teuthology.orchestra.run.smithi182.stdout: bdev enable discard = True 2023-03-08T15:48:40.412 INFO:teuthology.orchestra.run.smithi182.stdout: bluestore allocator = bitmap 2023-03-08T15:48:40.412 INFO:teuthology.orchestra.run.smithi182.stdout: bluestore block size = 96636764160 2023-03-08T15:48:40.412 INFO:teuthology.orchestra.run.smithi182.stdout: bluestore fsck on mount = True 2023-03-08T15:48:40.412 INFO:teuthology.orchestra.run.smithi182.stdout: debug bluefs = 1/20 2023-03-08T15:48:40.412 INFO:teuthology.orchestra.run.smithi182.stdout: debug bluestore = 1/20 2023-03-08T15:48:40.412 INFO:teuthology.orchestra.run.smithi182.stdout: debug ms = 1 2023-03-08T15:48:40.412 INFO:teuthology.orchestra.run.smithi182.stdout: debug osd = 20 2023-03-08T15:48:40.412 INFO:teuthology.orchestra.run.smithi182.stdout: debug rocksdb = 4/10 2023-03-08T15:48:40.413 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd backfillfull_ratio = 0.85 2023-03-08T15:48:40.413 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd full ratio = 0.9 2023-03-08T15:48:40.413 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd nearfull ratio = 0.8 2023-03-08T15:48:40.413 INFO:teuthology.orchestra.run.smithi182.stdout: osd failsafe full ratio = 0.95 2023-03-08T15:48:40.413 INFO:teuthology.orchestra.run.smithi182.stdout: osd objectstore = bluestore 2023-03-08T15:48:40.413 INFO:teuthology.orchestra.run.smithi182.stdout: osd op complaint time = 180 2023-03-08T15:48:40.413 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.414 INFO:teuthology.orchestra.run.smithi182.stdout:[mgr] 2023-03-08T15:48:40.414 INFO:teuthology.orchestra.run.smithi182.stdout: debug ms = 1 2023-03-08T15:48:40.414 INFO:teuthology.orchestra.run.smithi182.stdout: debug mgr = 20 2023-03-08T15:48:40.414 INFO:teuthology.orchestra.run.smithi182.stdout: debug mon = 20 2023-03-08T15:48:40.414 INFO:teuthology.orchestra.run.smithi182.stdout: debug auth = 20 2023-03-08T15:48:40.414 INFO:teuthology.orchestra.run.smithi182.stdout: mon reweight min pgs per osd = 4 2023-03-08T15:48:40.414 INFO:teuthology.orchestra.run.smithi182.stdout: mon reweight min bytes per osd = 10 2023-03-08T15:48:40.414 INFO:teuthology.orchestra.run.smithi182.stdout: mgr/telemetry/nag = false 2023-03-08T15:48:40.415 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.415 INFO:teuthology.orchestra.run.smithi182.stdout:[mon] 2023-03-08T15:48:40.415 INFO:teuthology.orchestra.run.smithi182.stdout: debug ms = 1 2023-03-08T15:48:40.415 INFO:teuthology.orchestra.run.smithi182.stdout: debug mon = 20 2023-03-08T15:48:40.415 INFO:teuthology.orchestra.run.smithi182.stdout: debug paxos = 20 2023-03-08T15:48:40.415 INFO:teuthology.orchestra.run.smithi182.stdout: debug auth = 20 2023-03-08T15:48:40.415 INFO:teuthology.orchestra.run.smithi182.stdout: mon data avail warn = 5 2023-03-08T15:48:40.415 INFO:teuthology.orchestra.run.smithi182.stdout: mon mgr mkfs grace = 240 2023-03-08T15:48:40.416 INFO:teuthology.orchestra.run.smithi182.stdout: mon reweight min pgs per osd = 4 2023-03-08T15:48:40.416 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd reporter subtree level = osd 2023-03-08T15:48:40.416 INFO:teuthology.orchestra.run.smithi182.stdout: mon osd prime pg temp = true 2023-03-08T15:48:40.416 INFO:teuthology.orchestra.run.smithi182.stdout: mon reweight min bytes per osd = 10 2023-03-08T15:48:40.416 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.416 INFO:teuthology.orchestra.run.smithi182.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-03-08T15:48:40.416 INFO:teuthology.orchestra.run.smithi182.stdout: auth mon ticket ttl = 660 # 11m 2023-03-08T15:48:40.416 INFO:teuthology.orchestra.run.smithi182.stdout: auth service ticket ttl = 240 # 4m 2023-03-08T15:48:40.417 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.417 INFO:teuthology.orchestra.run.smithi182.stdout: # don't complain about insecure global_id in the test suite 2023-03-08T15:48:40.417 INFO:teuthology.orchestra.run.smithi182.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-03-08T15:48:40.417 INFO:teuthology.orchestra.run.smithi182.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-03-08T15:48:40.417 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.417 INFO:teuthology.orchestra.run.smithi182.stdout: # 1m isn't quite enough 2023-03-08T15:48:40.417 INFO:teuthology.orchestra.run.smithi182.stdout: mon_down_mkfs_grace = 2m 2023-03-08T15:48:40.418 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.418 INFO:teuthology.orchestra.run.smithi182.stdout: mon_warn_on_filestore_osds = false 2023-03-08T15:48:40.418 INFO:teuthology.orchestra.run.smithi182.stdout: mon op complaint time = 120 2023-03-08T15:48:40.418 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:48:40.418 INFO:teuthology.orchestra.run.smithi182.stdout:[client] 2023-03-08T15:48:40.418 INFO:teuthology.orchestra.run.smithi182.stdout: rgw cache enabled = true 2023-03-08T15:48:40.418 INFO:teuthology.orchestra.run.smithi182.stdout: rgw enable ops log = true 2023-03-08T15:48:40.418 INFO:teuthology.orchestra.run.smithi182.stdout: rgw enable usage log = true 2023-03-08T15:48:40.419 INFO:teuthology.orchestra.run.smithi182.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-03-08T15:48:40.419 INFO:teuthology.orchestra.run.smithi182.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-03-08T15:48:40.419 INFO:teuthology.orchestra.run.smithi182.stdout: client mount timeout = 600 2023-03-08T15:48:40.419 INFO:teuthology.orchestra.run.smithi182.stdout: debug client = 20 2023-03-08T15:48:40.419 INFO:teuthology.orchestra.run.smithi182.stdout: debug ms = 1 2023-03-08T15:48:40.419 INFO:teuthology.orchestra.run.smithi182.stdout: rados mon op timeout = 900 2023-03-08T15:48:40.419 INFO:teuthology.orchestra.run.smithi182.stdout: rados osd op timeout = 900 2023-03-08T15:48:40.420 INFO:teuthology.orchestra.run.smithi182.stdout:[mon.a] 2023-03-08T15:48:40.420 INFO:teuthology.orchestra.run.smithi182.stdout:[mon.b] 2023-03-08T15:48:40.420 INFO:teuthology.orchestra.run.smithi182.stdout:[mon.c] 2023-03-08T15:48:40.420 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.a] 2023-03-08T15:48:40.420 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.c] 2023-03-08T15:48:40.420 INFO:teuthology.orchestra.run.smithi182.stdout:[mds.b] 2023-03-08T15:48:40.420 INFO:teuthology.orchestra.run.smithi182.stdout:[mds] 2023-03-08T15:48:40.420 INFO:teuthology.orchestra.run.smithi182.stdout: debug mds = 20 2023-03-08T15:48:40.421 INFO:teuthology.orchestra.run.smithi182.stdout: debug mds balancer = 20 2023-03-08T15:48:40.421 INFO:teuthology.orchestra.run.smithi182.stdout: debug ms = 1 2023-03-08T15:48:40.421 INFO:teuthology.orchestra.run.smithi182.stdout: mds debug frag = True 2023-03-08T15:48:40.421 INFO:teuthology.orchestra.run.smithi182.stdout: mds debug scatterstat = True 2023-03-08T15:48:40.421 INFO:teuthology.orchestra.run.smithi182.stdout: mds op complaint time = 180 2023-03-08T15:48:40.421 INFO:teuthology.orchestra.run.smithi182.stdout: mds verify scatter = True 2023-03-08T15:48:40.421 INFO:teuthology.orchestra.run.smithi182.stdout: osd op complaint time = 180 2023-03-08T15:48:40.421 INFO:teuthology.orchestra.run.smithi182.stdout: rados mon op timeout = 900 2023-03-08T15:48:40.422 INFO:teuthology.orchestra.run.smithi182.stdout: rados osd op timeout = 900 2023-03-08T15:48:40.444 INFO:tasks.ceph:Creating admin key on mon.a... 2023-03-08T15:48:40.445 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-03-08T15:48:40.501 INFO:tasks.ceph:Copying monmap to all nodes... 2023-03-08T15:48:40.501 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:48:40.502 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-03-08T15:48:40.518 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:48:40.519 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-03-08T15:48:40.576 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi123.front.sepia.ceph.com 2023-03-08T15:48:40.576 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:48:40.576 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.keyring 2023-03-08T15:48:40.576 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-08T15:48:40.688 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:48:40.689 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-03-08T15:48:40.750 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2023-03-08T15:48:40.750 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:48:40.751 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2023-03-08T15:48:40.751 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-08T15:48:40.788 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:48:40.789 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-03-08T15:48:40.846 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi182.front.sepia.ceph.com 2023-03-08T15:48:40.846 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:48:40.846 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/etc/ceph/ceph.keyring 2023-03-08T15:48:40.847 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-08T15:48:40.978 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:48:40.978 DEBUG:teuthology.orchestra.run.smithi182:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-03-08T15:48:41.083 INFO:tasks.ceph:Setting up mon nodes... 2023-03-08T15:48:41.084 INFO:tasks.ceph:Setting up mgr nodes... 2023-03-08T15:48:41.084 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-03-08T15:48:41.139 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-03-08T15:48:41.142 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-03-08T15:48:41.220 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-03-08T15:48:41.223 INFO:tasks.ceph:Setting up mds nodes... 2023-03-08T15:48:41.223 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-03-08T15:48:41.276 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-03-08T15:48:41.278 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-03-08T15:48:41.305 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-03-08T15:48:41.398 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-03-08T15:48:41.400 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-03-08T15:48:41.427 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-03-08T15:48:41.480 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-03-08T15:48:41.483 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-03-08T15:48:41.509 INFO:tasks.ceph_client:Setting up client nodes... 2023-03-08T15:48:41.509 DEBUG:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-03-08T15:48:41.662 INFO:teuthology.orchestra.run.smithi182.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-03-08T15:48:41.712 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-03-08T15:48:41.712 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-03-08T15:48:41.712 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-03-08T15:48:41.739 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-08T15:48:41.740 INFO:tasks.ceph:role: osd.0 2023-03-08T15:48:41.740 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com 2023-03-08T15:48:41.740 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-03-08T15:48:41.814 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-03-08T15:48:41.814 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-08T15:48:41.814 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-08T15:48:41.815 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-08T15:48:41.815 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-08T15:48:41.815 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-03-08T15:48:41.815 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-08T15:48:41.815 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-08T15:48:41.815 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-08T15:48:41.816 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-08T15:48:42.255 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2023-03-08T15:48:42.257 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-03-08T15:48:42.258 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-03-08T15:48:42.412 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-03-08T15:48:42.447 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-03-08T15:48:42.514 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-08T15:48:42.514 INFO:tasks.ceph:role: osd.1 2023-03-08T15:48:42.514 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com 2023-03-08T15:48:42.514 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-03-08T15:48:42.587 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-03-08T15:48:42.588 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-08T15:48:42.588 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-08T15:48:42.588 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-08T15:48:42.588 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-08T15:48:42.588 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-03-08T15:48:42.589 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-08T15:48:42.589 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-08T15:48:42.589 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-08T15:48:42.589 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-08T15:48:43.021 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2023-03-08T15:48:43.022 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-03-08T15:48:43.023 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-03-08T15:48:43.129 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-03-08T15:48:43.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-03-08T15:48:43.226 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-08T15:48:43.227 INFO:tasks.ceph:role: osd.2 2023-03-08T15:48:43.227 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com 2023-03-08T15:48:43.227 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-03-08T15:48:43.301 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-03-08T15:48:43.301 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-08T15:48:43.301 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-08T15:48:43.301 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-08T15:48:43.302 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-08T15:48:43.302 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-03-08T15:48:43.302 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-08T15:48:43.302 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-08T15:48:43.302 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-08T15:48:43.302 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-08T15:48:43.750 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2023-03-08T15:48:43.751 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-03-08T15:48:43.752 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-03-08T15:48:43.909 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-03-08T15:48:43.940 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-03-08T15:48:44.006 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-08T15:48:44.006 INFO:tasks.ceph:role: osd.3 2023-03-08T15:48:44.007 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com 2023-03-08T15:48:44.007 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-03-08T15:48:44.079 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-03-08T15:48:44.080 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-08T15:48:44.080 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-08T15:48:44.080 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-08T15:48:44.080 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-08T15:48:44.080 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-03-08T15:48:44.080 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-08T15:48:44.081 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-08T15:48:44.081 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-08T15:48:44.081 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-08T15:48:44.524 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2023-03-08T15:48:44.526 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-03-08T15:48:44.526 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-03-08T15:48:44.713 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-03-08T15:48:44.746 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-08T15:48:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:44.841+0000 7f14c1dd6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-03-08T15:48:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:44.842+0000 7f14c1dd6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-03-08T15:48:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:44.842+0000 7f14c1dd6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-08T15:48:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:44.842+0000 7f14c1dd6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-08T15:48:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:44.842+0000 7f14c1dd6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-08T15:48:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:44.842+0000 7f14c1dd6640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-03-08T15:48:47.696 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-03-08T15:48:47.726 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-08T15:48:47.818 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:47.817+0000 7f02d25a1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-03-08T15:48:47.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:47.817+0000 7f02d25a1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-03-08T15:48:47.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:47.817+0000 7f02d25a1640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-08T15:48:47.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:47.817+0000 7f02d25a1640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-08T15:48:47.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:47.817+0000 7f02d25a1640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-08T15:48:47.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:47.818+0000 7f02d25a1640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-03-08T15:48:50.666 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-03-08T15:48:50.696 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-08T15:48:50.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:50.784+0000 7f3aba6e9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-03-08T15:48:50.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:50.785+0000 7f3aba6e9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-03-08T15:48:50.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:50.785+0000 7f3aba6e9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-08T15:48:50.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:50.785+0000 7f3aba6e9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-08T15:48:50.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:50.785+0000 7f3aba6e9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-08T15:48:50.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:50.785+0000 7f3aba6e9640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-03-08T15:48:53.631 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-03-08T15:48:53.665 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-08T15:48:53.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:53.761+0000 7fcccbffb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-03-08T15:48:53.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:53.761+0000 7fcccbffb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-03-08T15:48:53.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:53.761+0000 7fcccbffb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-08T15:48:53.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:53.761+0000 7fcccbffb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-08T15:48:53.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:53.761+0000 7fcccbffb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-08T15:48:53.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:48:53.761+0000 7fcccbffb640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-03-08T15:48:56.606 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-03-08T15:48:56.640 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-03-08T15:48:56.667 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-08T15:48:56.667 INFO:tasks.ceph:role: osd.4 2023-03-08T15:48:56.667 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2023-03-08T15:48:56.667 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-03-08T15:48:56.740 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-03-08T15:48:56.741 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-08T15:48:56.741 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-08T15:48:56.741 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-08T15:48:56.741 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-08T15:48:56.741 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-03-08T15:48:56.741 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-08T15:48:56.742 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-08T15:48:56.742 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-08T15:48:56.742 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-08T15:48:57.169 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-03-08T15:48:57.170 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-03-08T15:48:57.170 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-03-08T15:48:57.318 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-03-08T15:48:57.352 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-03-08T15:48:57.419 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-08T15:48:57.419 INFO:tasks.ceph:role: osd.5 2023-03-08T15:48:57.419 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com 2023-03-08T15:48:57.420 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-03-08T15:48:57.493 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-03-08T15:48:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-08T15:48:57.493 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-08T15:48:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-08T15:48:57.494 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-08T15:48:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-03-08T15:48:57.494 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-08T15:48:57.494 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-08T15:48:57.494 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-08T15:48:57.494 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-08T15:48:57.915 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-03-08T15:48:57.917 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-03-08T15:48:57.917 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-03-08T15:48:58.002 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-03-08T15:48:58.031 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-03-08T15:48:58.098 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-08T15:48:58.099 INFO:tasks.ceph:role: osd.6 2023-03-08T15:48:58.099 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com 2023-03-08T15:48:58.099 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-03-08T15:48:58.173 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-03-08T15:48:58.173 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-08T15:48:58.174 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-08T15:48:58.174 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-08T15:48:58.174 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-08T15:48:58.174 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-03-08T15:48:58.174 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-08T15:48:58.174 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-08T15:48:58.175 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-08T15:48:58.175 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-08T15:48:58.615 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-03-08T15:48:58.616 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-03-08T15:48:58.617 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-03-08T15:48:58.749 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-03-08T15:48:58.780 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-03-08T15:48:58.847 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-08T15:48:58.847 INFO:tasks.ceph:role: osd.7 2023-03-08T15:48:58.848 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com 2023-03-08T15:48:58.848 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-03-08T15:48:58.922 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-03-08T15:48:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-08T15:48:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-08T15:48:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-08T15:48:58.923 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-08T15:48:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-03-08T15:48:58.923 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-08T15:48:58.923 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-08T15:48:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-08T15:48:58.923 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-08T15:48:59.353 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-03-08T15:48:59.354 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-03-08T15:48:59.355 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-03-08T15:48:59.522 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-03-08T15:48:59.553 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-08T15:48:59.677 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:48:59.675+0000 7f7c1921d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-03-08T15:48:59.679 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:48:59.677+0000 7f7c1921d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-03-08T15:48:59.679 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:48:59.677+0000 7f7c1921d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-08T15:48:59.679 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:48:59.677+0000 7f7c1921d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-08T15:48:59.679 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:48:59.677+0000 7f7c1921d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-08T15:48:59.682 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:48:59.681+0000 7f7c1921d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-03-08T15:49:02.530 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-03-08T15:49:02.562 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-08T15:49:02.654 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:02.652+0000 7f3123b97640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-03-08T15:49:02.654 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:02.652+0000 7f3123b97640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-03-08T15:49:02.654 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:02.652+0000 7f3123b97640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-08T15:49:02.655 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:02.652+0000 7f3123b97640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-08T15:49:02.655 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:02.652+0000 7f3123b97640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-08T15:49:02.655 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:02.653+0000 7f3123b97640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-03-08T15:49:05.499 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-03-08T15:49:05.530 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-08T15:49:05.620 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:05.619+0000 7fb7a28f1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-03-08T15:49:05.621 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:05.619+0000 7fb7a28f1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-03-08T15:49:05.621 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:05.619+0000 7fb7a28f1640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-08T15:49:05.621 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:05.619+0000 7fb7a28f1640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-08T15:49:05.621 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:05.619+0000 7fb7a28f1640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-08T15:49:05.622 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:05.620+0000 7fb7a28f1640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-03-08T15:49:08.120 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:49:08.122 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:49:08.125 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:49:08.482 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-03-08T15:49:08.514 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-08T15:49:08.605 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:08.604+0000 7f36540e9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-03-08T15:49:08.606 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:08.604+0000 7f36540e9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-03-08T15:49:08.606 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:08.604+0000 7f36540e9640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-08T15:49:08.606 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:08.604+0000 7f36540e9640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-08T15:49:08.606 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:08.604+0000 7f36540e9640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-08T15:49:08.606 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:08.604+0000 7f36540e9640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-03-08T15:49:11.454 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-03-08T15:49:11.484 INFO:tasks.ceph:Reading keys from all nodes... 2023-03-08T15:49:11.484 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:49:11.485 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-03-08T15:49:11.516 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:49:11.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-03-08T15:49:11.585 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:49:11.585 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-03-08T15:49:11.653 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:49:11.654 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-03-08T15:49:11.721 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:49:11.721 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-03-08T15:49:11.788 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:49:11.789 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-03-08T15:49:11.854 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:49:11.855 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-03-08T15:49:11.920 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:49:11.920 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-03-08T15:49:11.948 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:49:11.948 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-03-08T15:49:12.016 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:49:12.016 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-03-08T15:49:12.083 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:49:12.084 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-03-08T15:49:12.150 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:49:12.150 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-03-08T15:49:12.217 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:49:12.217 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-03-08T15:49:12.283 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:49:12.283 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-03-08T15:49:12.354 INFO:tasks.ceph:Adding keys to all mons... 2023-03-08T15:49:12.355 DEBUG:teuthology.orchestra.run.smithi123:> sudo tee -a /etc/ceph/ceph.keyring 2023-03-08T15:49:12.357 DEBUG:teuthology.orchestra.run.smithi175:> sudo tee -a /etc/ceph/ceph.keyring 2023-03-08T15:49:12.381 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.y] 2023-03-08T15:49:12.381 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBZrghkfi9QCBAATBmbzLj7Ed/rYrsrshuZ+Q== 2023-03-08T15:49:12.381 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2023-03-08T15:49:12.381 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBZrghkWNZ4EBAAMA2U3kpQfOu1QQIrwfP1xw== 2023-03-08T15:49:12.381 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2023-03-08T15:49:12.381 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBZrghkE4O7FxAAKebPQz7wEXV5SXPt2XSF9Q== 2023-03-08T15:49:12.382 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.0] 2023-03-08T15:49:12.382 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBcrghkg5A+MhAAUxJGw6XMtw2I2nY7prkHzA== 2023-03-08T15:49:12.382 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.1] 2023-03-08T15:49:12.382 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBfrghkjMPIMBAAJBSVelYPAZ2sSjF120fmIQ== 2023-03-08T15:49:12.382 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.2] 2023-03-08T15:49:12.382 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBirghkIKXWLhAA98rDwuV96f0fdkxaxxeyjw== 2023-03-08T15:49:12.382 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.3] 2023-03-08T15:49:12.383 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBlrghk+ZNrLRAAz3JzCAplasJVWClv10lr1w== 2023-03-08T15:49:12.383 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.x] 2023-03-08T15:49:12.383 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBZrghkwzIjDRAAklXNLBhbi3AAPfOTv9ZSNg== 2023-03-08T15:49:12.383 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2023-03-08T15:49:12.383 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBZrghk6xelHBAAQ5A68T67cGRq9xmLqpr8bQ== 2023-03-08T15:49:12.383 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.4] 2023-03-08T15:49:12.383 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBrrghk31xXKBAAnWGXIH40ZFPDCMjK6Sg8tg== 2023-03-08T15:49:12.383 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.5] 2023-03-08T15:49:12.384 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBurghknLb4JhAAcDyzC73+0aMhsqrP0c0a2g== 2023-03-08T15:49:12.384 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.6] 2023-03-08T15:49:12.384 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBxrghk+kT8JBAAnT9Y2A+AmmAmy0rPBsegMA== 2023-03-08T15:49:12.384 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.7] 2023-03-08T15:49:12.384 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQB0rghkr4EVJBAAFxJPLa5xZ+WYyJGbJbbiww== 2023-03-08T15:49:12.384 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2023-03-08T15:49:12.384 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBZrghkEZl9JxAAzJi2qJ/oIe4AzvPC2aiVjw== 2023-03-08T15:49:12.385 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.y] 2023-03-08T15:49:12.386 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBZrghkfi9QCBAATBmbzLj7Ed/rYrsrshuZ+Q== 2023-03-08T15:49:12.386 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2023-03-08T15:49:12.386 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBZrghkWNZ4EBAAMA2U3kpQfOu1QQIrwfP1xw== 2023-03-08T15:49:12.386 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2023-03-08T15:49:12.386 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBZrghkE4O7FxAAKebPQz7wEXV5SXPt2XSF9Q== 2023-03-08T15:49:12.386 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.0] 2023-03-08T15:49:12.387 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBcrghkg5A+MhAAUxJGw6XMtw2I2nY7prkHzA== 2023-03-08T15:49:12.387 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.1] 2023-03-08T15:49:12.387 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBfrghkjMPIMBAAJBSVelYPAZ2sSjF120fmIQ== 2023-03-08T15:49:12.387 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.2] 2023-03-08T15:49:12.387 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBirghkIKXWLhAA98rDwuV96f0fdkxaxxeyjw== 2023-03-08T15:49:12.387 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.3] 2023-03-08T15:49:12.387 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBlrghk+ZNrLRAAz3JzCAplasJVWClv10lr1w== 2023-03-08T15:49:12.387 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.x] 2023-03-08T15:49:12.388 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBZrghkwzIjDRAAklXNLBhbi3AAPfOTv9ZSNg== 2023-03-08T15:49:12.388 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2023-03-08T15:49:12.388 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBZrghk6xelHBAAQ5A68T67cGRq9xmLqpr8bQ== 2023-03-08T15:49:12.388 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.4] 2023-03-08T15:49:12.388 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBrrghk31xXKBAAnWGXIH40ZFPDCMjK6Sg8tg== 2023-03-08T15:49:12.388 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.5] 2023-03-08T15:49:12.388 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBurghknLb4JhAAcDyzC73+0aMhsqrP0c0a2g== 2023-03-08T15:49:12.388 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.6] 2023-03-08T15:49:12.389 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBxrghk+kT8JBAAnT9Y2A+AmmAmy0rPBsegMA== 2023-03-08T15:49:12.389 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.7] 2023-03-08T15:49:12.389 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQB0rghkr4EVJBAAFxJPLa5xZ+WYyJGbJbbiww== 2023-03-08T15:49:12.389 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2023-03-08T15:49:12.389 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBZrghkEZl9JxAAzJi2qJ/oIe4AzvPC2aiVjw== 2023-03-08T15:49:12.389 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-08T15:49:12.428 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-08T15:49:12.481 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-08T15:49:12.483 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-08T15:49:12.539 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-08T15:49:12.541 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-08T15:49:12.597 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:12.599 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:12.652 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:12.654 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:12.706 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:12.708 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:12.761 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:12.763 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:12.816 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-08T15:49:12.818 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-08T15:49:12.870 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-08T15:49:12.872 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-08T15:49:12.928 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:12.929 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:12.982 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:12.984 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:13.037 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:13.039 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:13.091 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:13.093 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-08T15:49:13.146 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-08T15:49:13.148 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-08T15:49:13.203 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-03-08T15:49:13.204 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-03-08T15:49:13.230 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-08T15:49:13.328 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-03-08T15:49:13.355 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-03-08T15:49:13.381 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-08T15:49:13.479 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-03-08T15:49:13.505 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-03-08T15:49:13.571 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-08T15:49:13.669 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-03-08T15:49:13.695 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-03-08T15:49:13.697 DEBUG:teuthology.orchestra.run.smithi175:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-03-08T15:49:13.752 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-03-08T15:49:13.752 INFO:tasks.ceph.mon.a:Restarting daemon 2023-03-08T15:49:13.753 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-03-08T15:49:13.755 INFO:tasks.ceph.mon.a:Started 2023-03-08T15:49:13.755 INFO:tasks.ceph.mon.b:Restarting daemon 2023-03-08T15:49:13.755 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-03-08T15:49:13.794 INFO:tasks.ceph.mon.b:Started 2023-03-08T15:49:13.794 INFO:tasks.ceph.mon.c:Restarting daemon 2023-03-08T15:49:13.794 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-03-08T15:49:13.796 INFO:tasks.ceph.mon.c:Started 2023-03-08T15:49:13.796 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-03-08T15:49:13.797 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-03-08T15:49:13.797 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-03-08T15:49:13.799 INFO:tasks.ceph.mgr.y:Started 2023-03-08T15:49:13.799 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-03-08T15:49:13.799 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-03-08T15:49:13.801 INFO:tasks.ceph.mgr.x:Started 2023-03-08T15:49:13.801 INFO:tasks.ceph:Setting crush tunables to default 2023-03-08T15:49:13.802 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd crush tunables default 2023-03-08T15:49:13.923 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.922+0000 7f38be821700 1 Processor -- start 2023-03-08T15:49:13.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.922+0000 7f38be821700 1 -- start start 2023-03-08T15:49:13.925 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38be821700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f38b80bee10 0x7f38b814ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:13.925 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38be821700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b80be2a0 0x7f38b806d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:13.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38be821700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f38b814bf50 0x7f38b806dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:13.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38be821700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b80ba130 con 0x7f38b814bf50 2023-03-08T15:49:13.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38be821700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b80b9280 con 0x7f38b80bee10 2023-03-08T15:49:13.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38be821700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b80b9670 con 0x7f38b80be2a0 2023-03-08T15:49:13.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38bcdbe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f38b814bf50 0x7f38b806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:13.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38bcdbe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f38b814bf50 0x7f38b806dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60962/0 (socket says 172.21.15.123:60962) 2023-03-08T15:49:13.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38bcdbe700 1 -- 172.21.15.123:0/3487000930 learned_addr learned my addr 172.21.15.123:0/3487000930 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:13.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38bcdbe700 1 -- 172.21.15.123:0/3487000930 >> v2:172.21.15.123:3300/0 conn(0x7f38b814bf50 msgr2=0x7f38b806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-08T15:49:13.927 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38bcdbe700 1 -- 172.21.15.123:0/3487000930 >> v2:172.21.15.123:3300/0 conn(0x7f38b814bf50 msgr2=0x7f38b806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-08T15:49:13.927 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38bcdbe700 1 --2- 172.21.15.123:0/3487000930 >> v2:172.21.15.123:3300/0 conn(0x7f38b814bf50 0x7f38b806dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-08T15:49:13.927 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38b7fff700 1 --2- 172.21.15.123:0/3487000930 >> v2:172.21.15.175:3300/0 conn(0x7f38b80bee10 0x7f38b814ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:13.927 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38bcdbe700 1 --2- 172.21.15.123:0/3487000930 >> v2:172.21.15.123:3300/0 conn(0x7f38b814bf50 0x7f38b806dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-08T15:49:13.927 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38b77fe700 1 --2- 172.21.15.123:0/3487000930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b80be2a0 0x7f38b806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:13.927 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38b7fff700 1 -- 172.21.15.123:0/3487000930 >> v2:172.21.15.175:3300/0 conn(0x7f38b80bee10 msgr2=0x7f38b814ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-03-08T15:49:13.927 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38b7fff700 1 -- 172.21.15.123:0/3487000930 >> v2:172.21.15.175:3300/0 conn(0x7f38b80bee10 msgr2=0x7f38b814ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-08T15:49:13.928 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38b7fff700 1 --2- 172.21.15.123:0/3487000930 >> v2:172.21.15.175:3300/0 conn(0x7f38b80bee10 0x7f38b814ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-08T15:49:13.928 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38b77fe700 1 -- 172.21.15.123:0/3487000930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b80be2a0 msgr2=0x7f38b806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-03-08T15:49:13.928 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38b77fe700 1 -- 172.21.15.123:0/3487000930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b80be2a0 msgr2=0x7f38b806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-08T15:49:13.928 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38b77fe700 1 --2- 172.21.15.123:0/3487000930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b80be2a0 0x7f38b806d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-08T15:49:13.928 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38b7fff700 1 --2- 172.21.15.123:0/3487000930 >> v2:172.21.15.175:3300/0 conn(0x7f38b80bee10 0x7f38b814ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-08T15:49:13.928 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:13.923+0000 7f38b77fe700 1 --2- 172.21.15.123:0/3487000930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b80be2a0 0x7f38b806d570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-08T15:49:14.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.124+0000 7f38bcdbe700 1 --2- 172.21.15.123:0/3487000930 >> v2:172.21.15.123:3300/0 conn(0x7f38b814bf50 0x7f38b806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.124+0000 7f38b7fff700 1 --2- 172.21.15.123:0/3487000930 >> v2:172.21.15.175:3300/0 conn(0x7f38b80bee10 0x7f38b814ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.124+0000 7f38b77fe700 1 --2- 172.21.15.123:0/3487000930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b80be2a0 0x7f38b806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.124+0000 7f38bcdbe700 1 -- 172.21.15.123:0/3487000930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b80be2a0 msgr2=0x7f38b806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.124+0000 7f38bcdbe700 1 --2- 172.21.15.123:0/3487000930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b80be2a0 0x7f38b806d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.124+0000 7f38bcdbe700 1 -- 172.21.15.123:0/3487000930 >> v2:172.21.15.175:3300/0 conn(0x7f38b80bee10 msgr2=0x7f38b814ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.124+0000 7f38bcdbe700 1 --2- 172.21.15.123:0/3487000930 >> v2:172.21.15.175:3300/0 conn(0x7f38b80bee10 0x7f38b814ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.124+0000 7f38bcdbe700 1 -- 172.21.15.123:0/3487000930 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b809dc80 con 0x7f38b814bf50 2023-03-08T15:49:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.124+0000 7f38bcdbe700 1 --2- 172.21.15.123:0/3487000930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b814bf50 0x7f38b806dab0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f38b80bf7d0 tx=0x7f38b0009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8134d160606af5d3 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.124+0000 7f38b6ffd700 1 -- 172.21.15.123:0/3487000930 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b0003e30 con 0x7f38b814bf50 2023-03-08T15:49:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.124+0000 7f38b6ffd700 1 -- 172.21.15.123:0/3487000930 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b000f040 con 0x7f38b814bf50 2023-03-08T15:49:14.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.124+0000 7f38b6ffd700 1 -- 172.21.15.123:0/3487000930 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b0007be0 con 0x7f38b814bf50 2023-03-08T15:49:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.125+0000 7f38be821700 1 -- 172.21.15.123:0/3487000930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b814bf50 msgr2=0x7f38b806dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.125+0000 7f38be821700 1 --2- 172.21.15.123:0/3487000930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b814bf50 0x7f38b806dab0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f38b80bf7d0 tx=0x7f38b0009e40 comp rx=0 tx=0).stop 2023-03-08T15:49:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.125+0000 7f38be821700 1 -- 172.21.15.123:0/3487000930 shutdown_connections 2023-03-08T15:49:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.125+0000 7f38be821700 1 --2- 172.21.15.123:0/3487000930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b814bf50 0x7f38b806dab0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.125+0000 7f38be821700 1 --2- 172.21.15.123:0/3487000930 >> v2:172.21.15.175:3300/0 conn(0x7f38b80bee10 0x7f38b814ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.125+0000 7f38be821700 1 --2- 172.21.15.123:0/3487000930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b80be2a0 0x7f38b806d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.125+0000 7f38be821700 1 -- 172.21.15.123:0/3487000930 >> 172.21.15.123:0/3487000930 conn(0x7f38b806aee0 msgr2=0x7f38b80be700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.125+0000 7f38be821700 1 -- 172.21.15.123:0/3487000930 shutdown_connections 2023-03-08T15:49:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.125+0000 7f38be821700 1 -- 172.21.15.123:0/3487000930 wait complete. 2023-03-08T15:49:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.127+0000 7f38be821700 1 Processor -- start 2023-03-08T15:49:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.127+0000 7f38be821700 1 -- start start 2023-03-08T15:49:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38be821700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38b80be2a0 0x7f38b814aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:14.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38be821700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b80bee10 0x7f38b81d1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:14.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38be821700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b814bf50 0x7f38b81d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:14.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38be821700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b814b2f0 con 0x7f38b80bee10 2023-03-08T15:49:14.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38be821700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b81d2590 con 0x7f38b80be2a0 2023-03-08T15:49:14.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38be821700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b81d4070 con 0x7f38b814bf50 2023-03-08T15:49:14.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b80bee10 0x7f38b81d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:14.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b80bee10 0x7f38b81d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32786/0 (socket says 172.21.15.123:32786) 2023-03-08T15:49:14.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38b77fe700 1 -- 172.21.15.123:0/2447630219 learned_addr learned my addr 172.21.15.123:0/2447630219 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38b7fff700 1 --2- 172.21.15.123:0/2447630219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38b80be2a0 0x7f38b814aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38bcdbe700 1 --2- 172.21.15.123:0/2447630219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b814bf50 0x7f38b81d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38b77fe700 1 -- 172.21.15.123:0/2447630219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b814bf50 msgr2=0x7f38b81d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38b77fe700 1 --2- 172.21.15.123:0/2447630219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b814bf50 0x7f38b81d35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38b77fe700 1 -- 172.21.15.123:0/2447630219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38b80be2a0 msgr2=0x7f38b814aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38b77fe700 1 --2- 172.21.15.123:0/2447630219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38b80be2a0 0x7f38b814aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38b77fe700 1 -- 172.21.15.123:0/2447630219 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b00097c0 con 0x7f38b80bee10 2023-03-08T15:49:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38b7fff700 1 --2- 172.21.15.123:0/2447630219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38b80be2a0 0x7f38b814aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:49:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.128+0000 7f38bcdbe700 1 --2- 172.21.15.123:0/2447630219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b814bf50 0x7f38b81d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:49:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.129+0000 7f38b77fe700 1 --2- 172.21.15.123:0/2447630219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b80bee10 0x7f38b81d1830 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f38ac010860 tx=0x7f38ac010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.129+0000 7f38b4ff9700 1 -- 172.21.15.123:0/2447630219 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac00e860 con 0x7f38b80bee10 2023-03-08T15:49:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.129+0000 7f38b4ff9700 1 -- 172.21.15.123:0/2447630219 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ac00c050 con 0x7f38b80bee10 2023-03-08T15:49:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.129+0000 7f38be821700 1 -- 172.21.15.123:0/2447630219 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b80b9930 con 0x7f38b80bee10 2023-03-08T15:49:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.129+0000 7f38b4ff9700 1 -- 172.21.15.123:0/2447630219 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac00ebe0 con 0x7f38b80bee10 2023-03-08T15:49:14.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.129+0000 7f38be821700 1 -- 172.21.15.123:0/2447630219 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b809df60 con 0x7f38b80bee10 2023-03-08T15:49:14.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.129+0000 7f38b4ff9700 1 -- 172.21.15.123:0/2447630219 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f38ac026070 con 0x7f38b80bee10 2023-03-08T15:49:14.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.129+0000 7f38b4ff9700 1 -- 172.21.15.123:0/2447630219 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f38ac015c80 con 0x7f38b80bee10 2023-03-08T15:49:14.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.130+0000 7f38be821700 1 -- 172.21.15.123:0/2447630219 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b80b9c10 con 0x7f38b80bee10 2023-03-08T15:49:14.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.132+0000 7f38b4ff9700 1 -- 172.21.15.123:0/2447630219 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f38ac03eb10 con 0x7f38b80bee10 2023-03-08T15:49:14.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.206+0000 7f38be821700 1 -- 172.21.15.123:0/2447630219 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f38b80b8da0 con 0x7f38b80bee10 2023-03-08T15:49:14.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.209+0000 7f38b4ff9700 1 -- 172.21.15.123:0/2447630219 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f38ac02d020 con 0x7f38b80bee10 2023-03-08T15:49:14.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.210+0000 7f38be821700 1 -- 172.21.15.123:0/2447630219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b80bee10 msgr2=0x7f38b81d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:14.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.210+0000 7f38be821700 1 --2- 172.21.15.123:0/2447630219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b80bee10 0x7f38b81d1830 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f38ac010860 tx=0x7f38ac010c20 comp rx=0 tx=0).stop 2023-03-08T15:49:14.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.210+0000 7f38be821700 1 -- 172.21.15.123:0/2447630219 shutdown_connections 2023-03-08T15:49:14.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.210+0000 7f38be821700 1 --2- 172.21.15.123:0/2447630219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38b814bf50 0x7f38b81d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.210+0000 7f38be821700 1 --2- 172.21.15.123:0/2447630219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38b80be2a0 0x7f38b814aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.210+0000 7f38be821700 1 --2- 172.21.15.123:0/2447630219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b80bee10 0x7f38b81d1830 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.210+0000 7f38be821700 1 -- 172.21.15.123:0/2447630219 >> 172.21.15.123:0/2447630219 conn(0x7f38b806aee0 msgr2=0x7f38b813ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:14.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.210+0000 7f38be821700 1 -- 172.21.15.123:0/2447630219 shutdown_connections 2023-03-08T15:49:14.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:14.210+0000 7f38be821700 1 -- 172.21.15.123:0/2447630219 wait complete. 2023-03-08T15:49:14.213 INFO:teuthology.orchestra.run.smithi123.stderr:adjusted tunables profile to default 2023-03-08T15:49:14.223 INFO:tasks.ceph:check_enable_crimson: False 2023-03-08T15:49:14.223 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-03-08T15:49:14.223 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:49:14.224 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-03-08T15:49:14.249 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:49:14.249 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-03-08T15:49:14.315 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:49:14.316 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-03-08T15:49:14.381 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-03-08T15:49:14.381 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-03-08T15:49:14.447 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:49:14.447 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-03-08T15:49:14.474 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:49:14.474 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-03-08T15:49:14.540 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:49:14.540 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-03-08T15:49:14.606 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-03-08T15:49:14.607 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-03-08T15:49:14.673 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 8fd40c70-d43e-4434-b1c4-3b90fad2fd47 0 2023-03-08T15:49:14.836 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.834+0000 7fecf5372700 1 Processor -- start 2023-03-08T15:49:14.836 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.834+0000 7fecf5372700 1 -- start start 2023-03-08T15:49:14.838 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.835+0000 7fecf5372700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fecf006fef0 0x7fecf014ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:14.838 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.835+0000 7fecf5372700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf014b6f0 con 0x7fecf0147e50 2023-03-08T15:49:14.838 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.835+0000 7fecf5372700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf006a960 con 0x7fecf014b250 2023-03-08T15:49:14.838 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.835+0000 7fecf5372700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf014a810 con 0x7fecf006fef0 2023-03-08T15:49:14.838 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.835+0000 7fecee7fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fecf006fef0 0x7fecf014ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:14.839 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.835+0000 7fecee7fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fecf006fef0 0x7fecf014ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36352/0 (socket says 172.21.15.175:36352) 2023-03-08T15:49:14.839 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.835+0000 7fecee7fc700 1 -- 172.21.15.175:0/1136908107 learned_addr learned my addr 172.21.15.175:0/1136908107 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-03-08T15:49:14.839 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.836+0000 7fecee7fc700 1 -- 172.21.15.175:0/1136908107 >> v1:172.21.15.175:6789/0 conn(0x7fecf014b250 legacy=0x7fecf0155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:14.839 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.836+0000 7fecee7fc700 1 -- 172.21.15.175:0/1136908107 >> v1:172.21.15.123:6789/0 conn(0x7fecf0147e50 legacy=0x7fecf006a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:14.839 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.836+0000 7fecee7fc700 1 -- 172.21.15.175:0/1136908107 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf0071a40 con 0x7fecf006fef0 2023-03-08T15:49:14.839 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.836+0000 7fecedffb700 1 -- 172.21.15.175:0/1136908107 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092208751 0 0) 0x7fecf014b6f0 con 0x7fecf0147e50 2023-03-08T15:49:14.839 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.836+0000 7fecee7fc700 1 --2- 172.21.15.175:0/1136908107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf006fef0 0x7fecf014ad10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fece40098f0 tx=0x7fece4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f600d09406fbd541 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:14.839 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.836+0000 7fecedffb700 1 -- 172.21.15.175:0/1136908107 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400b8a0 con 0x7fecf006fef0 2023-03-08T15:49:14.840 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.836+0000 7fecedffb700 1 -- 172.21.15.175:0/1136908107 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece400ba00 con 0x7fecf006fef0 2023-03-08T15:49:14.840 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.836+0000 7fecedffb700 1 -- 172.21.15.175:0/1136908107 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400bd90 con 0x7fecf006fef0 2023-03-08T15:49:14.840 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.836+0000 7fecf5372700 1 -- 172.21.15.175:0/1136908107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf006fef0 msgr2=0x7fecf014ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:14.840 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.836+0000 7fecf5372700 1 --2- 172.21.15.175:0/1136908107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf006fef0 0x7fecf014ad10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fece40098f0 tx=0x7fece4009c00 comp rx=0 tx=0).stop 2023-03-08T15:49:14.840 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.836+0000 7fecf5372700 1 -- 172.21.15.175:0/1136908107 shutdown_connections 2023-03-08T15:49:14.840 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.836+0000 7fecf5372700 1 --2- 172.21.15.175:0/1136908107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf006fef0 0x7fecf014ad10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.840 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.836+0000 7fecf5372700 1 -- 172.21.15.175:0/1136908107 >> 172.21.15.175:0/1136908107 conn(0x7fecf006b360 msgr2=0x7fecf006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:14.841 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.836+0000 7fecf5372700 1 -- 172.21.15.175:0/1136908107 shutdown_connections 2023-03-08T15:49:14.841 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.836+0000 7fecf5372700 1 -- 172.21.15.175:0/1136908107 wait complete. 2023-03-08T15:49:14.843 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.838+0000 7fecf5372700 1 Processor -- start 2023-03-08T15:49:14.843 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.838+0000 7fecf5372700 1 -- start start 2023-03-08T15:49:14.843 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.838+0000 7fecf5372700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecf006fef0 0x7fecf01400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:14.843 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.838+0000 7fecf5372700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecf0147e50 0x7fecf00bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:14.843 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.838+0000 7fecf5372700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf014b250 0x7fecf014c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:14.843 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.838+0000 7fecf5372700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf00b4580 con 0x7fecf0147e50 2023-03-08T15:49:14.843 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.838+0000 7fecf5372700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf014dce0 con 0x7fecf014b250 2023-03-08T15:49:14.844 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.838+0000 7fecf5372700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf014dfc0 con 0x7fecf006fef0 2023-03-08T15:49:14.844 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.838+0000 7fecef7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf014b250 0x7fecf014c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:14.844 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.838+0000 7feceeffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecf006fef0 0x7fecf01400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:14.844 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.838+0000 7fecef7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf014b250 0x7fecf014c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36368/0 (socket says 172.21.15.175:36368) 2023-03-08T15:49:14.844 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.838+0000 7fecef7fe700 1 -- 172.21.15.175:0/395613234 learned_addr learned my addr 172.21.15.175:0/395613234 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-03-08T15:49:14.844 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.838+0000 7fecee7fc700 1 --2- 172.21.15.175:0/395613234 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecf0147e50 0x7fecf00bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:14.844 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.839+0000 7feceeffd700 1 -- 172.21.15.175:0/395613234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf014b250 msgr2=0x7fecf014c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:14.845 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.839+0000 7feceeffd700 1 --2- 172.21.15.175:0/395613234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf014b250 0x7fecf014c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.845 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.839+0000 7feceeffd700 1 -- 172.21.15.175:0/395613234 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecf0147e50 msgr2=0x7fecf00bcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:14.845 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.839+0000 7feceeffd700 1 --2- 172.21.15.175:0/395613234 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecf0147e50 0x7fecf00bcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.845 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.839+0000 7feceeffd700 1 -- 172.21.15.175:0/395613234 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece4009550 con 0x7fecf006fef0 2023-03-08T15:49:14.845 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.839+0000 7fecee7fc700 1 --2- 172.21.15.175:0/395613234 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecf0147e50 0x7fecf00bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:14.845 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.839+0000 7fecef7fe700 1 --2- 172.21.15.175:0/395613234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf014b250 0x7fecf014c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:14.845 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.839+0000 7feceeffd700 1 --2- 172.21.15.175:0/395613234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecf006fef0 0x7fecf01400f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fece000c520 tx=0x7fece000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.839+0000 7fecd77fe700 1 -- 172.21.15.175:0/395613234 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece00054e0 con 0x7fecf006fef0 2023-03-08T15:49:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.839+0000 7fecd77fe700 1 -- 172.21.15.175:0/395613234 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece0003680 con 0x7fecf006fef0 2023-03-08T15:49:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.839+0000 7fecf5372700 1 -- 172.21.15.175:0/395613234 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf0072000 con 0x7fecf006fef0 2023-03-08T15:49:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.839+0000 7fecd77fe700 1 -- 172.21.15.175:0/395613234 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0003a30 con 0x7fecf006fef0 2023-03-08T15:49:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.839+0000 7fecf5372700 1 -- 172.21.15.175:0/395613234 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf0071d20 con 0x7fecf006fef0 2023-03-08T15:49:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.839+0000 7fecd77fe700 1 -- 172.21.15.175:0/395613234 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fece0019030 con 0x7fecf006fef0 2023-03-08T15:49:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.839+0000 7fecd77fe700 1 -- 172.21.15.175:0/395613234 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fece001cc70 con 0x7fecf006fef0 2023-03-08T15:49:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.840+0000 7fecf5372700 1 -- 172.21.15.175:0/395613234 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf0148220 con 0x7fecf006fef0 2023-03-08T15:49:14.847 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.842+0000 7fecd77fe700 1 -- 172.21.15.175:0/395613234 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fece0021060 con 0x7fecf006fef0 2023-03-08T15:49:14.926 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.924+0000 7fecf5372700 1 -- 172.21.15.175:0/395613234 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8fd40c70-d43e-4434-b1c4-3b90fad2fd47", "id": 0} v 0) v1 -- 0x7fecf014c440 con 0x7fecf006fef0 2023-03-08T15:49:14.934 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.932+0000 7fecd77fe700 1 -- 172.21.15.175:0/395613234 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8fd40c70-d43e-4434-b1c4-3b90fad2fd47", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fece0017070 con 0x7fecf006fef0 2023-03-08T15:49:14.934 INFO:teuthology.orchestra.run.smithi175.stdout:0 2023-03-08T15:49:14.935 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.933+0000 7fecf5372700 1 -- 172.21.15.175:0/395613234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecf006fef0 msgr2=0x7fecf01400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:14.935 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.933+0000 7fecf5372700 1 --2- 172.21.15.175:0/395613234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecf006fef0 0x7fecf01400f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fece000c520 tx=0x7fece000c830 comp rx=0 tx=0).stop 2023-03-08T15:49:14.935 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.933+0000 7fecf5372700 1 -- 172.21.15.175:0/395613234 shutdown_connections 2023-03-08T15:49:14.935 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.933+0000 7fecf5372700 1 --2- 172.21.15.175:0/395613234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecf014b250 0x7fecf014c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.936 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.933+0000 7fecf5372700 1 --2- 172.21.15.175:0/395613234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecf006fef0 0x7fecf01400f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.936 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.933+0000 7fecf5372700 1 --2- 172.21.15.175:0/395613234 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecf0147e50 0x7fecf00bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:14.936 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.933+0000 7fecf5372700 1 -- 172.21.15.175:0/395613234 >> 172.21.15.175:0/395613234 conn(0x7fecf006b360 msgr2=0x7fecf006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:14.936 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.933+0000 7fecf5372700 1 -- 172.21.15.175:0/395613234 shutdown_connections 2023-03-08T15:49:14.936 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:14.934+0000 7fecf5372700 1 -- 172.21.15.175:0/395613234 wait complete. 2023-03-08T15:49:14.947 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new bec1799b-fafb-4479-bc98-75096068107f 1 2023-03-08T15:49:15.027 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:15.026+0000 7f5c5a71a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-08T15:49:15.066 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.064+0000 7f2bd2820700 1 Processor -- start 2023-03-08T15:49:15.066 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.064+0000 7f2bd2820700 1 -- start start 2023-03-08T15:49:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.065+0000 7f2bd2820700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bcc1449b0 0x7f2bcc0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.065+0000 7f2bd2820700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2bcc0726b0 0x7f2bcc0711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.068 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.065+0000 7f2bd2820700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2bcc0b5200 0x7f2bcc14dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.068 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.065+0000 7f2bd2820700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bcc14a6a0 con 0x7f2bcc0b5200 2023-03-08T15:49:15.068 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.065+0000 7f2bd2820700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bcc14b650 con 0x7f2bcc0726b0 2023-03-08T15:49:15.068 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.065+0000 7f2bd2820700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc0b4e50 con 0x7f2bcc1449b0 2023-03-08T15:49:15.068 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.065+0000 7f2bcbfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bcc1449b0 0x7f2bcc0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.068 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.065+0000 7f2bcb7fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2bcc0726b0 0x7f2bcc0711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.068 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.065+0000 7f2bcbfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bcc1449b0 0x7f2bcc0b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:58118/0 (socket says 172.21.15.175:58118) 2023-03-08T15:49:15.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.065+0000 7f2bcb7fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2bcc0726b0 0x7f2bcc0711b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36376/0 (socket says 172.21.15.175:36376) 2023-03-08T15:49:15.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.065+0000 7f2bcbfff700 1 -- 172.21.15.175:0/947853921 learned_addr learned my addr 172.21.15.175:0/947853921 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-03-08T15:49:15.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.065+0000 7f2bd0dbd700 1 --2- 172.21.15.175:0/947853921 >> v2:172.21.15.123:3300/0 conn(0x7f2bcc0b5200 0x7f2bcc14dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bcb7fe700 1 -- 172.21.15.175:0/947853921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bcc1449b0 msgr2=0x7f2bcc0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:15.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bcb7fe700 1 --2- 172.21.15.175:0/947853921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bcc1449b0 0x7f2bcc0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bcb7fe700 1 -- 172.21.15.175:0/947853921 >> v2:172.21.15.123:3300/0 conn(0x7f2bcc0b5200 msgr2=0x7f2bcc14dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:15.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bcb7fe700 1 --2- 172.21.15.175:0/947853921 >> v2:172.21.15.123:3300/0 conn(0x7f2bcc0b5200 0x7f2bcc14dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.070 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bcb7fe700 1 -- 172.21.15.175:0/947853921 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bcc144d80 con 0x7f2bcc0726b0 2023-03-08T15:49:15.070 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bcbfff700 1 --2- 172.21.15.175:0/947853921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bcc1449b0 0x7f2bcc0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:15.070 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bcb7fe700 1 --2- 172.21.15.175:0/947853921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bcc0726b0 0x7f2bcc0711b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0bb0d0 tx=0x7f2bc0009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6adab5cbce41652c server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:15.070 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bcaffd700 1 -- 172.21.15.175:0/947853921 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0011830 con 0x7f2bcc0726b0 2023-03-08T15:49:15.070 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bcaffd700 1 -- 172.21.15.175:0/947853921 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc0011990 con 0x7f2bcc0726b0 2023-03-08T15:49:15.070 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bcaffd700 1 -- 172.21.15.175:0/947853921 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0011d20 con 0x7f2bcc0726b0 2023-03-08T15:49:15.072 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bd2820700 1 -- 172.21.15.175:0/947853921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bcc0726b0 msgr2=0x7f2bcc0711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.072 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bd2820700 1 --2- 172.21.15.175:0/947853921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bcc0726b0 0x7f2bcc0711b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0bb0d0 tx=0x7f2bc0009b20 comp rx=0 tx=0).stop 2023-03-08T15:49:15.073 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bd2820700 1 -- 172.21.15.175:0/947853921 shutdown_connections 2023-03-08T15:49:15.073 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bd2820700 1 --2- 172.21.15.175:0/947853921 >> v2:172.21.15.123:3300/0 conn(0x7f2bcc0b5200 0x7f2bcc14dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.073 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bd2820700 1 --2- 172.21.15.175:0/947853921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bcc1449b0 0x7f2bcc0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.073 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bd2820700 1 --2- 172.21.15.175:0/947853921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bcc0726b0 0x7f2bcc0711b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.073 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.066+0000 7f2bd2820700 1 -- 172.21.15.175:0/947853921 >> 172.21.15.175:0/947853921 conn(0x7f2bcc0be6f0 msgr2=0x7f2bcc0beac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:15.073 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.067+0000 7f2bd2820700 1 -- 172.21.15.175:0/947853921 shutdown_connections 2023-03-08T15:49:15.073 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.067+0000 7f2bd2820700 1 -- 172.21.15.175:0/947853921 wait complete. 2023-03-08T15:49:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.068+0000 7f2bd2820700 1 Processor -- start 2023-03-08T15:49:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.068+0000 7f2bd2820700 1 -- start start 2023-03-08T15:49:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bd2820700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bcc0726b0 0x7f2bcc0b9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bd2820700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bcc0b5200 0x7f2bcc1e37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bd2820700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bcc1449b0 0x7f2bcc1e3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bd2820700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc0b9b60 con 0x7f2bcc0b5200 2023-03-08T15:49:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bd2820700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc06d480 con 0x7f2bcc0726b0 2023-03-08T15:49:15.075 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bd2820700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc0b5ee0 con 0x7f2bcc1449b0 2023-03-08T15:49:15.075 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bcbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bcc0726b0 0x7f2bcc0b9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.075 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bd0dbd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bcc1449b0 0x7f2bcc1e3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.075 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bcbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bcc0726b0 0x7f2bcc0b9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36392/0 (socket says 172.21.15.175:36392) 2023-03-08T15:49:15.075 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bcbfff700 1 -- 172.21.15.175:0/175649822 learned_addr learned my addr 172.21.15.175:0/175649822 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-03-08T15:49:15.075 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bd0dbd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bcc1449b0 0x7f2bcc1e3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:58132/0 (socket says 172.21.15.175:58132) 2023-03-08T15:49:15.075 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bcb7fe700 1 --2- 172.21.15.175:0/175649822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bcc0b5200 0x7f2bcc1e37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.075 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bcbfff700 1 -- 172.21.15.175:0/175649822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bcc1449b0 msgr2=0x7f2bcc1e3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.076 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bcbfff700 1 --2- 172.21.15.175:0/175649822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bcc1449b0 0x7f2bcc1e3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.076 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bcbfff700 1 -- 172.21.15.175:0/175649822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bcc0b5200 msgr2=0x7f2bcc1e37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.076 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bcbfff700 1 --2- 172.21.15.175:0/175649822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bcc0b5200 0x7f2bcc1e37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.076 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bcbfff700 1 -- 172.21.15.175:0/175649822 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc009550 con 0x7f2bcc0726b0 2023-03-08T15:49:15.076 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bcb7fe700 1 --2- 172.21.15.175:0/175649822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bcc0b5200 0x7f2bcc1e37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:15.076 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.069+0000 7f2bcbfff700 1 --2- 172.21.15.175:0/175649822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bcc0726b0 0x7f2bcc0b9620 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00e9e0 tx=0x7f2bbc00ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:15.076 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.070+0000 7f2bc8ff9700 1 -- 172.21.15.175:0/175649822 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc00ee80 con 0x7f2bcc0726b0 2023-03-08T15:49:15.077 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.070+0000 7f2bc8ff9700 1 -- 172.21.15.175:0/175649822 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc00c850 con 0x7f2bcc0726b0 2023-03-08T15:49:15.077 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.070+0000 7f2bd2820700 1 -- 172.21.15.175:0/175649822 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc00094a0 con 0x7f2bcc0726b0 2023-03-08T15:49:15.077 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.070+0000 7f2bc8ff9700 1 -- 172.21.15.175:0/175649822 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc00cbc0 con 0x7f2bcc0726b0 2023-03-08T15:49:15.077 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.070+0000 7f2bd2820700 1 -- 172.21.15.175:0/175649822 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bcc14ab70 con 0x7f2bcc0726b0 2023-03-08T15:49:15.077 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.070+0000 7f2bc8ff9700 1 -- 172.21.15.175:0/175649822 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f2bbc019030 con 0x7f2bcc0726b0 2023-03-08T15:49:15.077 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.070+0000 7f2bc8ff9700 1 -- 172.21.15.175:0/175649822 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f2bbc0065e0 con 0x7f2bcc0726b0 2023-03-08T15:49:15.077 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.071+0000 7f2bd2820700 1 -- 172.21.15.175:0/175649822 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bcc14a890 con 0x7f2bcc0726b0 2023-03-08T15:49:15.078 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.074+0000 7f2bc8ff9700 1 -- 172.21.15.175:0/175649822 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f2bbc021060 con 0x7f2bcc0726b0 2023-03-08T15:49:15.097 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:15.096+0000 7f5c5a71a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-08T15:49:15.160 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.159+0000 7f2bd2820700 1 -- 172.21.15.175:0/175649822 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bec1799b-fafb-4479-bc98-75096068107f", "id": 1} v 0) v1 -- 0x7f2bcc14ae50 con 0x7f2bcc0726b0 2023-03-08T15:49:15.167 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.166+0000 7f2bc8ff9700 1 -- 172.21.15.175:0/175649822 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bec1799b-fafb-4479-bc98-75096068107f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2bbc017070 con 0x7f2bcc0726b0 2023-03-08T15:49:15.168 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-03-08T15:49:15.169 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.167+0000 7f2bd2820700 1 -- 172.21.15.175:0/175649822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bcc0726b0 msgr2=0x7f2bcc0b9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.169 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.167+0000 7f2bd2820700 1 --2- 172.21.15.175:0/175649822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bcc0726b0 0x7f2bcc0b9620 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00e9e0 tx=0x7f2bbc00ecf0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.169 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.167+0000 7f2bd2820700 1 -- 172.21.15.175:0/175649822 shutdown_connections 2023-03-08T15:49:15.169 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.167+0000 7f2bd2820700 1 --2- 172.21.15.175:0/175649822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bcc1449b0 0x7f2bcc1e3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.169 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.167+0000 7f2bd2820700 1 --2- 172.21.15.175:0/175649822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bcc0726b0 0x7f2bcc0b9620 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.170 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.167+0000 7f2bd2820700 1 --2- 172.21.15.175:0/175649822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bcc0b5200 0x7f2bcc1e37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.170 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.167+0000 7f2bd2820700 1 -- 172.21.15.175:0/175649822 >> 172.21.15.175:0/175649822 conn(0x7f2bcc0be6f0 msgr2=0x7f2bcc148dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:15.170 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.167+0000 7f2bd2820700 1 -- 172.21.15.175:0/175649822 shutdown_connections 2023-03-08T15:49:15.170 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.167+0000 7f2bd2820700 1 -- 172.21.15.175:0/175649822 wait complete. 2023-03-08T15:49:15.180 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 0330f8e5-4001-448b-8337-eb5d166bd58b 2 2023-03-08T15:49:15.200 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:15.199+0000 7f5c5a71a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-08T15:49:15.303 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.302+0000 7f251fdc9700 1 Processor -- start 2023-03-08T15:49:15.304 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.302+0000 7f251fdc9700 1 -- start start 2023-03-08T15:49:15.305 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251fdc9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f25180b5200 0x7f2518156010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.305 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251fdc9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25180b4e50 con 0x7f25181449b0 2023-03-08T15:49:15.305 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251fdc9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25180b3ca0 con 0x7f25180726b0 2023-03-08T15:49:15.305 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251fdc9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251814a6a0 con 0x7f25180b5200 2023-03-08T15:49:15.306 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251d364700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f25180726b0 0x7f25180711b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:32988/0 (socket says 172.21.15.175:32988) 2023-03-08T15:49:15.306 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251d364700 1 -- 172.21.15.175:0/3398686581 learned_addr learned my addr 172.21.15.175:0/3398686581 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-03-08T15:49:15.306 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251e366700 1 --2- 172.21.15.175:0/3398686581 >> v2:172.21.15.175:3300/0 conn(0x7f25180b5200 0x7f2518156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.306 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251cb63700 1 -- 172.21.15.175:0/3398686581 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157518463 0 0) 0x7f25180b3ca0 con 0x7f25180726b0 2023-03-08T15:49:15.306 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251cb63700 1 -- 172.21.15.175:0/3398686581 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25040035b0 con 0x7f25180726b0 2023-03-08T15:49:15.306 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251cb63700 1 -- 172.21.15.175:0/3398686581 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2778791770 0 0) 0x7f25180b4e50 con 0x7f25181449b0 2023-03-08T15:49:15.306 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251cb63700 1 -- 172.21.15.175:0/3398686581 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25180b3ca0 con 0x7f25181449b0 2023-03-08T15:49:15.307 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251e366700 1 -- 172.21.15.175:0/3398686581 >> v1:172.21.15.175:6789/0 conn(0x7f25180726b0 legacy=0x7f25180711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.307 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251e366700 1 -- 172.21.15.175:0/3398686581 >> v1:172.21.15.123:6789/0 conn(0x7f25181449b0 legacy=0x7f25180b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.307 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251e366700 1 -- 172.21.15.175:0/3398686581 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518144d80 con 0x7f25180b5200 2023-03-08T15:49:15.307 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251e366700 1 --2- 172.21.15.175:0/3398686581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25180b5200 0x7f2518156010 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2510009d90 tx=0x7f251000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d934b1143fdc1cb7 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:15.307 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.303+0000 7f251cb63700 1 -- 172.21.15.175:0/3398686581 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251000e070 con 0x7f25180b5200 2023-03-08T15:49:15.307 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.304+0000 7f251cb63700 1 -- 172.21.15.175:0/3398686581 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251000bb20 con 0x7f25180b5200 2023-03-08T15:49:15.307 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.304+0000 7f251cb63700 1 -- 172.21.15.175:0/3398686581 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510012430 con 0x7f25180b5200 2023-03-08T15:49:15.309 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.304+0000 7f251fdc9700 1 -- 172.21.15.175:0/3398686581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25180b5200 msgr2=0x7f2518156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.304+0000 7f251fdc9700 1 --2- 172.21.15.175:0/3398686581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25180b5200 0x7f2518156010 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2510009d90 tx=0x7f251000b330 comp rx=0 tx=0).stop 2023-03-08T15:49:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.304+0000 7f251fdc9700 1 -- 172.21.15.175:0/3398686581 shutdown_connections 2023-03-08T15:49:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.304+0000 7f251fdc9700 1 --2- 172.21.15.175:0/3398686581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25180b5200 0x7f2518156010 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.304+0000 7f251fdc9700 1 -- 172.21.15.175:0/3398686581 >> 172.21.15.175:0/3398686581 conn(0x7f25180be6f0 msgr2=0x7f25180beac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.304+0000 7f251fdc9700 1 -- 172.21.15.175:0/3398686581 shutdown_connections 2023-03-08T15:49:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.304+0000 7f251fdc9700 1 -- 172.21.15.175:0/3398686581 wait complete. 2023-03-08T15:49:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.305+0000 7f251fdc9700 1 Processor -- start 2023-03-08T15:49:15.311 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.305+0000 7f251fdc9700 1 -- start start 2023-03-08T15:49:15.311 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251fdc9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25180726b0 0x7f251806cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.311 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251fdc9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25180b5200 0x7f25180a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.311 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251fdc9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25181449b0 0x7f2518142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.311 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251fdc9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25180b8dd0 con 0x7f25180b5200 2023-03-08T15:49:15.311 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251fdc9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251806d290 con 0x7f25181449b0 2023-03-08T15:49:15.311 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251fdc9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251806dbc0 con 0x7f25180726b0 2023-03-08T15:49:15.311 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251db65700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25180726b0 0x7f251806cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.312 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251e366700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25181449b0 0x7f2518142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.312 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251db65700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25180726b0 0x7f251806cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:58144/0 (socket says 172.21.15.175:58144) 2023-03-08T15:49:15.312 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251d364700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25180b5200 0x7f25180a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.312 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251db65700 1 -- 172.21.15.175:0/1213822733 learned_addr learned my addr 172.21.15.175:0/1213822733 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-03-08T15:49:15.312 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251db65700 1 -- 172.21.15.175:0/1213822733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25181449b0 msgr2=0x7f2518142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.312 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251db65700 1 --2- 172.21.15.175:0/1213822733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25181449b0 0x7f2518142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.312 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251db65700 1 -- 172.21.15.175:0/1213822733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25180b5200 msgr2=0x7f25180a2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.312 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251db65700 1 --2- 172.21.15.175:0/1213822733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25180b5200 0x7f25180a2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.313 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251db65700 1 -- 172.21.15.175:0/1213822733 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2510009a70 con 0x7f25180726b0 2023-03-08T15:49:15.313 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251e366700 1 --2- 172.21.15.175:0/1213822733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25181449b0 0x7f2518142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:15.313 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.306+0000 7f251db65700 1 --2- 172.21.15.175:0/1213822733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25180726b0 0x7f251806cd50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f251400c560 tx=0x7f251400c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:15.313 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.307+0000 7f250e7fc700 1 -- 172.21.15.175:0/1213822733 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25140052d0 con 0x7f25180726b0 2023-03-08T15:49:15.313 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.307+0000 7f250e7fc700 1 -- 172.21.15.175:0/1213822733 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400ce90 con 0x7f25180726b0 2023-03-08T15:49:15.313 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.307+0000 7f251fdc9700 1 -- 172.21.15.175:0/1213822733 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251814ab70 con 0x7f25180726b0 2023-03-08T15:49:15.313 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.307+0000 7f250e7fc700 1 -- 172.21.15.175:0/1213822733 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514003680 con 0x7f25180726b0 2023-03-08T15:49:15.314 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.307+0000 7f251fdc9700 1 -- 172.21.15.175:0/1213822733 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251814a890 con 0x7f25180726b0 2023-03-08T15:49:15.314 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.307+0000 7f250e7fc700 1 -- 172.21.15.175:0/1213822733 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f2514019030 con 0x7f25180726b0 2023-03-08T15:49:15.314 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.307+0000 7f250e7fc700 1 -- 172.21.15.175:0/1213822733 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f2514011b40 con 0x7f25180726b0 2023-03-08T15:49:15.314 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.308+0000 7f251fdc9700 1 -- 172.21.15.175:0/1213822733 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251814ae50 con 0x7f25180726b0 2023-03-08T15:49:15.314 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.310+0000 7f250e7fc700 1 -- 172.21.15.175:0/1213822733 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f2514017070 con 0x7f25180726b0 2023-03-08T15:49:15.384 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:15.383+0000 7f5c5a71a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-08T15:49:15.403 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.402+0000 7f251fdc9700 1 -- 172.21.15.175:0/1213822733 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0330f8e5-4001-448b-8337-eb5d166bd58b", "id": 2} v 0) v1 -- 0x7f251806d9e0 con 0x7f25180726b0 2023-03-08T15:49:15.411 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.410+0000 7f250e7fc700 1 -- 172.21.15.175:0/1213822733 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0330f8e5-4001-448b-8337-eb5d166bd58b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2514011720 con 0x7f25180726b0 2023-03-08T15:49:15.411 INFO:teuthology.orchestra.run.smithi175.stdout:2 2023-03-08T15:49:15.412 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.411+0000 7f251fdc9700 1 -- 172.21.15.175:0/1213822733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25180726b0 msgr2=0x7f251806cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.412 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.411+0000 7f251fdc9700 1 --2- 172.21.15.175:0/1213822733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25180726b0 0x7f251806cd50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f251400c560 tx=0x7f251400c870 comp rx=0 tx=0).stop 2023-03-08T15:49:15.412 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.411+0000 7f251fdc9700 1 -- 172.21.15.175:0/1213822733 shutdown_connections 2023-03-08T15:49:15.413 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.411+0000 7f251fdc9700 1 --2- 172.21.15.175:0/1213822733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25181449b0 0x7f2518142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.413 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.411+0000 7f251fdc9700 1 --2- 172.21.15.175:0/1213822733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25180726b0 0x7f251806cd50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.413 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.411+0000 7f251fdc9700 1 --2- 172.21.15.175:0/1213822733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25180b5200 0x7f25180a2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.413 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.411+0000 7f251fdc9700 1 -- 172.21.15.175:0/1213822733 >> 172.21.15.175:0/1213822733 conn(0x7f25180be6f0 msgr2=0x7f25180bd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:15.413 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.411+0000 7f251fdc9700 1 -- 172.21.15.175:0/1213822733 shutdown_connections 2023-03-08T15:49:15.413 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.411+0000 7f251fdc9700 1 -- 172.21.15.175:0/1213822733 wait complete. 2023-03-08T15:49:15.423 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 9706b3c9-3521-4f32-9cd9-2a672751b830 3 2023-03-08T15:49:15.428 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:15.427+0000 7f399650f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-08T15:49:15.503 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:15.501+0000 7f399650f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-08T15:49:15.544 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.543+0000 7f5b4186d700 1 Processor -- start 2023-03-08T15:49:15.544 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.543+0000 7f5b4186d700 1 -- start start 2023-03-08T15:49:15.545 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.543+0000 7f5b4186d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5b3c147e50 0x7f5b3c06a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.546 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.543+0000 7f5b4186d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b3c14b420 0x7f5b3c155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.546 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.543+0000 7f5b4186d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c14a810 con 0x7f5b3c06fef0 2023-03-08T15:49:15.546 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.543+0000 7f5b4186d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3c071a40 con 0x7f5b3c147e50 2023-03-08T15:49:15.546 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.543+0000 7f5b4186d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c071d20 con 0x7f5b3c14b420 2023-03-08T15:49:15.546 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.543+0000 7f5b3b7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b3c14b420 0x7f5b3c155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.546 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.543+0000 7f5b3b7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b3c14b420 0x7f5b3c155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:58152/0 (socket says 172.21.15.175:58152) 2023-03-08T15:49:15.546 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.543+0000 7f5b3b7fe700 1 -- 172.21.15.175:0/322463450 learned_addr learned my addr 172.21.15.175:0/322463450 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-03-08T15:49:15.547 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.543+0000 7f5b3affd700 1 --2- 172.21.15.175:0/322463450 >> v2:172.21.15.123:3300/0 conn(0x7f5b3c147e50 0x7f5b3c06a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.547 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.544+0000 7f5b3b7fe700 1 -- 172.21.15.175:0/322463450 >> v2:172.21.15.123:3300/0 conn(0x7f5b3c147e50 msgr2=0x7f5b3c06a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:15.547 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.544+0000 7f5b3b7fe700 1 --2- 172.21.15.175:0/322463450 >> v2:172.21.15.123:3300/0 conn(0x7f5b3c147e50 0x7f5b3c06a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.547 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.544+0000 7f5b3b7fe700 1 -- 172.21.15.175:0/322463450 >> v1:172.21.15.123:6789/0 conn(0x7f5b3c06fef0 legacy=0x7f5b3c14ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.547 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.544+0000 7f5b3b7fe700 1 -- 172.21.15.175:0/322463450 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c072000 con 0x7f5b3c14b420 2023-03-08T15:49:15.547 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.544+0000 7f5b3b7fe700 1 --2- 172.21.15.175:0/322463450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b3c14b420 0x7f5b3c155040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009e50 tx=0x7f5b3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f8e838ecc85ff6c server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:15.547 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.544+0000 7f5b39ffb700 1 -- 172.21.15.175:0/322463450 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3400e070 con 0x7f5b3c14b420 2023-03-08T15:49:15.548 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.544+0000 7f5b39ffb700 1 -- 172.21.15.175:0/322463450 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3400b910 con 0x7f5b3c14b420 2023-03-08T15:49:15.548 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.544+0000 7f5b39ffb700 1 -- 172.21.15.175:0/322463450 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3400bcc0 con 0x7f5b3c14b420 2023-03-08T15:49:15.550 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.545+0000 7f5b4186d700 1 -- 172.21.15.175:0/322463450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b3c14b420 msgr2=0x7f5b3c155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.550 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.545+0000 7f5b4186d700 1 --2- 172.21.15.175:0/322463450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b3c14b420 0x7f5b3c155040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009e50 tx=0x7f5b3400b330 comp rx=0 tx=0).stop 2023-03-08T15:49:15.550 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.545+0000 7f5b4186d700 1 -- 172.21.15.175:0/322463450 shutdown_connections 2023-03-08T15:49:15.550 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.545+0000 7f5b4186d700 1 --2- 172.21.15.175:0/322463450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b3c14b420 0x7f5b3c155040 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.551 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.545+0000 7f5b4186d700 1 --2- 172.21.15.175:0/322463450 >> v2:172.21.15.123:3300/0 conn(0x7f5b3c147e50 0x7f5b3c06a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.551 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.545+0000 7f5b4186d700 1 -- 172.21.15.175:0/322463450 >> 172.21.15.175:0/322463450 conn(0x7f5b3c06b360 msgr2=0x7f5b3c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:15.551 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.545+0000 7f5b4186d700 1 -- 172.21.15.175:0/322463450 shutdown_connections 2023-03-08T15:49:15.551 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.545+0000 7f5b4186d700 1 -- 172.21.15.175:0/322463450 wait complete. 2023-03-08T15:49:15.551 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.546+0000 7f5b4186d700 1 Processor -- start 2023-03-08T15:49:15.551 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.546+0000 7f5b4186d700 1 -- start start 2023-03-08T15:49:15.551 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.546+0000 7f5b4186d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3c06fef0 0x7f5b3c1468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.552 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.546+0000 7f5b4186d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b3c147e50 0x7f5b3c13eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.552 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.546+0000 7f5b4186d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b3c14b420 0x7f5b3c1e33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.552 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.546+0000 7f5b4186d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c146e20 con 0x7f5b3c147e50 2023-03-08T15:49:15.552 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.546+0000 7f5b4186d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c13f410 con 0x7f5b3c06fef0 2023-03-08T15:49:15.552 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.546+0000 7f5b4186d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0bd800 con 0x7f5b3c14b420 2023-03-08T15:49:15.552 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b3affd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3c06fef0 0x7f5b3c1468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.552 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b3b7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b3c14b420 0x7f5b3c1e33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.552 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b3affd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3c06fef0 0x7f5b3c1468e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36420/0 (socket says 172.21.15.175:36420) 2023-03-08T15:49:15.553 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b3affd700 1 -- 172.21.15.175:0/452051323 learned_addr learned my addr 172.21.15.175:0/452051323 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-03-08T15:49:15.553 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b3a7fc700 1 --2- 172.21.15.175:0/452051323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b3c147e50 0x7f5b3c13eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.553 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b3affd700 1 -- 172.21.15.175:0/452051323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b3c14b420 msgr2=0x7f5b3c1e33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.553 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b3affd700 1 --2- 172.21.15.175:0/452051323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b3c14b420 0x7f5b3c1e33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.553 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b3affd700 1 -- 172.21.15.175:0/452051323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b3c147e50 msgr2=0x7f5b3c13eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.553 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b3affd700 1 --2- 172.21.15.175:0/452051323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b3c147e50 0x7f5b3c13eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.553 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b3affd700 1 -- 172.21.15.175:0/452051323 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b34009b30 con 0x7f5b3c06fef0 2023-03-08T15:49:15.554 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b3b7fe700 1 --2- 172.21.15.175:0/452051323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b3c14b420 0x7f5b3c1e33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:15.554 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b3affd700 1 --2- 172.21.15.175:0/452051323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3c06fef0 0x7f5b3c1468e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00e9b0 tx=0x7f5b2c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:15.554 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b23fff700 1 -- 172.21.15.175:0/452051323 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c009710 con 0x7f5b3c06fef0 2023-03-08T15:49:15.554 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b23fff700 1 -- 172.21.15.175:0/452051323 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c00ee50 con 0x7f5b3c06fef0 2023-03-08T15:49:15.554 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b23fff700 1 -- 172.21.15.175:0/452051323 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c00ca50 con 0x7f5b3c06fef0 2023-03-08T15:49:15.554 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b4186d700 1 -- 172.21.15.175:0/452051323 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c0728f0 con 0x7f5b3c06fef0 2023-03-08T15:49:15.554 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b4186d700 1 -- 172.21.15.175:0/452051323 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c148220 con 0x7f5b3c06fef0 2023-03-08T15:49:15.554 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b23fff700 1 -- 172.21.15.175:0/452051323 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f5b2c019030 con 0x7f5b3c06fef0 2023-03-08T15:49:15.555 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.547+0000 7f5b23fff700 1 -- 172.21.15.175:0/452051323 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f5b2c006640 con 0x7f5b3c06fef0 2023-03-08T15:49:15.555 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.548+0000 7f5b4186d700 1 -- 172.21.15.175:0/452051323 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c0b45f0 con 0x7f5b3c06fef0 2023-03-08T15:49:15.555 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.550+0000 7f5b23fff700 1 -- 172.21.15.175:0/452051323 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f5b2c021060 con 0x7f5b3c06fef0 2023-03-08T15:49:15.597 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:15.596+0000 7f399650f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-08T15:49:15.633 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.632+0000 7f5b4186d700 1 -- 172.21.15.175:0/452051323 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9706b3c9-3521-4f32-9cd9-2a672751b830", "id": 3} v 0) v1 -- 0x7f5b3c0744c0 con 0x7f5b3c06fef0 2023-03-08T15:49:15.639 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.637+0000 7f5b23fff700 1 -- 172.21.15.175:0/452051323 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9706b3c9-3521-4f32-9cd9-2a672751b830", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5b2c017070 con 0x7f5b3c06fef0 2023-03-08T15:49:15.639 INFO:teuthology.orchestra.run.smithi175.stdout:3 2023-03-08T15:49:15.640 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.638+0000 7f5b4186d700 1 -- 172.21.15.175:0/452051323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3c06fef0 msgr2=0x7f5b3c1468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.640 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.638+0000 7f5b4186d700 1 --2- 172.21.15.175:0/452051323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3c06fef0 0x7f5b3c1468e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00e9b0 tx=0x7f5b2c00ecc0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.640 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.638+0000 7f5b4186d700 1 -- 172.21.15.175:0/452051323 shutdown_connections 2023-03-08T15:49:15.640 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.638+0000 7f5b4186d700 1 --2- 172.21.15.175:0/452051323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b3c14b420 0x7f5b3c1e33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.641 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.638+0000 7f5b4186d700 1 --2- 172.21.15.175:0/452051323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3c06fef0 0x7f5b3c1468e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.641 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.638+0000 7f5b4186d700 1 --2- 172.21.15.175:0/452051323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b3c147e50 0x7f5b3c13eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.641 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.638+0000 7f5b4186d700 1 -- 172.21.15.175:0/452051323 >> 172.21.15.175:0/452051323 conn(0x7f5b3c06b360 msgr2=0x7f5b3c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:15.641 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.638+0000 7f5b4186d700 1 -- 172.21.15.175:0/452051323 shutdown_connections 2023-03-08T15:49:15.641 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.638+0000 7f5b4186d700 1 -- 172.21.15.175:0/452051323 wait complete. 2023-03-08T15:49:15.652 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 8677c2aa-a97f-4594-8a3d-bcc3c3eea244 4 2023-03-08T15:49:15.792 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:15.790+0000 7f399650f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-08T15:49:15.813 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.811+0000 7fd876df6700 1 Processor -- start 2023-03-08T15:49:15.813 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.811+0000 7fd876df6700 1 -- start start 2023-03-08T15:49:15.814 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.812+0000 7fd876df6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8700ba280 0x7fd87006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.814 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.812+0000 7fd876df6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd870070670 con 0x7fd870072760 2023-03-08T15:49:15.814 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.812+0000 7fd876df6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd870070c50 con 0x7fd870071df0 2023-03-08T15:49:15.814 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.812+0000 7fd876df6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd870070a40 con 0x7fd8700ba280 2023-03-08T15:49:15.815 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.812+0000 7fd874b92700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8700ba280 0x7fd87006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.815 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.812+0000 7fd875393700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd870071df0 0x7fd87014aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:32996/0 (socket says 172.21.15.175:32996) 2023-03-08T15:49:15.815 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.812+0000 7fd875393700 1 -- 172.21.15.175:0/2615311918 learned_addr learned my addr 172.21.15.175:0/2615311918 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-03-08T15:49:15.815 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.812+0000 7fd86f7fe700 1 -- 172.21.15.175:0/2615311918 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089327113 0 0) 0x7fd870070c50 con 0x7fd870071df0 2023-03-08T15:49:15.815 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.812+0000 7fd86f7fe700 1 -- 172.21.15.175:0/2615311918 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8600035b0 con 0x7fd870071df0 2023-03-08T15:49:15.815 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.812+0000 7fd874b92700 1 -- 172.21.15.175:0/2615311918 >> v1:172.21.15.175:6789/0 conn(0x7fd870071df0 legacy=0x7fd87014aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.815 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.812+0000 7fd874b92700 1 -- 172.21.15.175:0/2615311918 >> v1:172.21.15.123:6789/0 conn(0x7fd870072760 legacy=0x7fd870141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.816 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.812+0000 7fd874b92700 1 -- 172.21.15.175:0/2615311918 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8700ba650 con 0x7fd8700ba280 2023-03-08T15:49:15.816 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.812+0000 7fd874b92700 1 --2- 172.21.15.175:0/2615311918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8700ba280 0x7fd87006fff0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd864009870 tx=0x7fd864009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e5572b4be668a8f server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:15.816 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.813+0000 7fd86f7fe700 1 -- 172.21.15.175:0/2615311918 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd864011830 con 0x7fd8700ba280 2023-03-08T15:49:15.816 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.813+0000 7fd86f7fe700 1 -- 172.21.15.175:0/2615311918 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd864011990 con 0x7fd8700ba280 2023-03-08T15:49:15.816 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.813+0000 7fd86f7fe700 1 -- 172.21.15.175:0/2615311918 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd864011d20 con 0x7fd8700ba280 2023-03-08T15:49:15.818 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.813+0000 7fd876df6700 1 -- 172.21.15.175:0/2615311918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8700ba280 msgr2=0x7fd87006fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.818 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.813+0000 7fd876df6700 1 --2- 172.21.15.175:0/2615311918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8700ba280 0x7fd87006fff0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd864009870 tx=0x7fd864009b80 comp rx=0 tx=0).stop 2023-03-08T15:49:15.819 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.813+0000 7fd876df6700 1 -- 172.21.15.175:0/2615311918 shutdown_connections 2023-03-08T15:49:15.819 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.813+0000 7fd876df6700 1 --2- 172.21.15.175:0/2615311918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8700ba280 0x7fd87006fff0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.819 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.813+0000 7fd876df6700 1 -- 172.21.15.175:0/2615311918 >> 172.21.15.175:0/2615311918 conn(0x7fd87006b360 msgr2=0x7fd87006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:15.819 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.813+0000 7fd876df6700 1 -- 172.21.15.175:0/2615311918 shutdown_connections 2023-03-08T15:49:15.819 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.813+0000 7fd876df6700 1 -- 172.21.15.175:0/2615311918 wait complete. 2023-03-08T15:49:15.819 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.815+0000 7fd876df6700 1 Processor -- start 2023-03-08T15:49:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.815+0000 7fd876df6700 1 -- start start 2023-03-08T15:49:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd876df6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd870071df0 0x7fd87006a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd876df6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8700ba280 0x7fd8700b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd876df6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8700b75c0 0x7fd8700b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd876df6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87006aa00 con 0x7fd870071df0 2023-03-08T15:49:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd876df6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700b5a20 con 0x7fd8700b75c0 2023-03-08T15:49:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd876df6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700b64e0 con 0x7fd8700ba280 2023-03-08T15:49:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd86ffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8700ba280 0x7fd8700b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.821 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd875393700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8700b75c0 0x7fd8700b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.821 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd86ffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8700ba280 0x7fd8700b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:58188/0 (socket says 172.21.15.175:58188) 2023-03-08T15:49:15.821 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd86ffff700 1 -- 172.21.15.175:0/2850523019 learned_addr learned my addr 172.21.15.175:0/2850523019 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-03-08T15:49:15.821 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd874b92700 1 --2- 172.21.15.175:0/2850523019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd870071df0 0x7fd87006a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:15.821 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd86ffff700 1 -- 172.21.15.175:0/2850523019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8700b75c0 msgr2=0x7fd8700b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.821 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd86ffff700 1 --2- 172.21.15.175:0/2850523019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8700b75c0 0x7fd8700b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.821 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd86ffff700 1 -- 172.21.15.175:0/2850523019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd870071df0 msgr2=0x7fd87006a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.822 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd86ffff700 1 --2- 172.21.15.175:0/2850523019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd870071df0 0x7fd87006a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.822 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd86ffff700 1 -- 172.21.15.175:0/2850523019 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8640094a0 con 0x7fd8700ba280 2023-03-08T15:49:15.822 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd86ffff700 1 --2- 172.21.15.175:0/2850523019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8700ba280 0x7fd8700b48e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00c4e0 tx=0x7fd85c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:15.822 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd86d7fa700 1 -- 172.21.15.175:0/2850523019 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c0052d0 con 0x7fd8700ba280 2023-03-08T15:49:15.822 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd86d7fa700 1 -- 172.21.15.175:0/2850523019 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c005430 con 0x7fd8700ba280 2023-03-08T15:49:15.822 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd876df6700 1 -- 172.21.15.175:0/2850523019 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd870141d20 con 0x7fd8700ba280 2023-03-08T15:49:15.822 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd86d7fa700 1 -- 172.21.15.175:0/2850523019 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c0038c0 con 0x7fd8700ba280 2023-03-08T15:49:15.822 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.816+0000 7fd876df6700 1 -- 172.21.15.175:0/2850523019 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd870141b90 con 0x7fd8700ba280 2023-03-08T15:49:15.823 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.817+0000 7fd86d7fa700 1 -- 172.21.15.175:0/2850523019 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fd85c019030 con 0x7fd8700ba280 2023-03-08T15:49:15.823 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.817+0000 7fd86d7fa700 1 -- 172.21.15.175:0/2850523019 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd85c011c80 con 0x7fd8700ba280 2023-03-08T15:49:15.823 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.818+0000 7fd876df6700 1 -- 172.21.15.175:0/2850523019 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87014b1c0 con 0x7fd8700ba280 2023-03-08T15:49:15.823 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.820+0000 7fd86d7fa700 1 -- 172.21.15.175:0/2850523019 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fd85c017070 con 0x7fd8700ba280 2023-03-08T15:49:15.905 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.903+0000 7fd876df6700 1 -- 172.21.15.175:0/2850523019 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8677c2aa-a97f-4594-8a3d-bcc3c3eea244", "id": 4} v 0) v1 -- 0x7fd8700744c0 con 0x7fd8700ba280 2023-03-08T15:49:15.910 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.909+0000 7fd86d7fa700 1 -- 172.21.15.175:0/2850523019 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8677c2aa-a97f-4594-8a3d-bcc3c3eea244", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd85c011770 con 0x7fd8700ba280 2023-03-08T15:49:15.910 INFO:teuthology.orchestra.run.smithi175.stdout:4 2023-03-08T15:49:15.911 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.910+0000 7fd876df6700 1 -- 172.21.15.175:0/2850523019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8700ba280 msgr2=0x7fd8700b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:15.911 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.910+0000 7fd876df6700 1 --2- 172.21.15.175:0/2850523019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8700ba280 0x7fd8700b48e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00c4e0 tx=0x7fd85c00c7f0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.912 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.910+0000 7fd876df6700 1 -- 172.21.15.175:0/2850523019 shutdown_connections 2023-03-08T15:49:15.912 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.910+0000 7fd876df6700 1 --2- 172.21.15.175:0/2850523019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8700b75c0 0x7fd8700b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.912 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.910+0000 7fd876df6700 1 --2- 172.21.15.175:0/2850523019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd870071df0 0x7fd87006a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.912 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.910+0000 7fd876df6700 1 --2- 172.21.15.175:0/2850523019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8700ba280 0x7fd8700b48e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:15.912 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.910+0000 7fd876df6700 1 -- 172.21.15.175:0/2850523019 >> 172.21.15.175:0/2850523019 conn(0x7fd87006b360 msgr2=0x7fd87013ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:15.912 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.910+0000 7fd876df6700 1 -- 172.21.15.175:0/2850523019 shutdown_connections 2023-03-08T15:49:15.912 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:15.910+0000 7fd876df6700 1 -- 172.21.15.175:0/2850523019 wait complete. 2023-03-08T15:49:15.923 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new fc0759ee-94f0-46df-a298-5cdc9be436df 5 2023-03-08T15:49:16.045 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.044+0000 7f4f7d5b8700 1 Processor -- start 2023-03-08T15:49:16.046 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.044+0000 7f4f7d5b8700 1 -- start start 2023-03-08T15:49:16.047 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f7d5b8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4f78147e50 0x7f4f7806a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.047 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f7d5b8700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4f7814b420 0x7f4f78155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.047 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f7d5b8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f7814a810 con 0x7f4f7806fef0 2023-03-08T15:49:16.047 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f7d5b8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f78071a40 con 0x7f4f78147e50 2023-03-08T15:49:16.047 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f7d5b8700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f78071d20 con 0x7f4f7814b420 2023-03-08T15:49:16.048 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f777fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4f7814b420 0x7f4f78155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.048 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f777fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4f7814b420 0x7f4f78155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36436/0 (socket says 172.21.15.175:36436) 2023-03-08T15:49:16.048 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f777fe700 1 -- 172.21.15.175:0/3060078685 learned_addr learned my addr 172.21.15.175:0/3060078685 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-03-08T15:49:16.048 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f777fe700 1 -- 172.21.15.175:0/3060078685 >> v2:172.21.15.123:3300/0 conn(0x7f4f78147e50 msgr2=0x7f4f7806a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:16.048 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f777fe700 1 --2- 172.21.15.175:0/3060078685 >> v2:172.21.15.123:3300/0 conn(0x7f4f78147e50 0x7f4f7806a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.048 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f777fe700 1 -- 172.21.15.175:0/3060078685 >> v1:172.21.15.123:6789/0 conn(0x7f4f7806fef0 legacy=0x7f4f7814ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:16.048 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f777fe700 1 -- 172.21.15.175:0/3060078685 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f78072000 con 0x7f4f7814b420 2023-03-08T15:49:16.049 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f777fe700 1 --2- 172.21.15.175:0/3060078685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f7814b420 0x7f4f78155040 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4f780b9d00 tx=0x7f4f7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5525795349ec2a93 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:16.049 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f75ffb700 1 -- 172.21.15.175:0/3060078685 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7000e070 con 0x7f4f7814b420 2023-03-08T15:49:16.049 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f75ffb700 1 -- 172.21.15.175:0/3060078685 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f70003a20 con 0x7f4f7814b420 2023-03-08T15:49:16.049 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.045+0000 7f4f75ffb700 1 -- 172.21.15.175:0/3060078685 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70003dd0 con 0x7f4f7814b420 2023-03-08T15:49:16.051 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.046+0000 7f4f7d5b8700 1 -- 172.21.15.175:0/3060078685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f7814b420 msgr2=0x7f4f78155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.051 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.046+0000 7f4f7d5b8700 1 --2- 172.21.15.175:0/3060078685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f7814b420 0x7f4f78155040 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4f780b9d00 tx=0x7f4f7000b330 comp rx=0 tx=0).stop 2023-03-08T15:49:16.052 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.046+0000 7f4f7d5b8700 1 -- 172.21.15.175:0/3060078685 shutdown_connections 2023-03-08T15:49:16.052 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.046+0000 7f4f7d5b8700 1 --2- 172.21.15.175:0/3060078685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f7814b420 0x7f4f78155040 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.052 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.046+0000 7f4f7d5b8700 1 --2- 172.21.15.175:0/3060078685 >> v2:172.21.15.123:3300/0 conn(0x7f4f78147e50 0x7f4f7806a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.052 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.046+0000 7f4f7d5b8700 1 -- 172.21.15.175:0/3060078685 >> 172.21.15.175:0/3060078685 conn(0x7f4f7806b360 msgr2=0x7f4f7806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:16.052 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.046+0000 7f4f7d5b8700 1 -- 172.21.15.175:0/3060078685 shutdown_connections 2023-03-08T15:49:16.052 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.046+0000 7f4f7d5b8700 1 -- 172.21.15.175:0/3060078685 wait complete. 2023-03-08T15:49:16.052 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.047+0000 7f4f7d5b8700 1 Processor -- start 2023-03-08T15:49:16.052 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.047+0000 7f4f7d5b8700 1 -- start start 2023-03-08T15:49:16.053 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f7d5b8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f7806fef0 0x7f4f780b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.053 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f7d5b8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f78147e50 0x7f4f78143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.053 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f7d5b8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f7814b420 0x7f4f780b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.053 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f7d5b8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f781435a0 con 0x7f4f7814b420 2023-03-08T15:49:16.053 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f7d5b8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f780b79b0 con 0x7f4f7806fef0 2023-03-08T15:49:16.053 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f7d5b8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f780b5de0 con 0x7f4f78147e50 2023-03-08T15:49:16.053 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f76ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f7806fef0 0x7f4f780b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.054 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f767fc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f78147e50 0x7f4f78143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.054 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f76ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f7806fef0 0x7f4f780b6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36440/0 (socket says 172.21.15.175:36440) 2023-03-08T15:49:16.054 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f76ffd700 1 -- 172.21.15.175:0/1828599989 learned_addr learned my addr 172.21.15.175:0/1828599989 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-03-08T15:49:16.054 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f777fe700 1 --2- 172.21.15.175:0/1828599989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f7814b420 0x7f4f780b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.054 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f76ffd700 1 -- 172.21.15.175:0/1828599989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f78147e50 msgr2=0x7f4f78143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.054 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f76ffd700 1 --2- 172.21.15.175:0/1828599989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f78147e50 0x7f4f78143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.054 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f76ffd700 1 -- 172.21.15.175:0/1828599989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f7814b420 msgr2=0x7f4f780b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.054 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f76ffd700 1 --2- 172.21.15.175:0/1828599989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f7814b420 0x7f4f780b7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f76ffd700 1 -- 172.21.15.175:0/1828599989 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f70009b30 con 0x7f4f7806fef0 2023-03-08T15:49:16.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.048+0000 7f4f767fc700 1 --2- 172.21.15.175:0/1828599989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f78147e50 0x7f4f78143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:16.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.049+0000 7f4f76ffd700 1 --2- 172.21.15.175:0/1828599989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f7806fef0 0x7f4f780b6200 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800b530 tx=0x7f4f6800b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:16.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.049+0000 7f4f5f7fe700 1 -- 172.21.15.175:0/1828599989 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68011830 con 0x7f4f7806fef0 2023-03-08T15:49:16.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.049+0000 7f4f5f7fe700 1 -- 172.21.15.175:0/1828599989 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f68011990 con 0x7f4f7806fef0 2023-03-08T15:49:16.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.049+0000 7f4f7d5b8700 1 -- 172.21.15.175:0/1828599989 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f780728f0 con 0x7f4f7806fef0 2023-03-08T15:49:16.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.049+0000 7f4f5f7fe700 1 -- 172.21.15.175:0/1828599989 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68011d40 con 0x7f4f7806fef0 2023-03-08T15:49:16.056 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.049+0000 7f4f7d5b8700 1 -- 172.21.15.175:0/1828599989 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f78148220 con 0x7f4f7806fef0 2023-03-08T15:49:16.056 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.049+0000 7f4f5f7fe700 1 -- 172.21.15.175:0/1828599989 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f4f68021070 con 0x7f4f7806fef0 2023-03-08T15:49:16.056 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.049+0000 7f4f5f7fe700 1 -- 172.21.15.175:0/1828599989 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f4f6801acc0 con 0x7f4f7806fef0 2023-03-08T15:49:16.056 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.050+0000 7f4f7d5b8700 1 -- 172.21.15.175:0/1828599989 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f780b45f0 con 0x7f4f7806fef0 2023-03-08T15:49:16.056 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.053+0000 7f4f5f7fe700 1 -- 172.21.15.175:0/1828599989 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f4f68039b10 con 0x7f4f7806fef0 2023-03-08T15:49:16.139 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.137+0000 7f4f7d5b8700 1 -- 172.21.15.175:0/1828599989 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fc0759ee-94f0-46df-a298-5cdc9be436df", "id": 5} v 0) v1 -- 0x7f4f780b72c0 con 0x7f4f7806fef0 2023-03-08T15:49:16.146 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.144+0000 7f4f5f7fe700 1 -- 172.21.15.175:0/1828599989 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc0759ee-94f0-46df-a298-5cdc9be436df", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4f68028070 con 0x7f4f7806fef0 2023-03-08T15:49:16.146 INFO:teuthology.orchestra.run.smithi175.stdout:5 2023-03-08T15:49:16.147 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.145+0000 7f4f7d5b8700 1 -- 172.21.15.175:0/1828599989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f7806fef0 msgr2=0x7f4f780b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.147 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.145+0000 7f4f7d5b8700 1 --2- 172.21.15.175:0/1828599989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f7806fef0 0x7f4f780b6200 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800b530 tx=0x7f4f6800b840 comp rx=0 tx=0).stop 2023-03-08T15:49:16.147 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.145+0000 7f4f7d5b8700 1 -- 172.21.15.175:0/1828599989 shutdown_connections 2023-03-08T15:49:16.148 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.145+0000 7f4f7d5b8700 1 --2- 172.21.15.175:0/1828599989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f7814b420 0x7f4f780b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.148 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.145+0000 7f4f7d5b8700 1 --2- 172.21.15.175:0/1828599989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f7806fef0 0x7f4f780b6200 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.148 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.145+0000 7f4f7d5b8700 1 --2- 172.21.15.175:0/1828599989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f78147e50 0x7f4f78143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.148 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.145+0000 7f4f7d5b8700 1 -- 172.21.15.175:0/1828599989 >> 172.21.15.175:0/1828599989 conn(0x7f4f7806b360 msgr2=0x7f4f781496d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:16.148 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.145+0000 7f4f7d5b8700 1 -- 172.21.15.175:0/1828599989 shutdown_connections 2023-03-08T15:49:16.148 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.145+0000 7f4f7d5b8700 1 -- 172.21.15.175:0/1828599989 wait complete. 2023-03-08T15:49:16.158 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 2baaf193-569a-477b-823b-c52f1d931872 6 2023-03-08T15:49:16.162 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:16.161+0000 7f5c5a71a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-08T15:49:16.284 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.282+0000 7faca2df2700 1 Processor -- start 2023-03-08T15:49:16.284 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.282+0000 7faca2df2700 1 -- start start 2023-03-08T15:49:16.285 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.283+0000 7faca2df2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac9c0ba280 0x7fac9c06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.285 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.283+0000 7faca2df2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fac9c071df0 0x7fac9c14aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.283+0000 7faca2df2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9c070670 con 0x7fac9c072760 2023-03-08T15:49:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.283+0000 7faca2df2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9c070a40 con 0x7fac9c071df0 2023-03-08T15:49:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.283+0000 7faca2df2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9c070c50 con 0x7fac9c0ba280 2023-03-08T15:49:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.283+0000 7faca0b8e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac9c0ba280 0x7fac9c06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.283+0000 7faca0b8e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac9c0ba280 0x7fac9c06fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36446/0 (socket says 172.21.15.175:36446) 2023-03-08T15:49:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.283+0000 7faca0b8e700 1 -- 172.21.15.175:0/3470110619 learned_addr learned my addr 172.21.15.175:0/3470110619 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-03-08T15:49:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.283+0000 7faca138f700 1 --2- 172.21.15.175:0/3470110619 >> v2:172.21.15.123:3300/0 conn(0x7fac9c071df0 0x7fac9c14aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.287 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.284+0000 7faca0b8e700 1 -- 172.21.15.175:0/3470110619 >> v2:172.21.15.123:3300/0 conn(0x7fac9c071df0 msgr2=0x7fac9c14aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:16.287 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.284+0000 7faca0b8e700 1 --2- 172.21.15.175:0/3470110619 >> v2:172.21.15.123:3300/0 conn(0x7fac9c071df0 0x7fac9c14aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.287 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.284+0000 7faca0b8e700 1 -- 172.21.15.175:0/3470110619 >> v1:172.21.15.123:6789/0 conn(0x7fac9c072760 legacy=0x7fac9c141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.287 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.284+0000 7faca0b8e700 1 -- 172.21.15.175:0/3470110619 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c0ba650 con 0x7fac9c0ba280 2023-03-08T15:49:16.287 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.284+0000 7faca0b8e700 1 --2- 172.21.15.175:0/3470110619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c0ba280 0x7fac9c06fff0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fac9c06f300 tx=0x7fac9000be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cdc32fd65c0d1cf server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:16.287 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.284+0000 7fac9b7fe700 1 -- 172.21.15.175:0/3470110619 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9000dc70 con 0x7fac9c0ba280 2023-03-08T15:49:16.287 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.284+0000 7fac9b7fe700 1 -- 172.21.15.175:0/3470110619 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9000ddd0 con 0x7fac9c0ba280 2023-03-08T15:49:16.288 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.284+0000 7fac9b7fe700 1 -- 172.21.15.175:0/3470110619 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90010690 con 0x7fac9c0ba280 2023-03-08T15:49:16.290 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.285+0000 7faca2df2700 1 -- 172.21.15.175:0/3470110619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c0ba280 msgr2=0x7fac9c06fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.290 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.285+0000 7faca2df2700 1 --2- 172.21.15.175:0/3470110619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c0ba280 0x7fac9c06fff0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fac9c06f300 tx=0x7fac9000be70 comp rx=0 tx=0).stop 2023-03-08T15:49:16.290 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.285+0000 7faca2df2700 1 -- 172.21.15.175:0/3470110619 shutdown_connections 2023-03-08T15:49:16.290 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.285+0000 7faca2df2700 1 --2- 172.21.15.175:0/3470110619 >> v2:172.21.15.123:3300/0 conn(0x7fac9c071df0 0x7fac9c14aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.290 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.285+0000 7faca2df2700 1 --2- 172.21.15.175:0/3470110619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c0ba280 0x7fac9c06fff0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.291 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.285+0000 7faca2df2700 1 -- 172.21.15.175:0/3470110619 >> 172.21.15.175:0/3470110619 conn(0x7fac9c06b360 msgr2=0x7fac9c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:16.291 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.285+0000 7faca2df2700 1 -- 172.21.15.175:0/3470110619 shutdown_connections 2023-03-08T15:49:16.291 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.285+0000 7faca2df2700 1 -- 172.21.15.175:0/3470110619 wait complete. 2023-03-08T15:49:16.291 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.286+0000 7faca2df2700 1 Processor -- start 2023-03-08T15:49:16.291 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.286+0000 7faca2df2700 1 -- start start 2023-03-08T15:49:16.291 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca2df2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c071df0 0x7fac9c13bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.291 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca2df2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c0ba280 0x7fac9c13c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.292 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca2df2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c142670 0x7fac9c13ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.292 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca2df2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c148770 con 0x7fac9c071df0 2023-03-08T15:49:16.292 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca2df2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c13cfb0 con 0x7fac9c0ba280 2023-03-08T15:49:16.292 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca2df2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c1405c0 con 0x7fac9c142670 2023-03-08T15:49:16.292 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca138f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c142670 0x7fac9c13ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.292 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca138f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c142670 0x7fac9c13ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:58214/0 (socket says 172.21.15.175:58214) 2023-03-08T15:49:16.292 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca138f700 1 -- 172.21.15.175:0/3888428353 learned_addr learned my addr 172.21.15.175:0/3888428353 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-03-08T15:49:16.292 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7fac9bfff700 1 --2- 172.21.15.175:0/3888428353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c0ba280 0x7fac9c13c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.293 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca0b8e700 1 --2- 172.21.15.175:0/3888428353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c071df0 0x7fac9c13bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.293 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca0b8e700 1 -- 172.21.15.175:0/3888428353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c142670 msgr2=0x7fac9c13ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.293 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca0b8e700 1 --2- 172.21.15.175:0/3888428353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c142670 0x7fac9c13ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.293 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca0b8e700 1 -- 172.21.15.175:0/3888428353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c0ba280 msgr2=0x7fac9c13c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.293 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca0b8e700 1 --2- 172.21.15.175:0/3888428353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c0ba280 0x7fac9c13c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.293 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca0b8e700 1 -- 172.21.15.175:0/3888428353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9000b7f0 con 0x7fac9c071df0 2023-03-08T15:49:16.293 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca138f700 1 --2- 172.21.15.175:0/3888428353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c142670 0x7fac9c13ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:16.294 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7faca0b8e700 1 --2- 172.21.15.175:0/3888428353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c071df0 0x7fac9c13bff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fac90018000 tx=0x7fac90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:16.294 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7fac997fa700 1 -- 172.21.15.175:0/3888428353 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90003b70 con 0x7fac9c071df0 2023-03-08T15:49:16.294 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.287+0000 7fac997fa700 1 -- 172.21.15.175:0/3888428353 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac90003cf0 con 0x7fac9c071df0 2023-03-08T15:49:16.294 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.288+0000 7faca2df2700 1 -- 172.21.15.175:0/3888428353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9c141d20 con 0x7fac9c071df0 2023-03-08T15:49:16.294 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.288+0000 7fac997fa700 1 -- 172.21.15.175:0/3888428353 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac900106b0 con 0x7fac9c071df0 2023-03-08T15:49:16.294 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.288+0000 7faca2df2700 1 -- 172.21.15.175:0/3888428353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9c141b90 con 0x7fac9c071df0 2023-03-08T15:49:16.294 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.288+0000 7fac997fa700 1 -- 172.21.15.175:0/3888428353 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fac90010b00 con 0x7fac9c071df0 2023-03-08T15:49:16.294 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.288+0000 7fac997fa700 1 -- 172.21.15.175:0/3888428353 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fac90023e40 con 0x7fac9c071df0 2023-03-08T15:49:16.295 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.289+0000 7faca2df2700 1 -- 172.21.15.175:0/3888428353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9c14aff0 con 0x7fac9c071df0 2023-03-08T15:49:16.295 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.291+0000 7fac997fa700 1 -- 172.21.15.175:0/3888428353 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fac90023440 con 0x7fac9c071df0 2023-03-08T15:49:16.302 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:16.301+0000 7f5c5a71a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-08T15:49:16.375 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.374+0000 7faca2df2700 1 -- 172.21.15.175:0/3888428353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2baaf193-569a-477b-823b-c52f1d931872", "id": 6} v 0) v1 -- 0x7fac9c13d5c0 con 0x7fac9c071df0 2023-03-08T15:49:16.382 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.381+0000 7fac997fa700 1 -- 172.21.15.175:0/3888428353 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2baaf193-569a-477b-823b-c52f1d931872", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fac90023850 con 0x7fac9c071df0 2023-03-08T15:49:16.383 INFO:teuthology.orchestra.run.smithi175.stdout:6 2023-03-08T15:49:16.383 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.382+0000 7faca2df2700 1 -- 172.21.15.175:0/3888428353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c071df0 msgr2=0x7fac9c13bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.383 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.382+0000 7faca2df2700 1 --2- 172.21.15.175:0/3888428353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c071df0 0x7fac9c13bff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fac90018000 tx=0x7fac90004750 comp rx=0 tx=0).stop 2023-03-08T15:49:16.384 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.382+0000 7faca2df2700 1 -- 172.21.15.175:0/3888428353 shutdown_connections 2023-03-08T15:49:16.384 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.382+0000 7faca2df2700 1 --2- 172.21.15.175:0/3888428353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac9c142670 0x7fac9c13ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.384 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.382+0000 7faca2df2700 1 --2- 172.21.15.175:0/3888428353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c071df0 0x7fac9c13bff0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.384 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.382+0000 7faca2df2700 1 --2- 172.21.15.175:0/3888428353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac9c0ba280 0x7fac9c13c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.384 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.382+0000 7faca2df2700 1 -- 172.21.15.175:0/3888428353 >> 172.21.15.175:0/3888428353 conn(0x7fac9c06b360 msgr2=0x7fac9c139c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:16.384 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.382+0000 7faca2df2700 1 -- 172.21.15.175:0/3888428353 shutdown_connections 2023-03-08T15:49:16.384 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.382+0000 7faca2df2700 1 -- 172.21.15.175:0/3888428353 wait complete. 2023-03-08T15:49:16.395 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 39c8e50b-8b86-4f2e-8bf9-130df0e51aec 7 2023-03-08T15:49:16.519 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:16.517+0000 7f5c5a71a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-08T15:49:16.539 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.538+0000 7fae83463700 1 Processor -- start 2023-03-08T15:49:16.539 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.538+0000 7fae83463700 1 -- start start 2023-03-08T15:49:16.541 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae83463700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fae7c1475e0 0x7fae7c147a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.541 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae83463700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae7c14fcb0 0x7fae7c152090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.541 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae83463700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7c071ec0 con 0x7fae7c141890 2023-03-08T15:49:16.541 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae83463700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c141c60 con 0x7fae7c1475e0 2023-03-08T15:49:16.541 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae83463700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c070440 con 0x7fae7c14fcb0 2023-03-08T15:49:16.542 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae809fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fae7c1475e0 0x7fae7c147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.542 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae81a00700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae7c14fcb0 0x7fae7c152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.542 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae809fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fae7c1475e0 0x7fae7c147a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36456/0 (socket says 172.21.15.175:36456) 2023-03-08T15:49:16.542 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae81a00700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae7c14fcb0 0x7fae7c152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:58216/0 (socket says 172.21.15.175:58216) 2023-03-08T15:49:16.542 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae809fe700 1 -- 172.21.15.175:0/1740615922 learned_addr learned my addr 172.21.15.175:0/1740615922 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-03-08T15:49:16.542 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae811ff700 1 --1- 172.21.15.175:0/1740615922 >> v1:172.21.15.175:6789/0 conn(0x7fae7c141890 0x7fae7c06fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:33000/0 (socket says 172.21.15.175:33000) 2023-03-08T15:49:16.542 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae809fe700 1 -- 172.21.15.175:0/1740615922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae7c14fcb0 msgr2=0x7fae7c152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:16.543 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae809fe700 1 --2- 172.21.15.175:0/1740615922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae7c14fcb0 0x7fae7c152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.543 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae809fe700 1 -- 172.21.15.175:0/1740615922 >> v1:172.21.15.175:6789/0 conn(0x7fae7c141890 legacy=0x7fae7c06fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.543 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae809fe700 1 -- 172.21.15.175:0/1740615922 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c147f50 con 0x7fae7c1475e0 2023-03-08T15:49:16.543 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae809fe700 1 --2- 172.21.15.175:0/1740615922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae7c1475e0 0x7fae7c147a10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00bb90 tx=0x7fae6c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8596132fe9352ecc server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:16.543 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae73fff700 1 -- 172.21.15.175:0/1740615922 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c00dd30 con 0x7fae7c1475e0 2023-03-08T15:49:16.543 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae73fff700 1 -- 172.21.15.175:0/1740615922 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c00de90 con 0x7fae7c1475e0 2023-03-08T15:49:16.543 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.539+0000 7fae73fff700 1 -- 172.21.15.175:0/1740615922 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c010690 con 0x7fae7c1475e0 2023-03-08T15:49:16.546 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.540+0000 7fae83463700 1 -- 172.21.15.175:0/1740615922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae7c1475e0 msgr2=0x7fae7c147a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.546 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.540+0000 7fae83463700 1 --2- 172.21.15.175:0/1740615922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae7c1475e0 0x7fae7c147a10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00bb90 tx=0x7fae6c00bea0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.546 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.540+0000 7fae83463700 1 -- 172.21.15.175:0/1740615922 shutdown_connections 2023-03-08T15:49:16.546 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.540+0000 7fae83463700 1 --2- 172.21.15.175:0/1740615922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae7c14fcb0 0x7fae7c152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.546 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.540+0000 7fae83463700 1 --2- 172.21.15.175:0/1740615922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae7c1475e0 0x7fae7c147a10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.547 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.540+0000 7fae83463700 1 -- 172.21.15.175:0/1740615922 >> 172.21.15.175:0/1740615922 conn(0x7fae7c0b9800 msgr2=0x7fae7c0b9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:16.547 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.540+0000 7fae83463700 1 -- 172.21.15.175:0/1740615922 shutdown_connections 2023-03-08T15:49:16.547 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.540+0000 7fae83463700 1 -- 172.21.15.175:0/1740615922 wait complete. 2023-03-08T15:49:16.547 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.541+0000 7fae83463700 1 Processor -- start 2023-03-08T15:49:16.547 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.541+0000 7fae83463700 1 -- start start 2023-03-08T15:49:16.547 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae83463700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae7c141890 0x7fae7c143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.547 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae83463700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae7c1475e0 0x7fae7c0b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.547 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae83463700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae7c14fcb0 0x7fae7c1df340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.548 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae83463700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0b5ea0 con 0x7fae7c14fcb0 2023-03-08T15:49:16.548 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae83463700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c143c10 con 0x7fae7c1475e0 2023-03-08T15:49:16.548 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae83463700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0b6240 con 0x7fae7c141890 2023-03-08T15:49:16.548 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae809fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae7c1475e0 0x7fae7c0b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.548 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae809fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae7c1475e0 0x7fae7c0b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36470/0 (socket says 172.21.15.175:36470) 2023-03-08T15:49:16.548 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae809fe700 1 -- 172.21.15.175:0/534629554 learned_addr learned my addr 172.21.15.175:0/534629554 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-03-08T15:49:16.548 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae811ff700 1 --2- 172.21.15.175:0/534629554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae7c141890 0x7fae7c143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.549 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae81a00700 1 --2- 172.21.15.175:0/534629554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae7c14fcb0 0x7fae7c1df340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.549 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae809fe700 1 -- 172.21.15.175:0/534629554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae7c141890 msgr2=0x7fae7c143530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.549 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae809fe700 1 --2- 172.21.15.175:0/534629554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae7c141890 0x7fae7c143530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.549 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae809fe700 1 -- 172.21.15.175:0/534629554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae7c14fcb0 msgr2=0x7fae7c1df340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.549 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae809fe700 1 --2- 172.21.15.175:0/534629554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae7c14fcb0 0x7fae7c1df340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.549 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae809fe700 1 -- 172.21.15.175:0/534629554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c00b7f0 con 0x7fae7c1475e0 2023-03-08T15:49:16.549 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae81a00700 1 --2- 172.21.15.175:0/534629554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae7c14fcb0 0x7fae7c1df340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:16.549 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.542+0000 7fae809fe700 1 --2- 172.21.15.175:0/534629554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae7c1475e0 0x7fae7c0b5960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00bee0 tx=0x7fae6c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:16.550 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.543+0000 7fae71ffb700 1 -- 172.21.15.175:0/534629554 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c01f070 con 0x7fae7c1475e0 2023-03-08T15:49:16.550 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.543+0000 7fae71ffb700 1 -- 172.21.15.175:0/534629554 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c003970 con 0x7fae7c1475e0 2023-03-08T15:49:16.550 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.543+0000 7fae71ffb700 1 -- 172.21.15.175:0/534629554 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c003d20 con 0x7fae7c1475e0 2023-03-08T15:49:16.550 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.543+0000 7fae83463700 1 -- 172.21.15.175:0/534629554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c06fa10 con 0x7fae7c1475e0 2023-03-08T15:49:16.550 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.543+0000 7fae83463700 1 -- 172.21.15.175:0/534629554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c06f730 con 0x7fae7c1475e0 2023-03-08T15:49:16.550 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.543+0000 7fae71ffb700 1 -- 172.21.15.175:0/534629554 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fae6c010760 con 0x7fae7c1475e0 2023-03-08T15:49:16.550 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.543+0000 7fae71ffb700 1 -- 172.21.15.175:0/534629554 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fae6c019a60 con 0x7fae7c1475e0 2023-03-08T15:49:16.550 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.544+0000 7fae83463700 1 -- 172.21.15.175:0/534629554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c066200 con 0x7fae7c1475e0 2023-03-08T15:49:16.551 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.548+0000 7fae71ffb700 1 -- 172.21.15.175:0/534629554 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fae6c019cc0 con 0x7fae7c1475e0 2023-03-08T15:49:16.590 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:16.589+0000 7f5c5a71a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-08T15:49:16.614 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:16.613+0000 7f399650f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-08T15:49:16.632 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.631+0000 7fae83463700 1 -- 172.21.15.175:0/534629554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "39c8e50b-8b86-4f2e-8bf9-130df0e51aec", "id": 7} v 0) v1 -- 0x7fae7c070e80 con 0x7fae7c1475e0 2023-03-08T15:49:16.637 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.636+0000 7fae71ffb700 1 -- 172.21.15.175:0/534629554 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "39c8e50b-8b86-4f2e-8bf9-130df0e51aec", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fae6c019e60 con 0x7fae7c1475e0 2023-03-08T15:49:16.638 INFO:teuthology.orchestra.run.smithi175.stdout:7 2023-03-08T15:49:16.639 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.637+0000 7fae83463700 1 -- 172.21.15.175:0/534629554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae7c1475e0 msgr2=0x7fae7c0b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.639 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.637+0000 7fae83463700 1 --2- 172.21.15.175:0/534629554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae7c1475e0 0x7fae7c0b5960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00bee0 tx=0x7fae6c004750 comp rx=0 tx=0).stop 2023-03-08T15:49:16.639 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.637+0000 7fae83463700 1 -- 172.21.15.175:0/534629554 shutdown_connections 2023-03-08T15:49:16.639 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.637+0000 7fae83463700 1 --2- 172.21.15.175:0/534629554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae7c14fcb0 0x7fae7c1df340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.639 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.637+0000 7fae83463700 1 --2- 172.21.15.175:0/534629554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae7c141890 0x7fae7c143530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.640 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.637+0000 7fae83463700 1 --2- 172.21.15.175:0/534629554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae7c1475e0 0x7fae7c0b5960 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.640 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.637+0000 7fae83463700 1 -- 172.21.15.175:0/534629554 >> 172.21.15.175:0/534629554 conn(0x7fae7c0b9800 msgr2=0x7fae7c146a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:16.640 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.637+0000 7fae83463700 1 -- 172.21.15.175:0/534629554 shutdown_connections 2023-03-08T15:49:16.640 INFO:teuthology.orchestra.run.smithi175.stderr:2023-03-08T15:49:16.637+0000 7fae83463700 1 -- 172.21.15.175:0/534629554 wait complete. 2023-03-08T15:49:16.650 INFO:tasks.ceph.osd.0:Restarting daemon 2023-03-08T15:49:16.651 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-03-08T15:49:16.652 INFO:tasks.ceph.osd.0:Started 2023-03-08T15:49:16.653 INFO:tasks.ceph.osd.1:Restarting daemon 2023-03-08T15:49:16.653 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-03-08T15:49:16.655 INFO:tasks.ceph.osd.1:Started 2023-03-08T15:49:16.655 INFO:tasks.ceph.osd.2:Restarting daemon 2023-03-08T15:49:16.655 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-03-08T15:49:16.657 INFO:tasks.ceph.osd.2:Started 2023-03-08T15:49:16.657 INFO:tasks.ceph.osd.3:Restarting daemon 2023-03-08T15:49:16.658 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-03-08T15:49:16.659 INFO:tasks.ceph.osd.3:Started 2023-03-08T15:49:16.660 INFO:tasks.ceph.osd.4:Restarting daemon 2023-03-08T15:49:16.660 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-03-08T15:49:16.662 INFO:tasks.ceph.osd.4:Started 2023-03-08T15:49:16.662 INFO:tasks.ceph.osd.5:Restarting daemon 2023-03-08T15:49:16.662 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-03-08T15:49:16.664 INFO:tasks.ceph.osd.5:Started 2023-03-08T15:49:16.664 INFO:tasks.ceph.osd.6:Restarting daemon 2023-03-08T15:49:16.665 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-03-08T15:49:16.667 INFO:tasks.ceph.osd.6:Started 2023-03-08T15:49:16.667 INFO:tasks.ceph.osd.7:Restarting daemon 2023-03-08T15:49:16.667 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-03-08T15:49:16.669 INFO:tasks.ceph.osd.7:Started 2023-03-08T15:49:16.670 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:49:16.747 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:16.746+0000 7f5c5a71a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-08T15:49:16.785 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:16.783+0000 7f399650f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-08T15:49:16.826 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.825+0000 7f7f80489700 1 Processor -- start 2023-03-08T15:49:16.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.825+0000 7f7f80489700 1 -- start start 2023-03-08T15:49:16.828 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.826+0000 7f7f80489700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7f780ba280 0x7f7f7806fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.826+0000 7f7f80489700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7f78072760 0x7f7f78141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.826+0000 7f7f80489700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f78070670 con 0x7f7f78071df0 2023-03-08T15:49:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.826+0000 7f7f80489700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f78070a40 con 0x7f7f780ba280 2023-03-08T15:49:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.826+0000 7f7f80489700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f78070c50 con 0x7f7f78072760 2023-03-08T15:49:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.826+0000 7f7f7e225700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7f780ba280 0x7f7f7806fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.826+0000 7f7f7e225700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7f780ba280 0x7f7f7806fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35264/0 (socket says 172.21.15.123:35264) 2023-03-08T15:49:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.827+0000 7f7f7e225700 1 -- 172.21.15.123:0/1704413406 learned_addr learned my addr 172.21.15.123:0/1704413406 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:16.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.827+0000 7f7f7da24700 1 --2- 172.21.15.123:0/1704413406 >> v2:172.21.15.175:3300/0 conn(0x7f7f78072760 0x7f7f78141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.827+0000 7f7f7e225700 1 -- 172.21.15.123:0/1704413406 >> v2:172.21.15.175:3300/0 conn(0x7f7f78072760 msgr2=0x7f7f78141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:16.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.827+0000 7f7f7e225700 1 --2- 172.21.15.123:0/1704413406 >> v2:172.21.15.175:3300/0 conn(0x7f7f78072760 0x7f7f78141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.827+0000 7f7f7e225700 1 -- 172.21.15.123:0/1704413406 >> v1:172.21.15.175:6789/0 conn(0x7f7f78071df0 legacy=0x7f7f7814aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:16.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.827+0000 7f7f7e225700 1 -- 172.21.15.123:0/1704413406 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f780ba650 con 0x7f7f780ba280 2023-03-08T15:49:16.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.827+0000 7f7f7da24700 1 --2- 172.21.15.123:0/1704413406 >> v2:172.21.15.175:3300/0 conn(0x7f7f78072760 0x7f7f78141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:16.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.827+0000 7f7f7e225700 1 --2- 172.21.15.123:0/1704413406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f780ba280 0x7f7f7806fff0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7f7806f4c0 tx=0x7f7f7400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24aa709250dfe91c server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:16.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.827+0000 7f7f7d223700 1 -- 172.21.15.123:0/1704413406 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400dcf0 con 0x7f7f780ba280 2023-03-08T15:49:16.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.827+0000 7f7f7d223700 1 -- 172.21.15.123:0/1704413406 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7400de50 con 0x7f7f780ba280 2023-03-08T15:49:16.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.827+0000 7f7f7d223700 1 -- 172.21.15.123:0/1704413406 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74004250 con 0x7f7f780ba280 2023-03-08T15:49:16.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.828+0000 7f7f80489700 1 -- 172.21.15.123:0/1704413406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f780ba280 msgr2=0x7f7f7806fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.828+0000 7f7f80489700 1 --2- 172.21.15.123:0/1704413406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f780ba280 0x7f7f7806fff0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7f7806f4c0 tx=0x7f7f7400be70 comp rx=0 tx=0).stop 2023-03-08T15:49:16.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.828+0000 7f7f80489700 1 -- 172.21.15.123:0/1704413406 shutdown_connections 2023-03-08T15:49:16.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.828+0000 7f7f80489700 1 --2- 172.21.15.123:0/1704413406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f780ba280 0x7f7f7806fff0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.828+0000 7f7f80489700 1 --2- 172.21.15.123:0/1704413406 >> v2:172.21.15.175:3300/0 conn(0x7f7f78072760 0x7f7f78141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.828+0000 7f7f80489700 1 -- 172.21.15.123:0/1704413406 >> 172.21.15.123:0/1704413406 conn(0x7f7f7806b360 msgr2=0x7f7f7806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:16.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.828+0000 7f7f80489700 1 -- 172.21.15.123:0/1704413406 shutdown_connections 2023-03-08T15:49:16.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.828+0000 7f7f80489700 1 -- 172.21.15.123:0/1704413406 wait complete. 2023-03-08T15:49:16.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.829+0000 7f7f80489700 1 Processor -- start 2023-03-08T15:49:16.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.829+0000 7f7f80489700 1 -- start start 2023-03-08T15:49:16.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.830+0000 7f7f80489700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f78071df0 0x7f7f781df160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.830+0000 7f7f80489700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f780ba280 0x7f7f780b6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.830+0000 7f7f80489700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f78144370 0x7f7f780b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:16.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.830+0000 7f7f80489700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78147e00 con 0x7f7f78144370 2023-03-08T15:49:16.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.830+0000 7f7f80489700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f781dfc80 con 0x7f7f780ba280 2023-03-08T15:49:16.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.830+0000 7f7f80489700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f781415f0 con 0x7f7f78071df0 2023-03-08T15:49:16.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.830+0000 7f7f7ea26700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f78144370 0x7f7f780b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.830+0000 7f7f7ea26700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f78144370 0x7f7f780b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35268/0 (socket says 172.21.15.123:35268) 2023-03-08T15:49:16.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.830+0000 7f7f7da24700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f780ba280 0x7f7f780b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.830+0000 7f7f7ea26700 1 -- 172.21.15.123:0/3231805545 learned_addr learned my addr 172.21.15.123:0/3231805545 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:16.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.830+0000 7f7f7e225700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f78071df0 0x7f7f781df160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:16.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.831+0000 7f7f7ea26700 1 -- 172.21.15.123:0/3231805545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f78071df0 msgr2=0x7f7f781df160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.831+0000 7f7f7ea26700 1 --2- 172.21.15.123:0/3231805545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f78071df0 0x7f7f781df160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.831+0000 7f7f7ea26700 1 -- 172.21.15.123:0/3231805545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f780ba280 msgr2=0x7f7f780b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.831+0000 7f7f7ea26700 1 --2- 172.21.15.123:0/3231805545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f780ba280 0x7f7f780b6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.831+0000 7f7f7ea26700 1 -- 172.21.15.123:0/3231805545 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7400b7f0 con 0x7f7f78144370 2023-03-08T15:49:16.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.831+0000 7f7f7ea26700 1 --2- 172.21.15.123:0/3231805545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f78144370 0x7f7f780b5aa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000cbd0 tx=0x7f7f7000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:16.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.831+0000 7f7f6effd700 1 -- 172.21.15.123:0/3231805545 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000aa60 con 0x7f7f78144370 2023-03-08T15:49:16.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.831+0000 7f7f6effd700 1 -- 172.21.15.123:0/3231805545 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7000abc0 con 0x7f7f78144370 2023-03-08T15:49:16.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.831+0000 7f7f80489700 1 -- 172.21.15.123:0/3231805545 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7814b350 con 0x7f7f78144370 2023-03-08T15:49:16.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.831+0000 7f7f6effd700 1 -- 172.21.15.123:0/3231805545 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70012420 con 0x7f7f78144370 2023-03-08T15:49:16.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.831+0000 7f7f80489700 1 -- 172.21.15.123:0/3231805545 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7814b1c0 con 0x7f7f78144370 2023-03-08T15:49:16.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.831+0000 7f7f6effd700 1 -- 172.21.15.123:0/3231805545 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f7f70022070 con 0x7f7f78144370 2023-03-08T15:49:16.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.831+0000 7f7f6effd700 1 -- 172.21.15.123:0/3231805545 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7f7001bad0 con 0x7f7f78144370 2023-03-08T15:49:16.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.832+0000 7f7f80489700 1 -- 172.21.15.123:0/3231805545 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f781419c0 con 0x7f7f78144370 2023-03-08T15:49:16.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.834+0000 7f7f6effd700 1 -- 172.21.15.123:0/3231805545 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f7f7003ab10 con 0x7f7f78144370 2023-03-08T15:49:16.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.902+0000 7f7f80489700 1 -- 172.21.15.123:0/3231805545 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f780744c0 con 0x7f7f78144370 2023-03-08T15:49:16.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.902+0000 7f7f6effd700 1 -- 172.21.15.123:0/3231805545 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7f70029070 con 0x7f7f78144370 2023-03-08T15:49:16.904 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:16.904 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":10,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:16.632999+0000","last_up_change":"0.000000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:49:16.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.903+0000 7f7f80489700 1 -- 172.21.15.123:0/3231805545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f78144370 msgr2=0x7f7f780b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:16.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.903+0000 7f7f80489700 1 --2- 172.21.15.123:0/3231805545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f78144370 0x7f7f780b5aa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000cbd0 tx=0x7f7f7000cee0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.903+0000 7f7f80489700 1 -- 172.21.15.123:0/3231805545 shutdown_connections 2023-03-08T15:49:16.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.903+0000 7f7f80489700 1 --2- 172.21.15.123:0/3231805545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f78144370 0x7f7f780b5aa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.903+0000 7f7f80489700 1 --2- 172.21.15.123:0/3231805545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f78071df0 0x7f7f781df160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.903+0000 7f7f80489700 1 --2- 172.21.15.123:0/3231805545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f780ba280 0x7f7f780b6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:16.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.903+0000 7f7f80489700 1 -- 172.21.15.123:0/3231805545 >> 172.21.15.123:0/3231805545 conn(0x7f7f7806b360 msgr2=0x7f7f7813ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:16.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.903+0000 7f7f80489700 1 -- 172.21.15.123:0/3231805545 shutdown_connections 2023-03-08T15:49:16.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:16.903+0000 7f7f80489700 1 -- 172.21.15.123:0/3231805545 wait complete. 2023-03-08T15:49:16.916 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-03-08T15:49:16.916 INFO:tasks.ceph:Waiting for OSDs to come up 2023-03-08T15:49:17.007 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:17.005+0000 7f399650f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-08T15:49:17.081 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:17.079+0000 7f399650f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-08T15:49:17.219 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:17.218+0000 7f399650f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-08T15:49:17.263 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-03-08T15:49:17.261+0000 7f66247da640 -1 Falling back to public interface 2023-03-08T15:49:17.265 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T15:49:17.263+0000 7f75780c0640 -1 Falling back to public interface 2023-03-08T15:49:17.269 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T15:49:17.267+0000 7f24f3b4e640 -1 Falling back to public interface 2023-03-08T15:49:17.275 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-03-08T15:49:17.274+0000 7f3a9efb5640 -1 Falling back to public interface 2023-03-08T15:49:17.282 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T15:49:17.281+0000 7f3e271ad640 -1 Falling back to public interface 2023-03-08T15:49:17.283 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-03-08T15:49:17.282+0000 7f48d3493640 -1 Falling back to public interface 2023-03-08T15:49:17.286 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-03-08T15:49:17.285+0000 7fcf42767640 -1 Falling back to public interface 2023-03-08T15:49:17.292 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T15:49:17.290+0000 7f907333b640 -1 Falling back to public interface 2023-03-08T15:49:17.307 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:17.306+0000 7f5c5a71a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-08T15:49:17.381 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:17.379+0000 7f5c5a71a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-08T15:49:17.520 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:17.518+0000 7f5c5a71a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-08T15:49:17.721 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-08T15:49:17.766 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:17.765+0000 7f399650f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-08T15:49:17.772 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:17.771+0000 7f5c5a71a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-08T15:49:17.836 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.834+0000 7fb6681a8700 1 Processor -- start 2023-03-08T15:49:17.836 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.835+0000 7fb6681a8700 1 -- start start 2023-03-08T15:49:17.837 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.835+0000 7fb6681a8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6600b9940 0x7fb66006a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:17.838 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.835+0000 7fb6681a8700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb66014b030 0x7fb66014b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:17.838 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.835+0000 7fb6681a8700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb660145200 con 0x7fb6600b9d10 2023-03-08T15:49:17.838 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.835+0000 7fb6681a8700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66014b9f0 con 0x7fb66014b030 2023-03-08T15:49:17.838 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.835+0000 7fb6681a8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66006d9e0 con 0x7fb6600b9940 2023-03-08T15:49:17.838 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.836+0000 7fb665f44700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6600b9940 0x7fb66006a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:17.838 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.836+0000 7fb665743700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb66014b030 0x7fb66014b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:17.839 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.836+0000 7fb665f44700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6600b9940 0x7fb66006a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:51820/0 (socket says 172.21.15.123:51820) 2023-03-08T15:49:17.839 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.836+0000 7fb665f44700 1 -- 172.21.15.123:0/103667291 learned_addr learned my addr 172.21.15.123:0/103667291 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:17.839 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.836+0000 7fb665743700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb66014b030 0x7fb66014b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:41574/0 (socket says 172.21.15.123:41574) 2023-03-08T15:49:17.839 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.836+0000 7fb665f44700 1 -- 172.21.15.123:0/103667291 >> v2:172.21.15.175:3300/0 conn(0x7fb66014b030 msgr2=0x7fb66014b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:17.839 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.836+0000 7fb665f44700 1 --2- 172.21.15.123:0/103667291 >> v2:172.21.15.175:3300/0 conn(0x7fb66014b030 0x7fb66014b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:17.839 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.836+0000 7fb665f44700 1 -- 172.21.15.123:0/103667291 >> v1:172.21.15.175:6789/0 conn(0x7fb6600b9d10 legacy=0x7fb6600ba130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:17.839 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.836+0000 7fb665f44700 1 -- 172.21.15.123:0/103667291 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66006cc20 con 0x7fb6600b9940 2023-03-08T15:49:17.840 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.836+0000 7fb665f44700 1 --2- 172.21.15.123:0/103667291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6600b9940 0x7fb66006a250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0098f0 tx=0x7fb65c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56e47655869954f1 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:17.840 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.836+0000 7fb664f42700 1 -- 172.21.15.123:0/103667291 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c011830 con 0x7fb6600b9940 2023-03-08T15:49:17.840 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.836+0000 7fb664f42700 1 -- 172.21.15.123:0/103667291 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c011990 con 0x7fb6600b9940 2023-03-08T15:49:17.840 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.836+0000 7fb664f42700 1 -- 172.21.15.123:0/103667291 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c011d20 con 0x7fb6600b9940 2023-03-08T15:49:17.842 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.837+0000 7fb6681a8700 1 -- 172.21.15.123:0/103667291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6600b9940 msgr2=0x7fb66006a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:17.842 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.837+0000 7fb6681a8700 1 --2- 172.21.15.123:0/103667291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6600b9940 0x7fb66006a250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0098f0 tx=0x7fb65c009c00 comp rx=0 tx=0).stop 2023-03-08T15:49:17.842 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.837+0000 7fb6681a8700 1 -- 172.21.15.123:0/103667291 shutdown_connections 2023-03-08T15:49:17.843 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.837+0000 7fb6681a8700 1 --2- 172.21.15.123:0/103667291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6600b9940 0x7fb66006a250 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:17.843 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.837+0000 7fb6681a8700 1 --2- 172.21.15.123:0/103667291 >> v2:172.21.15.175:3300/0 conn(0x7fb66014b030 0x7fb66014b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:17.843 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.837+0000 7fb6681a8700 1 -- 172.21.15.123:0/103667291 >> 172.21.15.123:0/103667291 conn(0x7fb66009f270 msgr2=0x7fb66009f670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:17.843 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.837+0000 7fb6681a8700 1 -- 172.21.15.123:0/103667291 shutdown_connections 2023-03-08T15:49:17.843 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.837+0000 7fb6681a8700 1 -- 172.21.15.123:0/103667291 wait complete. 2023-03-08T15:49:17.843 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.838+0000 7fb6681a8700 1 Processor -- start 2023-03-08T15:49:17.843 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.838+0000 7fb6681a8700 1 -- start start 2023-03-08T15:49:17.844 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.838+0000 7fb6681a8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6600b9940 0x7fb6600a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:17.844 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb6681a8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6600b9d10 0x7fb660070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:17.844 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb6681a8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb66014b030 0x7fb66014bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:17.844 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb6681a8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600a2ff0 con 0x7fb66014b030 2023-03-08T15:49:17.844 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb6681a8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66006f950 con 0x7fb6600b9d10 2023-03-08T15:49:17.844 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb6681a8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb660070120 con 0x7fb6600b9940 2023-03-08T15:49:17.844 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb665743700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6600b9d10 0x7fb660070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:17.845 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb665f44700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6600b9940 0x7fb6600a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:17.845 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb665743700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6600b9d10 0x7fb660070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:41586/0 (socket says 172.21.15.123:41586) 2023-03-08T15:49:17.845 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb665f44700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6600b9940 0x7fb6600a2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:51832/0 (socket says 172.21.15.123:51832) 2023-03-08T15:49:17.845 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb666745700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb66014b030 0x7fb66014bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:17.845 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb665743700 1 -- 172.21.15.123:0/560682320 learned_addr learned my addr 172.21.15.123:0/560682320 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:17.845 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb665f44700 1 -- 172.21.15.123:0/560682320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6600b9d10 msgr2=0x7fb660070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:17.845 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb665f44700 1 --2- 172.21.15.123:0/560682320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6600b9d10 0x7fb660070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:17.845 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb665f44700 1 -- 172.21.15.123:0/560682320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb66014b030 msgr2=0x7fb66014bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:17.846 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb665f44700 1 --2- 172.21.15.123:0/560682320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb66014b030 0x7fb66014bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:17.846 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb665f44700 1 -- 172.21.15.123:0/560682320 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c009550 con 0x7fb6600b9940 2023-03-08T15:49:17.846 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb666745700 1 --2- 172.21.15.123:0/560682320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb66014b030 0x7fb66014bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:17.846 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb665f44700 1 --2- 172.21.15.123:0/560682320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6600b9940 0x7fb6600a2ab0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb66014f050 tx=0x7fb65c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:17.846 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb6567fc700 1 -- 172.21.15.123:0/560682320 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c004510 con 0x7fb6600b9940 2023-03-08T15:49:17.846 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb6567fc700 1 -- 172.21.15.123:0/560682320 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c01e070 con 0x7fb6600b9940 2023-03-08T15:49:17.846 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb6681a8700 1 -- 172.21.15.123:0/560682320 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66006d1e0 con 0x7fb6600b9940 2023-03-08T15:49:17.847 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb6567fc700 1 -- 172.21.15.123:0/560682320 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0038a0 con 0x7fb6600b9940 2023-03-08T15:49:17.847 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.839+0000 7fb6681a8700 1 -- 172.21.15.123:0/560682320 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66006cf00 con 0x7fb6600b9940 2023-03-08T15:49:17.847 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.840+0000 7fb6567fc700 1 -- 172.21.15.123:0/560682320 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fb65c00f050 con 0x7fb6600b9940 2023-03-08T15:49:17.847 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.840+0000 7fb6567fc700 1 -- 172.21.15.123:0/560682320 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb65c02dc60 con 0x7fb6600b9940 2023-03-08T15:49:17.847 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.840+0000 7fb6681a8700 1 -- 172.21.15.123:0/560682320 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66006d4c0 con 0x7fb6600b9940 2023-03-08T15:49:17.848 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:17.841+0000 7f399650f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-08T15:49:17.848 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.843+0000 7fb6567fc700 1 -- 172.21.15.123:0/560682320 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fb65c044b10 con 0x7fb6600b9940 2023-03-08T15:49:17.913 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.912+0000 7fb6681a8700 1 -- 172.21.15.123:0/560682320 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6600b7b90 con 0x7fb6600b9940 2023-03-08T15:49:17.914 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.913+0000 7fb6567fc700 1 -- 172.21.15.123:0/560682320 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb65c033020 con 0x7fb6600b9940 2023-03-08T15:49:17.914 INFO:teuthology.misc.health.smithi123.stdout: 2023-03-08T15:49:17.915 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":10,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:16.632999+0000","last_up_change":"0.000000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:49:17.915 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.914+0000 7fb6681a8700 1 -- 172.21.15.123:0/560682320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6600b9940 msgr2=0x7fb6600a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:17.916 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.914+0000 7fb6681a8700 1 --2- 172.21.15.123:0/560682320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6600b9940 0x7fb6600a2ab0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb66014f050 tx=0x7fb65c004750 comp rx=0 tx=0).stop 2023-03-08T15:49:17.916 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.914+0000 7fb6681a8700 1 -- 172.21.15.123:0/560682320 shutdown_connections 2023-03-08T15:49:17.916 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.914+0000 7fb6681a8700 1 --2- 172.21.15.123:0/560682320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb66014b030 0x7fb66014bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:17.916 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.914+0000 7fb6681a8700 1 --2- 172.21.15.123:0/560682320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6600b9940 0x7fb6600a2ab0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:17.916 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.914+0000 7fb6681a8700 1 --2- 172.21.15.123:0/560682320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6600b9d10 0x7fb660070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:17.916 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.914+0000 7fb6681a8700 1 -- 172.21.15.123:0/560682320 >> 172.21.15.123:0/560682320 conn(0x7fb66009f270 msgr2=0x7fb66009e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:17.917 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.914+0000 7fb6681a8700 1 -- 172.21.15.123:0/560682320 shutdown_connections 2023-03-08T15:49:17.917 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:17.914+0000 7fb6681a8700 1 -- 172.21.15.123:0/560682320 wait complete. 2023-03-08T15:49:17.918 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:17.917+0000 7f5c5a71a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-08T15:49:17.925 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-03-08T15:49:17.984 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:17.983+0000 7f399650f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-08T15:49:17.999 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:17.998+0000 7f5c5a71a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-08T15:49:18.078 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:18.077+0000 7f5c5a71a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-08T15:49:18.159 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:18.158+0000 7f5c5a71a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-08T15:49:18.237 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:18.235+0000 7f399650f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-08T15:49:18.377 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:18.376+0000 7f399650f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-08T15:49:18.458 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:18.456+0000 7f399650f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-08T15:49:18.537 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:18.536+0000 7f399650f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-08T15:49:18.615 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:18.614+0000 7f399650f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-08T15:49:18.942 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:18.941+0000 7f5c5a71a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-08T15:49:19.024 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:19.023+0000 7f5c5a71a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-08T15:49:19.099 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:19.098+0000 7f5c5a71a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-08T15:49:19.181 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:19.180+0000 7f5c5a71a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-08T15:49:19.330 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:19.329+0000 7f5c5a71a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-03-08T15:49:19.401 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:19.400+0000 7f399650f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-08T15:49:19.484 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:19.483+0000 7f399650f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-08T15:49:19.515 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:19.513+0000 7f5c5a71a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-08T15:49:19.589 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:19.559+0000 7f399650f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-08T15:49:19.643 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:19.641+0000 7f399650f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-08T15:49:19.799 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:19.798+0000 7f5c5a71a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-08T15:49:19.802 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:19.801+0000 7f399650f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-03-08T15:49:19.951 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:19.949+0000 7f5c5a71a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-08T15:49:19.986 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:19.985+0000 7f399650f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-08T15:49:20.358 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:20.357+0000 7f399650f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-08T15:49:20.516 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-03-08T15:49:20.514+0000 7f399650f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-08T15:49:20.807 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-03-08T15:49:20.805+0000 7f3a9efb5640 -1 osd.2 0 log_to_monitors true 2023-03-08T15:49:20.808 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T15:49:20.807+0000 7f75780c0640 -1 osd.4 0 log_to_monitors true 2023-03-08T15:49:20.816 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-03-08T15:49:20.815+0000 7f66247da640 -1 osd.0 0 log_to_monitors true 2023-03-08T15:49:20.822 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T15:49:20.820+0000 7f907333b640 -1 osd.7 0 log_to_monitors true 2023-03-08T15:49:20.822 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T15:49:20.821+0000 7f3e271ad640 -1 osd.5 0 log_to_monitors true 2023-03-08T15:49:20.823 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T15:49:20.822+0000 7f24f3b4e640 -1 osd.6 0 log_to_monitors true 2023-03-08T15:49:20.825 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-03-08T15:49:20.824+0000 7fcf42767640 -1 osd.1 0 log_to_monitors true 2023-03-08T15:49:20.839 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-03-08T15:49:20.838+0000 7f48d3493640 -1 osd.3 0 log_to_monitors true 2023-03-08T15:49:20.974 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:20.973+0000 7f5c141fc700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-03-08T15:49:20.975 INFO:tasks.ceph.mgr.y.smithi123.stderr:2023-03-08T15:49:20.973+0000 7f5c141fc700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-03-08T15:49:24.095 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T15:49:24.095+0000 7f24e76f5700 -1 osd.6 0 waiting for initial osdmap 2023-03-08T15:49:24.108 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T15:49:24.108+0000 7f24dfad0700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-08T15:49:24.124 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-03-08T15:49:24.122+0000 7fcf3630e700 -1 osd.1 0 waiting for initial osdmap 2023-03-08T15:49:24.124 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-03-08T15:49:24.122+0000 7f3a92b5c700 -1 osd.2 0 waiting for initial osdmap 2023-03-08T15:49:24.130 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T15:49:24.130+0000 7f756bc67700 -1 osd.4 0 waiting for initial osdmap 2023-03-08T15:49:24.132 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-03-08T15:49:24.131+0000 7f48c703a700 -1 osd.3 0 waiting for initial osdmap 2023-03-08T15:49:24.136 INFO:tasks.ceph.osd.2.smithi123.stderr:2023-03-08T15:49:24.135+0000 7f3a8af37700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-08T15:49:24.136 INFO:tasks.ceph.osd.1.smithi123.stderr:2023-03-08T15:49:24.135+0000 7fcf2e6e9700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-08T15:49:24.138 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-03-08T15:49:24.137+0000 7f6618381700 -1 osd.0 0 waiting for initial osdmap 2023-03-08T15:49:24.143 INFO:tasks.ceph.osd.3.smithi123.stderr:2023-03-08T15:49:24.142+0000 7f48bf415700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-08T15:49:24.147 INFO:tasks.ceph.osd.0.smithi123.stderr:2023-03-08T15:49:24.146+0000 7f661075c700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-08T15:49:24.154 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T15:49:24.154+0000 7f7564042700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-08T15:49:24.159 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T15:49:24.158+0000 7f3e1c557700 -1 osd.5 0 waiting for initial osdmap 2023-03-08T15:49:24.159 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T15:49:24.159+0000 7f9066ee2700 -1 osd.7 0 waiting for initial osdmap 2023-03-08T15:49:24.171 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T15:49:24.171+0000 7f3e1312f700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-08T15:49:24.177 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T15:49:24.177+0000 7f905f2bd700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-08T15:49:24.731 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-08T15:49:24.844 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.842+0000 7f0352c88700 1 Processor -- start 2023-03-08T15:49:24.844 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.842+0000 7f0352c88700 1 -- start start 2023-03-08T15:49:24.846 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.843+0000 7f0352c88700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f034c0bd510 0x7f034c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:24.846 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.843+0000 7f0352c88700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f034c0b5b90 0x7f034c144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:24.846 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.843+0000 7f0352c88700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f034c144d50 0x7f034c14a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:24.847 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.843+0000 7f0352c88700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034c0bca90 con 0x7f034c144d50 2023-03-08T15:49:24.847 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.843+0000 7f0352c88700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034c0b7110 con 0x7f034c0bd510 2023-03-08T15:49:24.847 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.843+0000 7f0352c88700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c0bcce0 con 0x7f034c0b5b90 2023-03-08T15:49:24.847 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.843+0000 7f0351225700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f034c144d50 0x7f034c14a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:24.847 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.843+0000 7f0351225700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f034c144d50 0x7f034c14a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35390/0 (socket says 172.21.15.123:35390) 2023-03-08T15:49:24.847 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.843+0000 7f0351225700 1 -- 172.21.15.123:0/512152142 learned_addr learned my addr 172.21.15.123:0/512152142 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:24.847 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.843+0000 7f034bfff700 1 --2- 172.21.15.123:0/512152142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f034c0b5b90 0x7f034c144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:24.848 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.843+0000 7f0351225700 1 -- 172.21.15.123:0/512152142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f034c0b5b90 msgr2=0x7f034c144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:24.848 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.843+0000 7f0350a24700 1 --2- 172.21.15.123:0/512152142 >> v2:172.21.15.175:3300/0 conn(0x7f034c0bd510 0x7f034c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:24.848 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f0351225700 1 --2- 172.21.15.123:0/512152142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f034c0b5b90 0x7f034c144810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:24.848 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f0351225700 1 -- 172.21.15.123:0/512152142 >> v2:172.21.15.175:3300/0 conn(0x7f034c0bd510 msgr2=0x7f034c0b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:24.848 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f0351225700 1 --2- 172.21.15.123:0/512152142 >> v2:172.21.15.175:3300/0 conn(0x7f034c0bd510 0x7f034c0b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:24.849 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f0351225700 1 -- 172.21.15.123:0/512152142 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c0bcfc0 con 0x7f034c144d50 2023-03-08T15:49:24.849 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f0350a24700 1 --2- 172.21.15.123:0/512152142 >> v2:172.21.15.175:3300/0 conn(0x7f034c0bd510 0x7f034c0b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:49:24.849 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f0351225700 1 --2- 172.21.15.123:0/512152142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f034c144d50 0x7f034c14a840 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f034c0c18c0 tx=0x7f034400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9176bd7f4f4d661c server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:24.849 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f034b7fe700 1 -- 172.21.15.123:0/512152142 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034400e070 con 0x7f034c144d50 2023-03-08T15:49:24.849 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f034b7fe700 1 -- 172.21.15.123:0/512152142 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034400b9c0 con 0x7f034c144d50 2023-03-08T15:49:24.849 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f034b7fe700 1 -- 172.21.15.123:0/512152142 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034400bd70 con 0x7f034c144d50 2023-03-08T15:49:24.849 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f0352c88700 1 -- 172.21.15.123:0/512152142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f034c144d50 msgr2=0x7f034c14a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:24.849 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f0352c88700 1 --2- 172.21.15.123:0/512152142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f034c144d50 0x7f034c14a840 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f034c0c18c0 tx=0x7f034400b330 comp rx=0 tx=0).stop 2023-03-08T15:49:24.850 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f0352c88700 1 -- 172.21.15.123:0/512152142 shutdown_connections 2023-03-08T15:49:24.850 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f0352c88700 1 --2- 172.21.15.123:0/512152142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f034c144d50 0x7f034c14a840 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:24.850 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f0352c88700 1 --2- 172.21.15.123:0/512152142 >> v2:172.21.15.175:3300/0 conn(0x7f034c0bd510 0x7f034c0b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:24.850 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f0352c88700 1 --2- 172.21.15.123:0/512152142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f034c0b5b90 0x7f034c144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:24.850 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f0352c88700 1 -- 172.21.15.123:0/512152142 >> 172.21.15.123:0/512152142 conn(0x7f034c06b1b0 msgr2=0x7f034c06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:24.850 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f0352c88700 1 -- 172.21.15.123:0/512152142 shutdown_connections 2023-03-08T15:49:24.850 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.844+0000 7f0352c88700 1 -- 172.21.15.123:0/512152142 wait complete. 2023-03-08T15:49:24.852 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.845+0000 7f0352c88700 1 Processor -- start 2023-03-08T15:49:24.853 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.845+0000 7f0352c88700 1 -- start start 2023-03-08T15:49:24.853 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.846+0000 7f0352c88700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f034c0b5b90 0x7f034c149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:24.853 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.846+0000 7f0352c88700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f034c0bd510 0x7f034c14c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:24.853 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.846+0000 7f0352c88700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f034c144d50 0x7f034c1453c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:24.853 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.846+0000 7f0352c88700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c14a2a0 con 0x7f034c0bd510 2023-03-08T15:49:24.853 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.846+0000 7f0352c88700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c0ba120 con 0x7f034c144d50 2023-03-08T15:49:24.853 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.846+0000 7f0352c88700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c14c820 con 0x7f034c0b5b90 2023-03-08T15:49:24.854 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.846+0000 7f034bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f034c0bd510 0x7f034c14c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:24.854 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.846+0000 7f034bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f034c0bd510 0x7f034c14c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35398/0 (socket says 172.21.15.123:35398) 2023-03-08T15:49:24.854 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.846+0000 7f034bfff700 1 -- 172.21.15.123:0/634147134 learned_addr learned my addr 172.21.15.123:0/634147134 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:24.854 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.846+0000 7f0350a24700 1 --2- 172.21.15.123:0/634147134 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f034c0b5b90 0x7f034c149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:24.854 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.846+0000 7f0351225700 1 --2- 172.21.15.123:0/634147134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f034c144d50 0x7f034c1453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:24.854 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.847+0000 7f034bfff700 1 -- 172.21.15.123:0/634147134 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f034c0b5b90 msgr2=0x7f034c149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:24.854 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.847+0000 7f034bfff700 1 --2- 172.21.15.123:0/634147134 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f034c0b5b90 0x7f034c149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:24.855 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.847+0000 7f034bfff700 1 -- 172.21.15.123:0/634147134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f034c144d50 msgr2=0x7f034c1453c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:24.855 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.847+0000 7f034bfff700 1 --2- 172.21.15.123:0/634147134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f034c144d50 0x7f034c1453c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:24.855 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.847+0000 7f034bfff700 1 -- 172.21.15.123:0/634147134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344009b30 con 0x7f034c0bd510 2023-03-08T15:49:24.855 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.847+0000 7f034bfff700 1 --2- 172.21.15.123:0/634147134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f034c0bd510 0x7f034c14c2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f033800c850 tx=0x7f033800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:24.855 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.847+0000 7f03497fa700 1 -- 172.21.15.123:0/634147134 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338004220 con 0x7f034c0bd510 2023-03-08T15:49:24.855 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.847+0000 7f03497fa700 1 -- 172.21.15.123:0/634147134 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0338004380 con 0x7f034c0bd510 2023-03-08T15:49:24.855 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.847+0000 7f0352c88700 1 -- 172.21.15.123:0/634147134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034c0b6bf0 con 0x7f034c0bd510 2023-03-08T15:49:24.855 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.847+0000 7f03497fa700 1 -- 172.21.15.123:0/634147134 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03380036a0 con 0x7f034c0bd510 2023-03-08T15:49:24.856 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.847+0000 7f0352c88700 1 -- 172.21.15.123:0/634147134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034c0b6910 con 0x7f034c0bd510 2023-03-08T15:49:24.856 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.848+0000 7f0352c88700 1 -- 172.21.15.123:0/634147134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034c0bd8e0 con 0x7f034c0bd510 2023-03-08T15:49:24.856 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.848+0000 7f03497fa700 1 -- 172.21.15.123:0/634147134 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) v1 ==== 87298+0+0 (secure 0 0 0) 0x7f0338020070 con 0x7f034c0bd510 2023-03-08T15:49:24.856 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.848+0000 7f03497fa700 1 --2- 172.21.15.123:0/634147134 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0330069880 0x7f033006bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:24.856 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.848+0000 7f03497fa700 1 -- 172.21.15.123:0/634147134 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f0338086040 con 0x7f034c0bd510 2023-03-08T15:49:24.856 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.849+0000 7f0350a24700 1 --2- 172.21.15.123:0/634147134 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0330069880 0x7f033006bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:24.856 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.849+0000 7f0350a24700 1 --2- 172.21.15.123:0/634147134 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0330069880 0x7f033006bd30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0340006fd0 tx=0x7f0340008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:24.857 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:24.853+0000 7f03497fa700 1 -- 172.21.15.123:0/634147134 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f0338052d50 con 0x7f034c0bd510 2023-03-08T15:49:25.042 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:25.041+0000 7f0352c88700 1 -- 172.21.15.123:0/634147134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f034c0744c0 con 0x7f034c0bd510 2023-03-08T15:49:25.043 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:25.041+0000 7f03497fa700 1 -- 172.21.15.123:0/634147134 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f033801e090 con 0x7f034c0bd510 2023-03-08T15:49:25.043 INFO:teuthology.misc.health.smithi123.stdout: 2023-03-08T15:49:25.043 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":12,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:22.027737+0000","last_up_change":"0.000000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:49:25.045 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:25.043+0000 7f0352c88700 1 -- 172.21.15.123:0/634147134 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0330069880 msgr2=0x7f033006bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:25.045 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:25.043+0000 7f0352c88700 1 --2- 172.21.15.123:0/634147134 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0330069880 0x7f033006bd30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0340006fd0 tx=0x7f0340008040 comp rx=0 tx=0).stop 2023-03-08T15:49:25.045 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:25.043+0000 7f0352c88700 1 -- 172.21.15.123:0/634147134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f034c0bd510 msgr2=0x7f034c14c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:25.046 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:25.043+0000 7f0352c88700 1 --2- 172.21.15.123:0/634147134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f034c0bd510 0x7f034c14c2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f033800c850 tx=0x7f033800cb60 comp rx=0 tx=0).stop 2023-03-08T15:49:25.046 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:25.044+0000 7f0352c88700 1 -- 172.21.15.123:0/634147134 shutdown_connections 2023-03-08T15:49:25.046 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:25.044+0000 7f0352c88700 1 --2- 172.21.15.123:0/634147134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f034c144d50 0x7f034c1453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:25.046 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:25.044+0000 7f0352c88700 1 --2- 172.21.15.123:0/634147134 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0330069880 0x7f033006bd30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:25.046 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:25.044+0000 7f0352c88700 1 --2- 172.21.15.123:0/634147134 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f034c0b5b90 0x7f034c149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:25.046 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:25.044+0000 7f0352c88700 1 --2- 172.21.15.123:0/634147134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f034c0bd510 0x7f034c14c2e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:25.046 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:25.044+0000 7f0352c88700 1 -- 172.21.15.123:0/634147134 >> 172.21.15.123:0/634147134 conn(0x7f034c06b1b0 msgr2=0x7f034c140e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:25.046 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:25.044+0000 7f0352c88700 1 -- 172.21.15.123:0/634147134 shutdown_connections 2023-03-08T15:49:25.047 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:25.044+0000 7f0352c88700 1 -- 172.21.15.123:0/634147134 wait complete. 2023-03-08T15:49:25.056 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-03-08T15:49:31.861 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-08T15:49:31.985 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.984+0000 7f0ace56d700 1 Processor -- start 2023-03-08T15:49:31.986 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.984+0000 7f0ace56d700 1 -- start start 2023-03-08T15:49:31.987 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.985+0000 7f0ace56d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0ac814e8b0 0x7f0ac80ba400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:31.987 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.985+0000 7f0ace56d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac814dd10 con 0x7f0ac80b9fb0 2023-03-08T15:49:31.987 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.985+0000 7f0ace56d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac80bb890 con 0x7f0ac8144990 2023-03-08T15:49:31.988 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.985+0000 7f0ace56d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac80be410 con 0x7f0ac814e8b0 2023-03-08T15:49:31.988 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.985+0000 7f0ac77fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0ac80b9fb0 0x7f0ac814e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36724/0 (socket says 172.21.15.123:36724) 2023-03-08T15:49:31.988 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.985+0000 7f0ac77fe700 1 -- 172.21.15.123:0/3328304232 learned_addr learned my addr 172.21.15.123:0/3328304232 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:31.988 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.985+0000 7f0accb0a700 1 --2- 172.21.15.123:0/3328304232 >> v2:172.21.15.175:3300/0 conn(0x7f0ac814e8b0 0x7f0ac80ba400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:31.988 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.985+0000 7f0ac6ffd700 1 -- 172.21.15.123:0/3328304232 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959817060 0 0) 0x7f0ac814dd10 con 0x7f0ac80b9fb0 2023-03-08T15:49:31.988 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.985+0000 7f0ac6ffd700 1 -- 172.21.15.123:0/3328304232 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ab40035b0 con 0x7f0ac80b9fb0 2023-03-08T15:49:31.988 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.985+0000 7f0accb0a700 1 -- 172.21.15.123:0/3328304232 >> v1:172.21.15.175:6789/0 conn(0x7f0ac8144990 legacy=0x7f0ac80bdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:31.988 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.985+0000 7f0ac6ffd700 1 -- 172.21.15.123:0/3328304232 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119160073 0 0) 0x7f0ac80bb890 con 0x7f0ac8144990 2023-03-08T15:49:31.989 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.985+0000 7f0accb0a700 1 -- 172.21.15.123:0/3328304232 >> v1:172.21.15.123:6789/0 conn(0x7f0ac80b9fb0 legacy=0x7f0ac814e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:31.989 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.985+0000 7f0accb0a700 1 -- 172.21.15.123:0/3328304232 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8144d60 con 0x7f0ac814e8b0 2023-03-08T15:49:31.989 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.986+0000 7f0accb0a700 1 --2- 172.21.15.123:0/3328304232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac814e8b0 0x7f0ac80ba400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009d90 tx=0x7f0ac000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a786394f9c22f882 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:31.989 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.986+0000 7f0ac6ffd700 1 -- 172.21.15.123:0/3328304232 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac000e070 con 0x7f0ac814e8b0 2023-03-08T15:49:31.989 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.986+0000 7f0ac6ffd700 1 -- 172.21.15.123:0/3328304232 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac0003a20 con 0x7f0ac814e8b0 2023-03-08T15:49:31.989 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.986+0000 7f0ac6ffd700 1 -- 172.21.15.123:0/3328304232 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8001670 con 0x7f0ac814e8b0 2023-03-08T15:49:31.991 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.986+0000 7f0ace56d700 1 -- 172.21.15.123:0/3328304232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac814e8b0 msgr2=0x7f0ac80ba400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:31.992 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.986+0000 7f0ace56d700 1 --2- 172.21.15.123:0/3328304232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac814e8b0 0x7f0ac80ba400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009d90 tx=0x7f0ac000b330 comp rx=0 tx=0).stop 2023-03-08T15:49:31.992 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.986+0000 7f0ace56d700 1 -- 172.21.15.123:0/3328304232 shutdown_connections 2023-03-08T15:49:31.992 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.986+0000 7f0ace56d700 1 --2- 172.21.15.123:0/3328304232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac814e8b0 0x7f0ac80ba400 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:31.992 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.986+0000 7f0ace56d700 1 -- 172.21.15.123:0/3328304232 >> 172.21.15.123:0/3328304232 conn(0x7f0ac806a250 msgr2=0x7f0ac806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:31.992 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.986+0000 7f0ace56d700 1 -- 172.21.15.123:0/3328304232 shutdown_connections 2023-03-08T15:49:31.992 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.986+0000 7f0ace56d700 1 -- 172.21.15.123:0/3328304232 wait complete. 2023-03-08T15:49:31.992 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.988+0000 7f0ace56d700 1 Processor -- start 2023-03-08T15:49:31.993 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.988+0000 7f0ace56d700 1 -- start start 2023-03-08T15:49:31.993 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0ace56d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ac80b9fb0 0x7f0ac81dfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:31.993 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0ace56d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac8144990 0x7f0ac80b8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:31.993 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0ace56d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac814e8b0 0x7f0ac80b8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:31.993 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0ace56d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac81e0db0 con 0x7f0ac8144990 2023-03-08T15:49:31.993 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0ace56d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8144f50 con 0x7f0ac814e8b0 2023-03-08T15:49:31.993 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0ace56d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8145480 con 0x7f0ac80b9fb0 2023-03-08T15:49:31.993 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0ac77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac8144990 0x7f0ac80b8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:31.994 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0ac77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac8144990 0x7f0ac80b8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56916/0 (socket says 172.21.15.123:56916) 2023-03-08T15:49:31.994 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0ac77fe700 1 -- 172.21.15.123:0/1156656270 learned_addr learned my addr 172.21.15.123:0/1156656270 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:31.994 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0accb0a700 1 --2- 172.21.15.123:0/1156656270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac814e8b0 0x7f0ac80b8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:31.994 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0ac7fff700 1 --2- 172.21.15.123:0/1156656270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ac80b9fb0 0x7f0ac81dfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:31.994 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0ac77fe700 1 -- 172.21.15.123:0/1156656270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ac80b9fb0 msgr2=0x7f0ac81dfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:31.994 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0ac77fe700 1 --2- 172.21.15.123:0/1156656270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ac80b9fb0 0x7f0ac81dfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:31.994 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0ac77fe700 1 -- 172.21.15.123:0/1156656270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac814e8b0 msgr2=0x7f0ac80b8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:31.995 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0ac77fe700 1 --2- 172.21.15.123:0/1156656270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac814e8b0 0x7f0ac80b8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:31.995 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.989+0000 7f0ac77fe700 1 -- 172.21.15.123:0/1156656270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac0009a70 con 0x7f0ac8144990 2023-03-08T15:49:31.995 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.990+0000 7f0ac77fe700 1 --2- 172.21.15.123:0/1156656270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac8144990 0x7f0ac80b8030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800cac0 tx=0x7f0ab800cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:31.995 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.990+0000 7f0ac4ff9700 1 -- 172.21.15.123:0/1156656270 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8004a70 con 0x7f0ac8144990 2023-03-08T15:49:31.995 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.990+0000 7f0ac4ff9700 1 -- 172.21.15.123:0/1156656270 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab8004bd0 con 0x7f0ac8144990 2023-03-08T15:49:31.995 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.990+0000 7f0ac4ff9700 1 -- 172.21.15.123:0/1156656270 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8007e20 con 0x7f0ac8144990 2023-03-08T15:49:31.995 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.990+0000 7f0ace56d700 1 -- 172.21.15.123:0/1156656270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac80bb5b0 con 0x7f0ac8144990 2023-03-08T15:49:31.995 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.990+0000 7f0ace56d700 1 -- 172.21.15.123:0/1156656270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac80bb2d0 con 0x7f0ac8144990 2023-03-08T15:49:31.996 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.991+0000 7f0ace56d700 1 -- 172.21.15.123:0/1156656270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac80baf90 con 0x7f0ac8144990 2023-03-08T15:49:31.996 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.991+0000 7f0ac4ff9700 1 -- 172.21.15.123:0/1156656270 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f0ab8010070 con 0x7f0ac8144990 2023-03-08T15:49:31.996 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.991+0000 7f0ac4ff9700 1 --2- 172.21.15.123:0/1156656270 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0aa8069900 0x7f0aa806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:31.997 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.992+0000 7f0ac7fff700 1 --2- 172.21.15.123:0/1156656270 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0aa8069900 0x7f0aa806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:31.997 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.992+0000 7f0ac4ff9700 1 -- 172.21.15.123:0/1156656270 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0ab80860f0 con 0x7f0ac8144990 2023-03-08T15:49:31.997 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.992+0000 7f0ac7fff700 1 --2- 172.21.15.123:0/1156656270 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0aa8069900 0x7f0aa806bdb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0000f60 tx=0x7f0ab0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:31.997 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:31.996+0000 7f0ac4ff9700 1 -- 172.21.15.123:0/1156656270 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f0ab8052370 con 0x7f0ac8144990 2023-03-08T15:49:32.182 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:32.181+0000 7f0ace56d700 1 -- 172.21.15.123:0/1156656270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ac80744c0 con 0x7f0ac8144990 2023-03-08T15:49:32.183 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:32.182+0000 7f0ac4ff9700 1 -- 172.21.15.123:0/1156656270 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12526 (secure 0 0 0) 0x7f0ab8055990 con 0x7f0ac8144990 2023-03-08T15:49:32.184 INFO:teuthology.misc.health.smithi123.stdout: 2023-03-08T15:49:32.184 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":16,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:28.441539+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:49:32.185 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:32.184+0000 7f0ace56d700 1 -- 172.21.15.123:0/1156656270 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0aa8069900 msgr2=0x7f0aa806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:32.186 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:32.184+0000 7f0ace56d700 1 --2- 172.21.15.123:0/1156656270 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0aa8069900 0x7f0aa806bdb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0000f60 tx=0x7f0ab0009040 comp rx=0 tx=0).stop 2023-03-08T15:49:32.186 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:32.184+0000 7f0ace56d700 1 -- 172.21.15.123:0/1156656270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac8144990 msgr2=0x7f0ac80b8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:32.186 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:32.184+0000 7f0ace56d700 1 --2- 172.21.15.123:0/1156656270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac8144990 0x7f0ac80b8030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800cac0 tx=0x7f0ab800cdd0 comp rx=0 tx=0).stop 2023-03-08T15:49:32.186 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:32.184+0000 7f0ace56d700 1 -- 172.21.15.123:0/1156656270 shutdown_connections 2023-03-08T15:49:32.186 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:32.184+0000 7f0ace56d700 1 --2- 172.21.15.123:0/1156656270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac814e8b0 0x7f0ac80b8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:32.186 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:32.184+0000 7f0ace56d700 1 --2- 172.21.15.123:0/1156656270 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0aa8069900 0x7f0aa806bdb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:32.187 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:32.184+0000 7f0ace56d700 1 --2- 172.21.15.123:0/1156656270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ac80b9fb0 0x7f0ac81dfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:32.187 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:32.184+0000 7f0ace56d700 1 --2- 172.21.15.123:0/1156656270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ac8144990 0x7f0ac80b8030 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:32.187 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:32.184+0000 7f0ace56d700 1 -- 172.21.15.123:0/1156656270 >> 172.21.15.123:0/1156656270 conn(0x7f0ac806a250 msgr2=0x7f0ac80bc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:32.187 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:32.184+0000 7f0ace56d700 1 -- 172.21.15.123:0/1156656270 shutdown_connections 2023-03-08T15:49:32.187 INFO:teuthology.misc.health.smithi123.stderr:2023-03-08T15:49:32.184+0000 7f0ace56d700 1 -- 172.21.15.123:0/1156656270 wait complete. 2023-03-08T15:49:32.196 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-03-08T15:49:32.197 INFO:tasks.ceph:Creating RBD pool 2023-03-08T15:49:32.197 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd pool create rbd 8 2023-03-08T15:49:32.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.315+0000 7f49ad311700 1 Processor -- start 2023-03-08T15:49:32.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.315+0000 7f49ad311700 1 -- start start 2023-03-08T15:49:32.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.315+0000 7f49ad311700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f49a806aee0 0x7f49a80b7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:32.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.315+0000 7f49ad311700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49a80b8320 0x7f49a80b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:32.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.315+0000 7f49ad311700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a80b59c0 con 0x7f49a8140990 2023-03-08T15:49:32.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.315+0000 7f49ad311700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a80b7e40 con 0x7f49a806aee0 2023-03-08T15:49:32.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.315+0000 7f49ad311700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80b8b10 con 0x7f49a80b8320 2023-03-08T15:49:32.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.316+0000 7f49a6ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f49a806aee0 0x7f49a80b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:32.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.316+0000 7f49a6ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f49a806aee0 0x7f49a80b7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56922/0 (socket says 172.21.15.123:56922) 2023-03-08T15:49:32.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.316+0000 7f49a77fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f49a8140990 0x7f49a8146fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36732/0 (socket says 172.21.15.123:36732) 2023-03-08T15:49:32.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.316+0000 7f49a6ffd700 1 -- 172.21.15.123:0/1664911363 learned_addr learned my addr 172.21.15.123:0/1664911363 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:32.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.316+0000 7f49a6ffd700 1 -- 172.21.15.123:0/1664911363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49a80b8320 msgr2=0x7f49a80b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:32.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.316+0000 7f49a67fc700 1 --2- 172.21.15.123:0/1664911363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49a80b8320 0x7f49a80b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:32.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.316+0000 7f49a6ffd700 1 --2- 172.21.15.123:0/1664911363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49a80b8320 0x7f49a80b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:32.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.316+0000 7f49a6ffd700 1 -- 172.21.15.123:0/1664911363 >> v1:172.21.15.123:6789/0 conn(0x7f49a8140990 legacy=0x7f49a8146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:32.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.316+0000 7f49a6ffd700 1 -- 172.21.15.123:0/1664911363 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a80b56e0 con 0x7f49a806aee0 2023-03-08T15:49:32.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.316+0000 7f49a5ffb700 1 -- 172.21.15.123:0/1664911363 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424110626 0 0) 0x7f49a80b59c0 con 0x7f49a8140990 2023-03-08T15:49:32.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.316+0000 7f49a6ffd700 1 --2- 172.21.15.123:0/1664911363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49a806aee0 0x7f49a80b7900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f49980098f0 tx=0x7f4998009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e97699dd2d2cfe4 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:32.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.316+0000 7f49a5ffb700 1 -- 172.21.15.123:0/1664911363 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499800b8a0 con 0x7f49a806aee0 2023-03-08T15:49:32.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.316+0000 7f49a5ffb700 1 -- 172.21.15.123:0/1664911363 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499800ba00 con 0x7f49a806aee0 2023-03-08T15:49:32.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.316+0000 7f49a5ffb700 1 -- 172.21.15.123:0/1664911363 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499800bd90 con 0x7f49a806aee0 2023-03-08T15:49:32.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.317+0000 7f49ad311700 1 -- 172.21.15.123:0/1664911363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49a806aee0 msgr2=0x7f49a80b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:32.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.317+0000 7f49ad311700 1 --2- 172.21.15.123:0/1664911363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49a806aee0 0x7f49a80b7900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f49980098f0 tx=0x7f4998009c00 comp rx=0 tx=0).stop 2023-03-08T15:49:32.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.317+0000 7f49ad311700 1 -- 172.21.15.123:0/1664911363 shutdown_connections 2023-03-08T15:49:32.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.317+0000 7f49ad311700 1 --2- 172.21.15.123:0/1664911363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49a806aee0 0x7f49a80b7900 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:32.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.317+0000 7f49ad311700 1 --2- 172.21.15.123:0/1664911363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49a80b8320 0x7f49a80b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:32.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.317+0000 7f49ad311700 1 -- 172.21.15.123:0/1664911363 >> 172.21.15.123:0/1664911363 conn(0x7f49a80bc480 msgr2=0x7f49a80bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:32.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.317+0000 7f49ad311700 1 -- 172.21.15.123:0/1664911363 shutdown_connections 2023-03-08T15:49:32.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.317+0000 7f49ad311700 1 -- 172.21.15.123:0/1664911363 wait complete. 2023-03-08T15:49:32.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.318+0000 7f49ad311700 1 Processor -- start 2023-03-08T15:49:32.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.318+0000 7f49ad311700 1 -- start start 2023-03-08T15:49:32.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49ad311700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49a806aee0 0x7f49a813faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:32.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49ad311700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49a80b8320 0x7f49a8131de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:32.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49ad311700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49a8140990 0x7f49a8132320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49ad311700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a813ffe0 con 0x7f49a80b8320 2023-03-08T15:49:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49ad311700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a8154b00 con 0x7f49a806aee0 2023-03-08T15:49:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49ad311700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a8154de0 con 0x7f49a8140990 2023-03-08T15:49:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49a67fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49a80b8320 0x7f49a8131de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49a67fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49a80b8320 0x7f49a8131de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56936/0 (socket says 172.21.15.123:56936) 2023-03-08T15:49:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49a67fc700 1 -- 172.21.15.123:0/665148069 learned_addr learned my addr 172.21.15.123:0/665148069 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:32.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49a77fe700 1 --2- 172.21.15.123:0/665148069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49a8140990 0x7f49a8132320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:32.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49a67fc700 1 -- 172.21.15.123:0/665148069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49a8140990 msgr2=0x7f49a8132320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:32.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49a6ffd700 1 --2- 172.21.15.123:0/665148069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49a806aee0 0x7f49a813faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:32.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49a67fc700 1 --2- 172.21.15.123:0/665148069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49a8140990 0x7f49a8132320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:32.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49a67fc700 1 -- 172.21.15.123:0/665148069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49a806aee0 msgr2=0x7f49a813faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:32.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49a67fc700 1 --2- 172.21.15.123:0/665148069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49a806aee0 0x7f49a813faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:32.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49a67fc700 1 -- 172.21.15.123:0/665148069 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4998009550 con 0x7f49a80b8320 2023-03-08T15:49:32.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49a77fe700 1 --2- 172.21.15.123:0/665148069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49a8140990 0x7f49a8132320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:49:32.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49a67fc700 1 --2- 172.21.15.123:0/665148069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49a80b8320 0x7f49a8131de0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f499c00c7f0 tx=0x7f499c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:32.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f498f7fe700 1 -- 172.21.15.123:0/665148069 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c011800 con 0x7f49a80b8320 2023-03-08T15:49:32.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f498f7fe700 1 -- 172.21.15.123:0/665148069 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c011960 con 0x7f49a80b8320 2023-03-08T15:49:32.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49ad311700 1 -- 172.21.15.123:0/665148069 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a80bd360 con 0x7f49a80b8320 2023-03-08T15:49:32.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f498f7fe700 1 -- 172.21.15.123:0/665148069 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c011cf0 con 0x7f49a80b8320 2023-03-08T15:49:32.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.319+0000 7f49ad311700 1 -- 172.21.15.123:0/665148069 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a80bd1d0 con 0x7f49a80b8320 2023-03-08T15:49:32.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.320+0000 7f49ad311700 1 -- 172.21.15.123:0/665148069 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a80b7340 con 0x7f49a80b8320 2023-03-08T15:49:32.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.321+0000 7f498f7fe700 1 -- 172.21.15.123:0/665148069 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f499c021070 con 0x7f49a80b8320 2023-03-08T15:49:32.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.321+0000 7f498f7fe700 1 --2- 172.21.15.123:0/665148069 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f49940698d0 0x7f499406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:32.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.321+0000 7f498f7fe700 1 -- 172.21.15.123:0/665148069 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f499c0870e0 con 0x7f49a80b8320 2023-03-08T15:49:32.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.321+0000 7f49a6ffd700 1 --2- 172.21.15.123:0/665148069 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f49940698d0 0x7f499406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:32.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.321+0000 7f49a6ffd700 1 --2- 172.21.15.123:0/665148069 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f49940698d0 0x7f499406bd80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4998009c40 tx=0x7f4998008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:32.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.325+0000 7f498f7fe700 1 -- 172.21.15.123:0/665148069 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f499c0532e0 con 0x7f49a80b8320 2023-03-08T15:49:32.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:32.510+0000 7f49ad311700 1 -- 172.21.15.123:0/665148069 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f49a80b61f0 con 0x7f49a80b8320 2023-03-08T15:49:33.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.033+0000 7f498f7fe700 1 -- 172.21.15.123:0/665148069 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f499c01f0a0 con 0x7f49a80b8320 2023-03-08T15:49:33.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.035+0000 7f49ad311700 1 -- 172.21.15.123:0/665148069 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f49940698d0 msgr2=0x7f499406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:33.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.036+0000 7f49ad311700 1 --2- 172.21.15.123:0/665148069 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f49940698d0 0x7f499406bd80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4998009c40 tx=0x7f4998008030 comp rx=0 tx=0).stop 2023-03-08T15:49:33.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.036+0000 7f49ad311700 1 -- 172.21.15.123:0/665148069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49a80b8320 msgr2=0x7f49a8131de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:33.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.036+0000 7f49ad311700 1 --2- 172.21.15.123:0/665148069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49a80b8320 0x7f49a8131de0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f499c00c7f0 tx=0x7f499c00cbb0 comp rx=0 tx=0).stop 2023-03-08T15:49:33.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.036+0000 7f49ad311700 1 -- 172.21.15.123:0/665148069 shutdown_connections 2023-03-08T15:49:33.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.036+0000 7f49ad311700 1 --2- 172.21.15.123:0/665148069 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f49940698d0 0x7f499406bd80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:33.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.036+0000 7f49ad311700 1 --2- 172.21.15.123:0/665148069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49a8140990 0x7f49a8132320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.036+0000 7f49ad311700 1 --2- 172.21.15.123:0/665148069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49a806aee0 0x7f49a813faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.036+0000 7f49ad311700 1 --2- 172.21.15.123:0/665148069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49a80b8320 0x7f49a8131de0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.036+0000 7f49ad311700 1 -- 172.21.15.123:0/665148069 >> 172.21.15.123:0/665148069 conn(0x7f49a80bc480 msgr2=0x7f49a80b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.036+0000 7f49ad311700 1 -- 172.21.15.123:0/665148069 shutdown_connections 2023-03-08T15:49:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.036+0000 7f49ad311700 1 -- 172.21.15.123:0/665148069 wait complete. 2023-03-08T15:49:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'rbd' created 2023-03-08T15:49:33.050 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-03-08T15:49:33.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.174+0000 7f0245237700 1 Processor -- start 2023-03-08T15:49:33.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.174+0000 7f0245237700 1 -- start start 2023-03-08T15:49:33.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.174+0000 7f0245237700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f02400bdcb0 0x7f02400be130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:33.178 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.174+0000 7f0245237700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024014dc00 con 0x7f024014e090 2023-03-08T15:49:33.178 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.174+0000 7f0245237700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024006bb70 con 0x7f02400bb350 2023-03-08T15:49:33.178 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.174+0000 7f0245237700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0240144dc0 con 0x7f02400bdcb0 2023-03-08T15:49:33.178 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.174+0000 7f023f59e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f024014e090 0x7f024014e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36748/0 (socket says 172.21.15.123:36748) 2023-03-08T15:49:33.178 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.174+0000 7f023f59e700 1 -- 172.21.15.123:0/433553238 learned_addr learned my addr 172.21.15.123:0/433553238 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:33.178 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.175+0000 7f023e59c700 1 --2- 172.21.15.123:0/433553238 >> v2:172.21.15.175:3300/0 conn(0x7f02400bdcb0 0x7f02400be130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:33.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.175+0000 7f023dd9b700 1 -- 172.21.15.123:0/433553238 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837728971 0 0) 0x7f024014dc00 con 0x7f024014e090 2023-03-08T15:49:33.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.175+0000 7f023dd9b700 1 -- 172.21.15.123:0/433553238 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02280035b0 con 0x7f024014e090 2023-03-08T15:49:33.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.175+0000 7f023dd9b700 1 -- 172.21.15.123:0/433553238 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45615432 0 0) 0x7f024006bb70 con 0x7f02400bb350 2023-03-08T15:49:33.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.175+0000 7f023dd9b700 1 -- 172.21.15.123:0/433553238 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f024014dc00 con 0x7f02400bb350 2023-03-08T15:49:33.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.175+0000 7f023e59c700 1 -- 172.21.15.123:0/433553238 >> v1:172.21.15.175:6789/0 conn(0x7f02400bb350 legacy=0x7f02401446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:33.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.175+0000 7f023e59c700 1 -- 172.21.15.123:0/433553238 >> v1:172.21.15.123:6789/0 conn(0x7f024014e090 legacy=0x7f024014e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:33.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.175+0000 7f023dd9b700 1 -- 172.21.15.123:0/433553238 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1005514626 0 0) 0x7f02280035b0 con 0x7f024014e090 2023-03-08T15:49:33.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.175+0000 7f023e59c700 1 -- 172.21.15.123:0/433553238 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02400b9fc0 con 0x7f02400bdcb0 2023-03-08T15:49:33.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.175+0000 7f023e59c700 1 --2- 172.21.15.123:0/433553238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02400bdcb0 0x7f02400be130 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f024006bd00 tx=0x7f0234009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=210accbd13e48ad3 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:33.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.175+0000 7f023dd9b700 1 -- 172.21.15.123:0/433553238 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02380019f0 con 0x7f02400bdcb0 2023-03-08T15:49:33.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.175+0000 7f023dd9b700 1 -- 172.21.15.123:0/433553238 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0234004030 con 0x7f02400bdcb0 2023-03-08T15:49:33.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.175+0000 7f023dd9b700 1 -- 172.21.15.123:0/433553238 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02340043a0 con 0x7f02400bdcb0 2023-03-08T15:49:33.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.176+0000 7f0245237700 1 -- 172.21.15.123:0/433553238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02400bdcb0 msgr2=0x7f02400be130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:33.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.176+0000 7f0245237700 1 --2- 172.21.15.123:0/433553238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02400bdcb0 0x7f02400be130 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f024006bd00 tx=0x7f0234009b20 comp rx=0 tx=0).stop 2023-03-08T15:49:33.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.176+0000 7f0245237700 1 -- 172.21.15.123:0/433553238 shutdown_connections 2023-03-08T15:49:33.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.176+0000 7f0245237700 1 --2- 172.21.15.123:0/433553238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02400bdcb0 0x7f02400be130 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:33.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.176+0000 7f0245237700 1 -- 172.21.15.123:0/433553238 >> 172.21.15.123:0/433553238 conn(0x7f024006a250 msgr2=0x7f024006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:33.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.176+0000 7f0245237700 1 -- 172.21.15.123:0/433553238 shutdown_connections 2023-03-08T15:49:33.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.176+0000 7f0245237700 1 -- 172.21.15.123:0/433553238 wait complete. 2023-03-08T15:49:33.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.178+0000 7f0245237700 1 Processor -- start 2023-03-08T15:49:33.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.178+0000 7f0245237700 1 -- start start 2023-03-08T15:49:33.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.178+0000 7f0245237700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02400bb350 0x7f02401e1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:33.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.178+0000 7f0245237700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02400bdcb0 0x7f0240137920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:33.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.178+0000 7f0245237700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f024014e090 0x7f02401d6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:33.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.178+0000 7f0245237700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02401d6890 con 0x7f024014e090 2023-03-08T15:49:33.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.178+0000 7f0245237700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02401e0540 con 0x7f02400bb350 2023-03-08T15:49:33.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.178+0000 7f0245237700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02401e0820 con 0x7f02400bdcb0 2023-03-08T15:49:33.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f023f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f024014e090 0x7f02401d6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:33.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f023f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f024014e090 0x7f02401d6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56948/0 (socket says 172.21.15.123:56948) 2023-03-08T15:49:33.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f023f59e700 1 -- 172.21.15.123:0/1666514703 learned_addr learned my addr 172.21.15.123:0/1666514703 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:33.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f023e59c700 1 --2- 172.21.15.123:0/1666514703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02400bdcb0 0x7f0240137920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:33.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f023ed9d700 1 --2- 172.21.15.123:0/1666514703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02400bb350 0x7f02401e1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:33.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f023f59e700 1 -- 172.21.15.123:0/1666514703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02400bdcb0 msgr2=0x7f0240137920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:33.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f023f59e700 1 --2- 172.21.15.123:0/1666514703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02400bdcb0 0x7f0240137920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:33.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f023f59e700 1 -- 172.21.15.123:0/1666514703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02400bb350 msgr2=0x7f02401e1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:33.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f023f59e700 1 --2- 172.21.15.123:0/1666514703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02400bb350 0x7f02401e1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:33.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f023f59e700 1 -- 172.21.15.123:0/1666514703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02340094a0 con 0x7f024014e090 2023-03-08T15:49:33.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f023f59e700 1 --2- 172.21.15.123:0/1666514703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f024014e090 0x7f02401d6350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f023800cba0 tx=0x7f023800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:33.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f02277fe700 1 -- 172.21.15.123:0/1666514703 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023800aaa0 con 0x7f024014e090 2023-03-08T15:49:33.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f02277fe700 1 -- 172.21.15.123:0/1666514703 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023800ac20 con 0x7f024014e090 2023-03-08T15:49:33.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f02277fe700 1 -- 172.21.15.123:0/1666514703 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02380070d0 con 0x7f024014e090 2023-03-08T15:49:33.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f0245237700 1 -- 172.21.15.123:0/1666514703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02400ba580 con 0x7f024014e090 2023-03-08T15:49:33.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.179+0000 7f0245237700 1 -- 172.21.15.123:0/1666514703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02400ba2a0 con 0x7f024014e090 2023-03-08T15:49:33.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.180+0000 7f0245237700 1 -- 172.21.15.123:0/1666514703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02400bb720 con 0x7f024014e090 2023-03-08T15:49:33.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.181+0000 7f02277fe700 1 -- 172.21.15.123:0/1666514703 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f0238010070 con 0x7f024014e090 2023-03-08T15:49:33.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.181+0000 7f02277fe700 1 --2- 172.21.15.123:0/1666514703 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f022c069900 0x7f022c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:33.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.181+0000 7f02277fe700 1 -- 172.21.15.123:0/1666514703 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f0238086c60 con 0x7f024014e090 2023-03-08T15:49:33.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.181+0000 7f023ed9d700 1 --2- 172.21.15.123:0/1666514703 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f022c069900 0x7f022c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:33.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.181+0000 7f023ed9d700 1 --2- 172.21.15.123:0/1666514703 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f022c069900 0x7f022c06bdb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02300011e0 tx=0x7f0230009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:33.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.185+0000 7f02277fe700 1 -- 172.21.15.123:0/1666514703 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f0238052d90 con 0x7f024014e090 2023-03-08T15:49:33.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:33.370+0000 7f0245237700 1 -- 172.21.15.123:0/1666514703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f02400bbe30 con 0x7f024014e090 2023-03-08T15:49:34.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.031+0000 7f02277fe700 1 -- 172.21.15.123:0/1666514703 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0238018020 con 0x7f024014e090 2023-03-08T15:49:34.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.035+0000 7f0245237700 1 -- 172.21.15.123:0/1666514703 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f022c069900 msgr2=0x7f022c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.035+0000 7f0245237700 1 --2- 172.21.15.123:0/1666514703 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f022c069900 0x7f022c06bdb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02300011e0 tx=0x7f0230009040 comp rx=0 tx=0).stop 2023-03-08T15:49:34.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.035+0000 7f0245237700 1 -- 172.21.15.123:0/1666514703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f024014e090 msgr2=0x7f02401d6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.035+0000 7f0245237700 1 --2- 172.21.15.123:0/1666514703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f024014e090 0x7f02401d6350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f023800cba0 tx=0x7f023800ceb0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.035+0000 7f0245237700 1 -- 172.21.15.123:0/1666514703 shutdown_connections 2023-03-08T15:49:34.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.035+0000 7f0245237700 1 --2- 172.21.15.123:0/1666514703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f024014e090 0x7f02401d6350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.035+0000 7f0245237700 1 --2- 172.21.15.123:0/1666514703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02400bb350 0x7f02401e1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.035+0000 7f0245237700 1 --2- 172.21.15.123:0/1666514703 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f022c069900 0x7f022c06bdb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.035+0000 7f0245237700 1 --2- 172.21.15.123:0/1666514703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02400bdcb0 0x7f0240137920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.035+0000 7f0245237700 1 -- 172.21.15.123:0/1666514703 >> 172.21.15.123:0/1666514703 conn(0x7f024006a250 msgr2=0x7f02400bce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:34.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.035+0000 7f0245237700 1 -- 172.21.15.123:0/1666514703 shutdown_connections 2023-03-08T15:49:34.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.035+0000 7f0245237700 1 -- 172.21.15.123:0/1666514703 wait complete. 2023-03-08T15:49:34.039 INFO:teuthology.orchestra.run.smithi123.stderr:enabled application 'rbd' on pool 'rbd' 2023-03-08T15:49:34.051 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-03-08T15:49:34.051 INFO:tasks.ceph.mds.a:Restarting daemon 2023-03-08T15:49:34.052 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-03-08T15:49:34.054 INFO:tasks.ceph.mds.a:Started 2023-03-08T15:49:34.054 INFO:tasks.ceph.mds.c:Restarting daemon 2023-03-08T15:49:34.054 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-03-08T15:49:34.056 INFO:tasks.ceph.mds.c:Started 2023-03-08T15:49:34.056 INFO:tasks.ceph.mds.b:Restarting daemon 2023-03-08T15:49:34.056 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-03-08T15:49:34.059 INFO:tasks.ceph.mds.b:Started 2023-03-08T15:49:34.059 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-03-08T15:49:34.059 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:49:34.133 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2023-03-08T15:49:34.135 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2023-03-08T15:49:34.144 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-03-08T15:49:34.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.186+0000 7fc73a6e3700 1 Processor -- start 2023-03-08T15:49:34.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.187+0000 7fc73a6e3700 1 -- start start 2023-03-08T15:49:34.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.187+0000 7fc73a6e3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc7341427e0 0x7fc7340b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.187+0000 7fc73a6e3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc734070b00 0x7fc734148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.187+0000 7fc73a6e3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc734148a30 con 0x7fc7340a0f70 2023-03-08T15:49:34.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.187+0000 7fc73a6e3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7341484d0 con 0x7fc7341427e0 2023-03-08T15:49:34.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.187+0000 7fc73a6e3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc734072970 con 0x7fc734070b00 2023-03-08T15:49:34.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.187+0000 7fc733fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc7341427e0 0x7fc7340b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.187+0000 7fc733fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc7341427e0 0x7fc7340b3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56992/0 (socket says 172.21.15.123:56992) 2023-03-08T15:49:34.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.187+0000 7fc733fff700 1 -- 172.21.15.123:0/2562913404 learned_addr learned my addr 172.21.15.123:0/2562913404 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:34.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.187+0000 7fc7337fe700 1 --2- 172.21.15.123:0/2562913404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc734070b00 0x7fc734148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc733fff700 1 -- 172.21.15.123:0/2562913404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc734070b00 msgr2=0x7fc734148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:34.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc733fff700 1 --2- 172.21.15.123:0/2562913404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc734070b00 0x7fc734148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc733fff700 1 -- 172.21.15.123:0/2562913404 >> v1:172.21.15.175:6789/0 conn(0x7fc7340a0f70 legacy=0x7fc73406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc733fff700 1 -- 172.21.15.123:0/2562913404 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73406dc80 con 0x7fc7341427e0 2023-03-08T15:49:34.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc733fff700 1 --2- 172.21.15.123:0/2562913404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7341427e0 0x7fc7340b3a50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc7280098f0 tx=0x7fc728009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785a2d636f4cccf5 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:34.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc732ffd700 1 -- 172.21.15.123:0/2562913404 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72800b8a0 con 0x7fc7341427e0 2023-03-08T15:49:34.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc732ffd700 1 -- 172.21.15.123:0/2562913404 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72800ba00 con 0x7fc7341427e0 2023-03-08T15:49:34.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc732ffd700 1 -- 172.21.15.123:0/2562913404 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72800bd90 con 0x7fc7341427e0 2023-03-08T15:49:34.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc73a6e3700 1 -- 172.21.15.123:0/2562913404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7341427e0 msgr2=0x7fc7340b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc73a6e3700 1 --2- 172.21.15.123:0/2562913404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7341427e0 0x7fc7340b3a50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc7280098f0 tx=0x7fc728009c00 comp rx=0 tx=0).stop 2023-03-08T15:49:34.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc73a6e3700 1 -- 172.21.15.123:0/2562913404 shutdown_connections 2023-03-08T15:49:34.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc73a6e3700 1 --2- 172.21.15.123:0/2562913404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7341427e0 0x7fc7340b3a50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc73a6e3700 1 --2- 172.21.15.123:0/2562913404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc734070b00 0x7fc734148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc73a6e3700 1 -- 172.21.15.123:0/2562913404 >> 172.21.15.123:0/2562913404 conn(0x7fc7340be6f0 msgr2=0x7fc7340beac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:34.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc73a6e3700 1 -- 172.21.15.123:0/2562913404 shutdown_connections 2023-03-08T15:49:34.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.188+0000 7fc73a6e3700 1 -- 172.21.15.123:0/2562913404 wait complete. 2023-03-08T15:49:34.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.189+0000 7fc73a6e3700 1 Processor -- start 2023-03-08T15:49:34.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.190+0000 7fc73a6e3700 1 -- start start 2023-03-08T15:49:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.190+0000 7fc73a6e3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc734070b00 0x7fc73409fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.190+0000 7fc73a6e3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7340a0f70 0x7fc7341e3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.190+0000 7fc73a6e3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7341427e0 0x7fc734139a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.190+0000 7fc73a6e3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340a01d0 con 0x7fc7341427e0 2023-03-08T15:49:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.190+0000 7fc73a6e3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73409ea20 con 0x7fc7340a0f70 2023-03-08T15:49:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.190+0000 7fc73a6e3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73406b360 con 0x7fc734070b00 2023-03-08T15:49:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.190+0000 7fc738c80700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7341427e0 0x7fc734139a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.190+0000 7fc738c80700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7341427e0 0x7fc734139a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56998/0 (socket says 172.21.15.123:56998) 2023-03-08T15:49:34.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.190+0000 7fc738c80700 1 -- 172.21.15.123:0/2834947924 learned_addr learned my addr 172.21.15.123:0/2834947924 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:34.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.190+0000 7fc733fff700 1 --2- 172.21.15.123:0/2834947924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc734070b00 0x7fc73409fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.190+0000 7fc7337fe700 1 --2- 172.21.15.123:0/2834947924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7340a0f70 0x7fc7341e3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.191+0000 7fc738c80700 1 -- 172.21.15.123:0/2834947924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc734070b00 msgr2=0x7fc73409fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.191+0000 7fc738c80700 1 --2- 172.21.15.123:0/2834947924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc734070b00 0x7fc73409fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.191+0000 7fc738c80700 1 -- 172.21.15.123:0/2834947924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7340a0f70 msgr2=0x7fc7341e3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.191+0000 7fc738c80700 1 --2- 172.21.15.123:0/2834947924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7340a0f70 0x7fc7341e3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.191+0000 7fc738c80700 1 -- 172.21.15.123:0/2834947924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc728009550 con 0x7fc7341427e0 2023-03-08T15:49:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.191+0000 7fc738c80700 1 --2- 172.21.15.123:0/2834947924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7341427e0 0x7fc734139a70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00cc80 tx=0x7fc72c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.191+0000 7fc730ff9700 1 -- 172.21.15.123:0/2834947924 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c003c00 con 0x7fc7341427e0 2023-03-08T15:49:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.191+0000 7fc730ff9700 1 -- 172.21.15.123:0/2834947924 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c003d60 con 0x7fc7341427e0 2023-03-08T15:49:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.191+0000 7fc73a6e3700 1 -- 172.21.15.123:0/2834947924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7340715d0 con 0x7fc7341427e0 2023-03-08T15:49:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.191+0000 7fc730ff9700 1 -- 172.21.15.123:0/2834947924 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c00aaa0 con 0x7fc7341427e0 2023-03-08T15:49:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.191+0000 7fc73a6e3700 1 -- 172.21.15.123:0/2834947924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc734149400 con 0x7fc7341427e0 2023-03-08T15:49:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.192+0000 7fc73a6e3700 1 -- 172.21.15.123:0/2834947924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7340718a0 con 0x7fc7341427e0 2023-03-08T15:49:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.192+0000 7fc730ff9700 1 -- 172.21.15.123:0/2834947924 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fc72c010050 con 0x7fc7341427e0 2023-03-08T15:49:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.193+0000 7fc730ff9700 1 --2- 172.21.15.123:0/2834947924 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc7200698d0 0x7fc72006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.193+0000 7fc730ff9700 1 -- 172.21.15.123:0/2834947924 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc72c087190 con 0x7fc7341427e0 2023-03-08T15:49:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.193+0000 7fc733fff700 1 --2- 172.21.15.123:0/2834947924 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc7200698d0 0x7fc72006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.193+0000 7fc733fff700 1 --2- 172.21.15.123:0/2834947924 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc7200698d0 0x7fc72006bd80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc728009c40 tx=0x7fc728008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.197+0000 7fc730ff9700 1 -- 172.21.15.123:0/2834947924 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fc72c053220 con 0x7fc7341427e0 2023-03-08T15:49:34.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.387+0000 7fc73a6e3700 1 -- 172.21.15.123:0/2834947924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7340744c0 con 0x7fc7341427e0 2023-03-08T15:49:34.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.388+0000 7fc730ff9700 1 -- 172.21.15.123:0/2834947924 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14325 (secure 0 0 0) 0x7fc72c056840 con 0x7fc7341427e0 2023-03-08T15:49:34.391 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:34.391 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":18,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:34.029795+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:49:34.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.390+0000 7fc73a6e3700 1 -- 172.21.15.123:0/2834947924 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc7200698d0 msgr2=0x7fc72006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.390+0000 7fc73a6e3700 1 --2- 172.21.15.123:0/2834947924 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc7200698d0 0x7fc72006bd80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc728009c40 tx=0x7fc728008030 comp rx=0 tx=0).stop 2023-03-08T15:49:34.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.390+0000 7fc73a6e3700 1 -- 172.21.15.123:0/2834947924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7341427e0 msgr2=0x7fc734139a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.390+0000 7fc73a6e3700 1 --2- 172.21.15.123:0/2834947924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7341427e0 0x7fc734139a70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00cc80 tx=0x7fc72c00cf90 comp rx=0 tx=0).stop 2023-03-08T15:49:34.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.390+0000 7fc73a6e3700 1 -- 172.21.15.123:0/2834947924 shutdown_connections 2023-03-08T15:49:34.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.390+0000 7fc73a6e3700 1 --2- 172.21.15.123:0/2834947924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7341427e0 0x7fc734139a70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.390+0000 7fc73a6e3700 1 --2- 172.21.15.123:0/2834947924 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc7200698d0 0x7fc72006bd80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.390+0000 7fc73a6e3700 1 --2- 172.21.15.123:0/2834947924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc734070b00 0x7fc73409fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.390+0000 7fc73a6e3700 1 --2- 172.21.15.123:0/2834947924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7340a0f70 0x7fc7341e3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.390+0000 7fc73a6e3700 1 -- 172.21.15.123:0/2834947924 >> 172.21.15.123:0/2834947924 conn(0x7fc7340be6f0 msgr2=0x7fc73413fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:34.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.390+0000 7fc73a6e3700 1 -- 172.21.15.123:0/2834947924 shutdown_connections 2023-03-08T15:49:34.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.390+0000 7fc73a6e3700 1 -- 172.21.15.123:0/2834947924 wait complete. 2023-03-08T15:49:34.405 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-08T15:49:26.011228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-08T15:49:32.528343+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-08T15:49:34.405 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-08T15:49:34.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.525+0000 7fcf7e3dc700 1 Processor -- start 2023-03-08T15:49:34.527 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.525+0000 7fcf7e3dc700 1 -- start start 2023-03-08T15:49:34.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.525+0000 7fcf7e3dc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcf7814e7a0 0x7fcf780be130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.525+0000 7fcf7e3dc700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7814dc00 con 0x7fcf780bdcb0 2023-03-08T15:49:34.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.525+0000 7fcf7e3dc700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7806bb70 con 0x7fcf780bb350 2023-03-08T15:49:34.530 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.525+0000 7fcf7e3dc700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf78144dc0 con 0x7fcf7814e7a0 2023-03-08T15:49:34.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.525+0000 7fcf777fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcf780bdcb0 0x7fcf7814e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36766/0 (socket says 172.21.15.123:36766) 2023-03-08T15:49:34.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.525+0000 7fcf777fe700 1 -- 172.21.15.123:0/1425373349 learned_addr learned my addr 172.21.15.123:0/1425373349 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:34.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf7c979700 1 --2- 172.21.15.123:0/1425373349 >> v2:172.21.15.175:3300/0 conn(0x7fcf7814e7a0 0x7fcf780be130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf76ffd700 1 -- 172.21.15.123:0/1425373349 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477974551 0 0) 0x7fcf7814dc00 con 0x7fcf780bdcb0 2023-03-08T15:49:34.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf76ffd700 1 -- 172.21.15.123:0/1425373349 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf600035b0 con 0x7fcf780bdcb0 2023-03-08T15:49:34.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf76ffd700 1 -- 172.21.15.123:0/1425373349 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3297593362 0 0) 0x7fcf600035b0 con 0x7fcf780bdcb0 2023-03-08T15:49:34.531 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf76ffd700 1 -- 172.21.15.123:0/1425373349 >> v2:172.21.15.175:3300/0 conn(0x7fcf7814e7a0 msgr2=0x7fcf780be130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf76ffd700 1 --2- 172.21.15.123:0/1425373349 >> v2:172.21.15.175:3300/0 conn(0x7fcf7814e7a0 0x7fcf780be130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf76ffd700 1 -- 172.21.15.123:0/1425373349 >> v1:172.21.15.175:6789/0 conn(0x7fcf780bb350 legacy=0x7fcf781446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf76ffd700 1 -- 172.21.15.123:0/1425373349 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf780b9fc0 con 0x7fcf780bdcb0 2023-03-08T15:49:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf76ffd700 1 -- 172.21.15.123:0/1425373349 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7fcf68001670 con 0x7fcf780bdcb0 2023-03-08T15:49:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf76ffd700 1 -- 172.21.15.123:0/1425373349 >> v1:172.21.15.123:6789/0 conn(0x7fcf780bdcb0 legacy=0x7fcf7814e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf76ffd700 1 --2- 172.21.15.123:0/1425373349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf60003a00 0x7fcf60003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf76ffd700 1 --2- 172.21.15.123:0/1425373349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf60004850 0x7fcf60004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf76ffd700 1 --2- 172.21.15.123:0/1425373349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf60005200 0x7fcf6000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf76ffd700 1 -- 172.21.15.123:0/1425373349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78144dc0 con 0x7fcf60003a00 2023-03-08T15:49:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf76ffd700 1 -- 172.21.15.123:0/1425373349 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6000c090 con 0x7fcf60005200 2023-03-08T15:49:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf76ffd700 1 -- 172.21.15.123:0/1425373349 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6000c250 con 0x7fcf60004850 2023-03-08T15:49:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf77fff700 1 --2- 172.21.15.123:0/1425373349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf60003a00 0x7fcf60003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf7c979700 1 --2- 172.21.15.123:0/1425373349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf60005200 0x7fcf6000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf777fe700 1 --2- 172.21.15.123:0/1425373349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf60004850 0x7fcf60004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf77fff700 1 -- 172.21.15.123:0/1425373349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf60004850 msgr2=0x7fcf60004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:34.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf77fff700 1 --2- 172.21.15.123:0/1425373349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf60004850 0x7fcf60004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf77fff700 1 -- 172.21.15.123:0/1425373349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf60005200 msgr2=0x7fcf6000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:34.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf77fff700 1 --2- 172.21.15.123:0/1425373349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf60005200 0x7fcf6000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf7c979700 1 -- 172.21.15.123:0/1425373349 reap_dead start 2023-03-08T15:49:34.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.526+0000 7fcf77fff700 1 -- 172.21.15.123:0/1425373349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf600035b0 con 0x7fcf60003a00 2023-03-08T15:49:34.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.527+0000 7fcf77fff700 1 --2- 172.21.15.123:0/1425373349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf60003a00 0x7fcf60003e30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0017c0 tx=0x7fcf60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f328f27e3e041cf server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:34.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.527+0000 7fcf76ffd700 1 -- 172.21.15.123:0/1425373349 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0052d0 con 0x7fcf60003a00 2023-03-08T15:49:34.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.527+0000 7fcf76ffd700 1 -- 172.21.15.123:0/1425373349 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c005450 con 0x7fcf60003a00 2023-03-08T15:49:34.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.527+0000 7fcf76ffd700 1 -- 172.21.15.123:0/1425373349 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0038c0 con 0x7fcf60003a00 2023-03-08T15:49:34.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.527+0000 7fcf7e3dc700 1 -- 172.21.15.123:0/1425373349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf60003a00 msgr2=0x7fcf60003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.527+0000 7fcf7e3dc700 1 --2- 172.21.15.123:0/1425373349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf60003a00 0x7fcf60003e30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0017c0 tx=0x7fcf60005880 comp rx=0 tx=0).stop 2023-03-08T15:49:34.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.527+0000 7fcf7e3dc700 1 -- 172.21.15.123:0/1425373349 shutdown_connections 2023-03-08T15:49:34.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.527+0000 7fcf7e3dc700 1 --2- 172.21.15.123:0/1425373349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf60003a00 0x7fcf60003e30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.527+0000 7fcf7e3dc700 1 -- 172.21.15.123:0/1425373349 >> 172.21.15.123:0/1425373349 conn(0x7fcf7806a250 msgr2=0x7fcf7806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:34.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.527+0000 7fcf7e3dc700 1 -- 172.21.15.123:0/1425373349 shutdown_connections 2023-03-08T15:49:34.536 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.527+0000 7fcf7e3dc700 1 -- 172.21.15.123:0/1425373349 wait complete. 2023-03-08T15:49:34.537 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.529+0000 7fcf7e3dc700 1 Processor -- start 2023-03-08T15:49:34.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.529+0000 7fcf7e3dc700 1 -- start start 2023-03-08T15:49:34.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf7e3dc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf60003a00 0x7fcf78142f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf7e3dc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf7814d550 0x7fcf7814b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf7e3dc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf78136780 0x7fcf78136bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf7e3dc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78143440 con 0x7fcf7814d550 2023-03-08T15:49:34.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf7e3dc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf781dff40 con 0x7fcf78136780 2023-03-08T15:49:34.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf7e3dc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf781e0190 con 0x7fcf60003a00 2023-03-08T15:49:34.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf777fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf7814d550 0x7fcf7814b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf777fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf7814d550 0x7fcf7814b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57016/0 (socket says 172.21.15.123:57016) 2023-03-08T15:49:34.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf777fe700 1 -- 172.21.15.123:0/777662380 learned_addr learned my addr 172.21.15.123:0/777662380 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:34.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf77fff700 1 --2- 172.21.15.123:0/777662380 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf60003a00 0x7fcf78142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf7c979700 1 --2- 172.21.15.123:0/777662380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf78136780 0x7fcf78136bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf777fe700 1 -- 172.21.15.123:0/777662380 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf60003a00 msgr2=0x7fcf78142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf777fe700 1 --2- 172.21.15.123:0/777662380 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf60003a00 0x7fcf78142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf777fe700 1 -- 172.21.15.123:0/777662380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf78136780 msgr2=0x7fcf78136bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf777fe700 1 --2- 172.21.15.123:0/777662380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf78136780 0x7fcf78136bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf777fe700 1 -- 172.21.15.123:0/777662380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf780ba580 con 0x7fcf7814d550 2023-03-08T15:49:34.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf777fe700 1 --2- 172.21.15.123:0/777662380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf7814d550 0x7fcf7814b7d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcf68007290 tx=0x7fcf680075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:34.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf74ff9700 1 -- 172.21.15.123:0/777662380 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68011580 con 0x7fcf7814d550 2023-03-08T15:49:34.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf74ff9700 1 -- 172.21.15.123:0/777662380 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf680116e0 con 0x7fcf7814d550 2023-03-08T15:49:34.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf7e3dc700 1 -- 172.21.15.123:0/777662380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf780ba2a0 con 0x7fcf7814d550 2023-03-08T15:49:34.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf74ff9700 1 -- 172.21.15.123:0/777662380 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68011a90 con 0x7fcf7814d550 2023-03-08T15:49:34.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.530+0000 7fcf7e3dc700 1 -- 172.21.15.123:0/777662380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf780bb720 con 0x7fcf7814d550 2023-03-08T15:49:34.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.531+0000 7fcf7e3dc700 1 -- 172.21.15.123:0/777662380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf780744c0 con 0x7fcf7814d550 2023-03-08T15:49:34.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.532+0000 7fcf74ff9700 1 -- 172.21.15.123:0/777662380 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fcf68011bf0 con 0x7fcf7814d550 2023-03-08T15:49:34.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.532+0000 7fcf74ff9700 1 --2- 172.21.15.123:0/777662380 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fcf640698d0 0x7fcf6406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.532+0000 7fcf74ff9700 1 -- 172.21.15.123:0/777662380 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcf680874d0 con 0x7fcf7814d550 2023-03-08T15:49:34.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.532+0000 7fcf77fff700 1 --2- 172.21.15.123:0/777662380 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fcf640698d0 0x7fcf6406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.532+0000 7fcf77fff700 1 --2- 172.21.15.123:0/777662380 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fcf640698d0 0x7fcf6406bd80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c000c00 tx=0x7fcf6c009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:34.543 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.536+0000 7fcf74ff9700 1 -- 172.21.15.123:0/777662380 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fcf68053560 con 0x7fcf7814d550 2023-03-08T15:49:34.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.719+0000 7fcf7e3dc700 1 -- 172.21.15.123:0/777662380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf7813e5c0 con 0x7fcf7814d550 2023-03-08T15:49:34.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.720+0000 7fcf74ff9700 1 -- 172.21.15.123:0/777662380 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf68056b80 con 0x7fcf7814d550 2023-03-08T15:49:34.722 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-03-08T15:49:34.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.722+0000 7fcf7e3dc700 1 -- 172.21.15.123:0/777662380 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fcf640698d0 msgr2=0x7fcf6406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.722+0000 7fcf7e3dc700 1 --2- 172.21.15.123:0/777662380 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fcf640698d0 0x7fcf6406bd80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c000c00 tx=0x7fcf6c009030 comp rx=0 tx=0).stop 2023-03-08T15:49:34.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.722+0000 7fcf7e3dc700 1 -- 172.21.15.123:0/777662380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf7814d550 msgr2=0x7fcf7814b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.722+0000 7fcf7e3dc700 1 --2- 172.21.15.123:0/777662380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf7814d550 0x7fcf7814b7d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcf68007290 tx=0x7fcf680075a0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.722+0000 7fcf7e3dc700 1 -- 172.21.15.123:0/777662380 shutdown_connections 2023-03-08T15:49:34.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.722+0000 7fcf7e3dc700 1 --2- 172.21.15.123:0/777662380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf78136780 0x7fcf78136bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.722+0000 7fcf7e3dc700 1 --2- 172.21.15.123:0/777662380 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fcf640698d0 0x7fcf6406bd80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.722+0000 7fcf7e3dc700 1 --2- 172.21.15.123:0/777662380 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf60003a00 0x7fcf78142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.722+0000 7fcf7e3dc700 1 --2- 172.21.15.123:0/777662380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf7814d550 0x7fcf7814b7d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.722+0000 7fcf7e3dc700 1 -- 172.21.15.123:0/777662380 >> 172.21.15.123:0/777662380 conn(0x7fcf7806a250 msgr2=0x7fcf78073110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:34.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.722+0000 7fcf7e3dc700 1 -- 172.21.15.123:0/777662380 shutdown_connections 2023-03-08T15:49:34.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.722+0000 7fcf7e3dc700 1 -- 172.21.15.123:0/777662380 wait complete. 2023-03-08T15:49:34.736 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-08T15:49:34.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.855+0000 7f53efed6700 1 Processor -- start 2023-03-08T15:49:34.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.856+0000 7f53efed6700 1 -- start start 2023-03-08T15:49:34.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.856+0000 7f53efed6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f53e8144a90 0x7f53e80bd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.856+0000 7f53efed6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e80b7fa0 con 0x7f53e80ba560 2023-03-08T15:49:34.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.856+0000 7f53efed6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e80bc030 con 0x7f53e81446c0 2023-03-08T15:49:34.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.856+0000 7f53efed6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e80bc310 con 0x7f53e8144a90 2023-03-08T15:49:34.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.856+0000 7f53ed471700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f53e8144a90 0x7f53e80bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.857+0000 7f53ee473700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f53e80ba560 0x7f53e8154f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36780/0 (socket says 172.21.15.123:36780) 2023-03-08T15:49:34.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.857+0000 7f53ee473700 1 -- 172.21.15.123:0/296252041 learned_addr learned my addr 172.21.15.123:0/296252041 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:34.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.857+0000 7f53ed471700 1 -- 172.21.15.123:0/296252041 >> v1:172.21.15.175:6789/0 conn(0x7f53e81446c0 legacy=0x7f53e80b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.857+0000 7f53ed471700 1 -- 172.21.15.123:0/296252041 >> v1:172.21.15.123:6789/0 conn(0x7f53e80ba560 legacy=0x7f53e8154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.857+0000 7f53ecc70700 1 -- 172.21.15.123:0/296252041 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005544545 0 0) 0x7f53e80b7fa0 con 0x7f53e80ba560 2023-03-08T15:49:34.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.857+0000 7f53ed471700 1 -- 172.21.15.123:0/296252041 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e80bc5f0 con 0x7f53e8144a90 2023-03-08T15:49:34.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.857+0000 7f53ed471700 1 --2- 172.21.15.123:0/296252041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8144a90 0x7f53e80bd580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009840 tx=0x7f53e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac8bc80f67eea9a server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:34.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.857+0000 7f53ecc70700 1 -- 172.21.15.123:0/296252041 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4011830 con 0x7f53e8144a90 2023-03-08T15:49:34.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.857+0000 7f53ecc70700 1 -- 172.21.15.123:0/296252041 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e4011990 con 0x7f53e8144a90 2023-03-08T15:49:34.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.857+0000 7f53ecc70700 1 -- 172.21.15.123:0/296252041 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4011d20 con 0x7f53e8144a90 2023-03-08T15:49:34.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.858+0000 7f53efed6700 1 -- 172.21.15.123:0/296252041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8144a90 msgr2=0x7f53e80bd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.858+0000 7f53efed6700 1 --2- 172.21.15.123:0/296252041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8144a90 0x7f53e80bd580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009840 tx=0x7f53e4009b50 comp rx=0 tx=0).stop 2023-03-08T15:49:34.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.858+0000 7f53efed6700 1 -- 172.21.15.123:0/296252041 shutdown_connections 2023-03-08T15:49:34.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.858+0000 7f53efed6700 1 --2- 172.21.15.123:0/296252041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8144a90 0x7f53e80bd580 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.858+0000 7f53efed6700 1 -- 172.21.15.123:0/296252041 >> 172.21.15.123:0/296252041 conn(0x7f53e8071980 msgr2=0x7f53e8071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:34.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.858+0000 7f53efed6700 1 -- 172.21.15.123:0/296252041 shutdown_connections 2023-03-08T15:49:34.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.858+0000 7f53efed6700 1 -- 172.21.15.123:0/296252041 wait complete. 2023-03-08T15:49:34.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.859+0000 7f53efed6700 1 Processor -- start 2023-03-08T15:49:34.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.859+0000 7f53efed6700 1 -- start start 2023-03-08T15:49:34.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.859+0000 7f53efed6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e80ba560 0x7f53e81422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.859+0000 7f53efed6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53e81446c0 0x7f53e813d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.859+0000 7f53efed6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53e8144a90 0x7f53e81393f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.859+0000 7f53efed6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e813d4a0 con 0x7f53e80ba560 2023-03-08T15:49:34.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.859+0000 7f53efed6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e81427f0 con 0x7f53e8144a90 2023-03-08T15:49:34.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.859+0000 7f53efed6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e813d2c0 con 0x7f53e81446c0 2023-03-08T15:49:34.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.859+0000 7f53edc72700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e80ba560 0x7f53e81422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.859+0000 7f53edc72700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e80ba560 0x7f53e81422b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57034/0 (socket says 172.21.15.123:57034) 2023-03-08T15:49:34.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.859+0000 7f53edc72700 1 -- 172.21.15.123:0/1126481002 learned_addr learned my addr 172.21.15.123:0/1126481002 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:34.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.859+0000 7f53ed471700 1 --2- 172.21.15.123:0/1126481002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53e81446c0 0x7f53e813d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.859+0000 7f53ee473700 1 --2- 172.21.15.123:0/1126481002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53e8144a90 0x7f53e81393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.860+0000 7f53edc72700 1 -- 172.21.15.123:0/1126481002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53e81446c0 msgr2=0x7f53e813d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.860+0000 7f53edc72700 1 --2- 172.21.15.123:0/1126481002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53e81446c0 0x7f53e813d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.860+0000 7f53edc72700 1 -- 172.21.15.123:0/1126481002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53e8144a90 msgr2=0x7f53e81393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:34.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.860+0000 7f53edc72700 1 --2- 172.21.15.123:0/1126481002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53e8144a90 0x7f53e81393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:34.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.860+0000 7f53edc72700 1 -- 172.21.15.123:0/1126481002 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e40094a0 con 0x7f53e80ba560 2023-03-08T15:49:34.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.860+0000 7f53edc72700 1 --2- 172.21.15.123:0/1126481002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e80ba560 0x7f53e81422b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f53d800c4e0 tx=0x7f53d800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:34.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.860+0000 7f53de7fc700 1 -- 172.21.15.123:0/1126481002 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d80052d0 con 0x7f53e80ba560 2023-03-08T15:49:34.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.860+0000 7f53de7fc700 1 -- 172.21.15.123:0/1126481002 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d8005430 con 0x7f53e80ba560 2023-03-08T15:49:34.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.860+0000 7f53efed6700 1 -- 172.21.15.123:0/1126481002 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e814db90 con 0x7f53e80ba560 2023-03-08T15:49:34.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.860+0000 7f53de7fc700 1 -- 172.21.15.123:0/1126481002 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d80038c0 con 0x7f53e80ba560 2023-03-08T15:49:34.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.860+0000 7f53efed6700 1 -- 172.21.15.123:0/1126481002 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e80bdac0 con 0x7f53e80ba560 2023-03-08T15:49:34.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.861+0000 7f53de7fc700 1 -- 172.21.15.123:0/1126481002 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f53d8019030 con 0x7f53e80ba560 2023-03-08T15:49:34.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.861+0000 7f53efed6700 1 -- 172.21.15.123:0/1126481002 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e813d710 con 0x7f53e80ba560 2023-03-08T15:49:34.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.862+0000 7f53de7fc700 1 --2- 172.21.15.123:0/1126481002 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f53cc0698d0 0x7f53cc06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:34.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.862+0000 7f53ed471700 1 --2- 172.21.15.123:0/1126481002 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f53cc0698d0 0x7f53cc06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:34.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.862+0000 7f53de7fc700 1 -- 172.21.15.123:0/1126481002 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f53d8086540 con 0x7f53e80ba560 2023-03-08T15:49:34.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.862+0000 7f53ed471700 1 --2- 172.21.15.123:0/1126481002 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f53cc0698d0 0x7f53cc06bd80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f53e40090b0 tx=0x7f53e401c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:34.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:34.866+0000 7f53de7fc700 1 -- 172.21.15.123:0/1126481002 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f53d8052660 con 0x7f53e80ba560 2023-03-08T15:49:35.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.053+0000 7f53efed6700 1 -- 172.21.15.123:0/1126481002 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f53e814dd20 con 0x7f53e80ba560 2023-03-08T15:49:35.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.054+0000 7f53de7fc700 1 -- 172.21.15.123:0/1126481002 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f53e814dd20 con 0x7f53e80ba560 2023-03-08T15:49:35.056 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-03-08T15:49:35.058 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.056+0000 7f53efed6700 1 -- 172.21.15.123:0/1126481002 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f53cc0698d0 msgr2=0x7f53cc06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.058 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.056+0000 7f53efed6700 1 --2- 172.21.15.123:0/1126481002 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f53cc0698d0 0x7f53cc06bd80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f53e40090b0 tx=0x7f53e401c040 comp rx=0 tx=0).stop 2023-03-08T15:49:35.058 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.056+0000 7f53efed6700 1 -- 172.21.15.123:0/1126481002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e80ba560 msgr2=0x7f53e81422b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.058 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.056+0000 7f53efed6700 1 --2- 172.21.15.123:0/1126481002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e80ba560 0x7f53e81422b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f53d800c4e0 tx=0x7f53d800c7f0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.058 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.056+0000 7f53efed6700 1 -- 172.21.15.123:0/1126481002 shutdown_connections 2023-03-08T15:49:35.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.056+0000 7f53efed6700 1 --2- 172.21.15.123:0/1126481002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53e8144a90 0x7f53e81393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.056+0000 7f53efed6700 1 --2- 172.21.15.123:0/1126481002 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e80ba560 0x7f53e81422b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.056+0000 7f53efed6700 1 --2- 172.21.15.123:0/1126481002 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f53cc0698d0 0x7f53cc06bd80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.056+0000 7f53efed6700 1 --2- 172.21.15.123:0/1126481002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53e81446c0 0x7f53e813d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.056+0000 7f53efed6700 1 -- 172.21.15.123:0/1126481002 >> 172.21.15.123:0/1126481002 conn(0x7f53e8071980 msgr2=0x7f53e814ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:35.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.056+0000 7f53efed6700 1 -- 172.21.15.123:0/1126481002 shutdown_connections 2023-03-08T15:49:35.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.056+0000 7f53efed6700 1 -- 172.21.15.123:0/1126481002 wait complete. 2023-03-08T15:49:35.070 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-08T15:49:35.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.189+0000 7fdcfda9e700 1 Processor -- start 2023-03-08T15:49:35.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.189+0000 7fdcfda9e700 1 -- start start 2023-03-08T15:49:35.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.190+0000 7fdcfda9e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcf814b1c0 0x7fdcf806fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.190+0000 7fdcfda9e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf8070670 con 0x7fdcf8072760 2023-03-08T15:49:35.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.190+0000 7fdcfda9e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf8070c50 con 0x7fdcf80ba280 2023-03-08T15:49:35.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.190+0000 7fdcfda9e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf8070a40 con 0x7fdcf814b1c0 2023-03-08T15:49:35.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.190+0000 7fdceeffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdcf8072760 0x7fdcf814aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36790/0 (socket says 172.21.15.123:36790) 2023-03-08T15:49:35.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.190+0000 7fdceeffd700 1 -- 172.21.15.123:0/2557091409 learned_addr learned my addr 172.21.15.123:0/2557091409 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:35.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.190+0000 7fdcf6ffd700 1 -- 172.21.15.123:0/2557091409 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513355583 0 0) 0x7fdcf8070670 con 0x7fdcf8072760 2023-03-08T15:49:35.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.190+0000 7fdcf7fff700 1 --2- 172.21.15.123:0/2557091409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcf814b1c0 0x7fdcf806fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.190+0000 7fdcf6ffd700 1 -- 172.21.15.123:0/2557091409 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdce40035b0 con 0x7fdcf8072760 2023-03-08T15:49:35.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 -- 172.21.15.123:0/2557091409 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2759504086 0 0) 0x7fdce40035b0 con 0x7fdcf8072760 2023-03-08T15:49:35.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 -- 172.21.15.123:0/2557091409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcf814b1c0 msgr2=0x7fdcf806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:35.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 --2- 172.21.15.123:0/2557091409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcf814b1c0 0x7fdcf806fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 -- 172.21.15.123:0/2557091409 >> v1:172.21.15.175:6789/0 conn(0x7fdcf80ba280 legacy=0x7fdcf8141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.196 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 -- 172.21.15.123:0/2557091409 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf80ba650 con 0x7fdcf8072760 2023-03-08T15:49:35.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 -- 172.21.15.123:0/2557091409 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7fdce0001670 con 0x7fdcf8072760 2023-03-08T15:49:35.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 -- 172.21.15.123:0/2557091409 >> v1:172.21.15.123:6789/0 conn(0x7fdcf8072760 legacy=0x7fdcf814aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 --2- 172.21.15.123:0/2557091409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce4003a30 0x7fdce4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 --2- 172.21.15.123:0/2557091409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcf814b1c0 0x7fdce4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 --2- 172.21.15.123:0/2557091409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce4004d90 0x7fdce4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 -- 172.21.15.123:0/2557091409 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf8070a40 con 0x7fdce4003a30 2023-03-08T15:49:35.197 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 -- 172.21.15.123:0/2557091409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce400bac0 con 0x7fdce4004d90 2023-03-08T15:49:35.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 -- 172.21.15.123:0/2557091409 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce400bc80 con 0x7fdcf814b1c0 2023-03-08T15:49:35.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf77fe700 1 --2- 172.21.15.123:0/2557091409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce4003a30 0x7fdce4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdceeffd700 1 --2- 172.21.15.123:0/2557091409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcf814b1c0 0x7fdce4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf7fff700 1 --2- 172.21.15.123:0/2557091409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce4004d90 0x7fdce4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf77fe700 1 -- 172.21.15.123:0/2557091409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcf814b1c0 msgr2=0x7fdce4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:35.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf77fe700 1 --2- 172.21.15.123:0/2557091409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcf814b1c0 0x7fdce4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf77fe700 1 -- 172.21.15.123:0/2557091409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce4004d90 msgr2=0x7fdce4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:35.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf77fe700 1 --2- 172.21.15.123:0/2557091409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce4004d90 0x7fdce4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf77fe700 1 -- 172.21.15.123:0/2557091409 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce40035b0 con 0x7fdce4003a30 2023-03-08T15:49:35.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf77fe700 1 --2- 172.21.15.123:0/2557091409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce4003a30 0x7fdce4003e40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdce80017c0 tx=0x7fdce4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95afa145a44d93ac server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:35.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 -- 172.21.15.123:0/2557091409 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce80052d0 con 0x7fdce4003a30 2023-03-08T15:49:35.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 -- 172.21.15.123:0/2557091409 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce8005430 con 0x7fdce4003a30 2023-03-08T15:49:35.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.191+0000 7fdcf6ffd700 1 -- 172.21.15.123:0/2557091409 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce80038c0 con 0x7fdce4003a30 2023-03-08T15:49:35.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.192+0000 7fdcfda9e700 1 -- 172.21.15.123:0/2557091409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce4003a30 msgr2=0x7fdce4003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.192+0000 7fdcfda9e700 1 --2- 172.21.15.123:0/2557091409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce4003a30 0x7fdce4003e40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdce80017c0 tx=0x7fdce4005880 comp rx=0 tx=0).stop 2023-03-08T15:49:35.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.192+0000 7fdcf7fff700 1 -- 172.21.15.123:0/2557091409 reap_dead start 2023-03-08T15:49:35.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.192+0000 7fdcfda9e700 1 -- 172.21.15.123:0/2557091409 shutdown_connections 2023-03-08T15:49:35.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.192+0000 7fdcfda9e700 1 -- 172.21.15.123:0/2557091409 >> 172.21.15.123:0/2557091409 conn(0x7fdcf806b360 msgr2=0x7fdcf806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:35.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.192+0000 7fdcfda9e700 1 -- 172.21.15.123:0/2557091409 shutdown_connections 2023-03-08T15:49:35.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.192+0000 7fdcfda9e700 1 -- 172.21.15.123:0/2557091409 wait complete. 2023-03-08T15:49:35.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.193+0000 7fdcfda9e700 1 Processor -- start 2023-03-08T15:49:35.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.193+0000 7fdcfda9e700 1 -- start start 2023-03-08T15:49:35.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcfda9e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce4003a30 0x7fdcf80b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcfda9e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcf813d480 0x7fdcf80bc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcfda9e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcf80b4b80 0x7fdcf80b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcfda9e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80bc960 con 0x7fdcf80b4b80 2023-03-08T15:49:35.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcfda9e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80b76c0 con 0x7fdce4003a30 2023-03-08T15:49:35.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcfda9e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80b5530 con 0x7fdcf813d480 2023-03-08T15:49:35.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcf7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcf80b4b80 0x7fdcf80b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcf7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcf80b4b80 0x7fdcf80b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57056/0 (socket says 172.21.15.123:57056) 2023-03-08T15:49:35.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcf7fff700 1 -- 172.21.15.123:0/3847888578 learned_addr learned my addr 172.21.15.123:0/3847888578 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:35.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdceeffd700 1 --2- 172.21.15.123:0/3847888578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcf813d480 0x7fdcf80bc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcf77fe700 1 --2- 172.21.15.123:0/3847888578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce4003a30 0x7fdcf80b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcf7fff700 1 -- 172.21.15.123:0/3847888578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcf813d480 msgr2=0x7fdcf80bc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcf7fff700 1 --2- 172.21.15.123:0/3847888578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcf813d480 0x7fdcf80bc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcf7fff700 1 -- 172.21.15.123:0/3847888578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce4003a30 msgr2=0x7fdcf80b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcf7fff700 1 --2- 172.21.15.123:0/3847888578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce4003a30 0x7fdcf80b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcf7fff700 1 -- 172.21.15.123:0/3847888578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf8141d20 con 0x7fdcf80b4b80 2023-03-08T15:49:35.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcf7fff700 1 --2- 172.21.15.123:0/3847888578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcf80b4b80 0x7fdcf80b4ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8145170 tx=0x7fdcf0011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:35.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcf4ff9700 1 -- 172.21.15.123:0/3847888578 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf000e040 con 0x7fdcf80b4b80 2023-03-08T15:49:35.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcf4ff9700 1 -- 172.21.15.123:0/3847888578 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf000f040 con 0x7fdcf80b4b80 2023-03-08T15:49:35.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcfda9e700 1 -- 172.21.15.123:0/3847888578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf8141b90 con 0x7fdcf80b4b80 2023-03-08T15:49:35.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcf4ff9700 1 -- 172.21.15.123:0/3847888578 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf000fc40 con 0x7fdcf80b4b80 2023-03-08T15:49:35.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.194+0000 7fdcfda9e700 1 -- 172.21.15.123:0/3847888578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf8071df0 con 0x7fdcf80b4b80 2023-03-08T15:49:35.205 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.195+0000 7fdcfda9e700 1 -- 172.21.15.123:0/3847888578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf80744c0 con 0x7fdcf80b4b80 2023-03-08T15:49:35.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.196+0000 7fdcf4ff9700 1 -- 172.21.15.123:0/3847888578 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fdcf000fda0 con 0x7fdcf80b4b80 2023-03-08T15:49:35.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.196+0000 7fdcf4ff9700 1 --2- 172.21.15.123:0/3847888578 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fdcd8069900 0x7fdcd806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.196+0000 7fdcf77fe700 1 --2- 172.21.15.123:0/3847888578 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fdcd8069900 0x7fdcd806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.196+0000 7fdcf4ff9700 1 -- 172.21.15.123:0/3847888578 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdcf0087780 con 0x7fdcf80b4b80 2023-03-08T15:49:35.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.197+0000 7fdcf77fe700 1 --2- 172.21.15.123:0/3847888578 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fdcd8069900 0x7fdcd806bdb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdce8000ff0 tx=0x7fdce8009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:35.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.201+0000 7fdcf4ff9700 1 -- 172.21.15.123:0/3847888578 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fdcf00538a0 con 0x7fdcf80b4b80 2023-03-08T15:49:35.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.428+0000 7fdcfda9e700 1 -- 172.21.15.123:0/3847888578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcf814ad90 con 0x7fdcf80b4b80 2023-03-08T15:49:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.428+0000 7fdcf4ff9700 1 -- 172.21.15.123:0/3847888578 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2774 (secure 0 0 0) 0x7fdcf0056ec0 con 0x7fdcf80b4b80 2023-03-08T15:49:35.431 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:35.431 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/108043707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":108043707},{"type":"v1","addr":"172.21.15.123:6835","nonce":108043707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1787308526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1787308526},{"type":"v1","addr":"172.21.15.123:6837","nonce":1787308526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1018957090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1018957090},{"type":"v1","addr":"172.21.15.175:6833","nonce":1018957090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-03-08T15:49:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.430+0000 7fdcfda9e700 1 -- 172.21.15.123:0/3847888578 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fdcd8069900 msgr2=0x7fdcd806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.430+0000 7fdcfda9e700 1 --2- 172.21.15.123:0/3847888578 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fdcd8069900 0x7fdcd806bdb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdce8000ff0 tx=0x7fdce8009030 comp rx=0 tx=0).stop 2023-03-08T15:49:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.430+0000 7fdcfda9e700 1 -- 172.21.15.123:0/3847888578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcf80b4b80 msgr2=0x7fdcf80b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.430+0000 7fdcfda9e700 1 --2- 172.21.15.123:0/3847888578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcf80b4b80 0x7fdcf80b4ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8145170 tx=0x7fdcf0011ed0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.430+0000 7fdcfda9e700 1 -- 172.21.15.123:0/3847888578 shutdown_connections 2023-03-08T15:49:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.430+0000 7fdcfda9e700 1 --2- 172.21.15.123:0/3847888578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcf80b4b80 0x7fdcf80b4ff0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.430+0000 7fdcfda9e700 1 --2- 172.21.15.123:0/3847888578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdce4003a30 0x7fdcf80b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.430+0000 7fdcfda9e700 1 --2- 172.21.15.123:0/3847888578 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fdcd8069900 0x7fdcd806bdb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.430+0000 7fdcfda9e700 1 --2- 172.21.15.123:0/3847888578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcf813d480 0x7fdcf80bc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.430+0000 7fdcfda9e700 1 -- 172.21.15.123:0/3847888578 >> 172.21.15.123:0/3847888578 conn(0x7fdcf806b360 msgr2=0x7fdcf813e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.430+0000 7fdcfda9e700 1 -- 172.21.15.123:0/3847888578 shutdown_connections 2023-03-08T15:49:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.430+0000 7fdcfda9e700 1 -- 172.21.15.123:0/3847888578 wait complete. 2023-03-08T15:49:35.435 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 3 2023-03-08T15:49:35.444 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:49:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.561+0000 7f2c8b80a700 1 Processor -- start 2023-03-08T15:49:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.561+0000 7f2c8b80a700 1 -- start start 2023-03-08T15:49:35.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c8b80a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2c84147e50 0x7f2c8406a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c8b80a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2c8406fef0 0x7f2c8414ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c8b80a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8414b6f0 con 0x7f2c8414b250 2023-03-08T15:49:35.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c8b80a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c8414a810 con 0x7f2c84147e50 2023-03-08T15:49:35.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c8b80a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c84071a40 con 0x7f2c8406fef0 2023-03-08T15:49:35.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c895a6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2c84147e50 0x7f2c8406a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c89da7700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2c8414b250 0x7f2c8414dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36794/0 (socket says 172.21.15.123:36794) 2023-03-08T15:49:35.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c89da7700 1 -- 172.21.15.123:0/3900329026 learned_addr learned my addr 172.21.15.123:0/3900329026 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:35.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c88da5700 1 --2- 172.21.15.123:0/3900329026 >> v2:172.21.15.175:3300/0 conn(0x7f2c8406fef0 0x7f2c8414ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c895a6700 1 -- 172.21.15.123:0/3900329026 >> v2:172.21.15.175:3300/0 conn(0x7f2c8406fef0 msgr2=0x7f2c8414ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:35.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c895a6700 1 --2- 172.21.15.123:0/3900329026 >> v2:172.21.15.175:3300/0 conn(0x7f2c8406fef0 0x7f2c8414ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c895a6700 1 -- 172.21.15.123:0/3900329026 >> v1:172.21.15.123:6789/0 conn(0x7f2c8414b250 legacy=0x7f2c8414dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c895a6700 1 -- 172.21.15.123:0/3900329026 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c84071d20 con 0x7f2c84147e50 2023-03-08T15:49:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c7bfff700 1 -- 172.21.15.123:0/3900329026 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816405118 0 0) 0x7f2c8414b6f0 con 0x7f2c8414b250 2023-03-08T15:49:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c895a6700 1 --2- 172.21.15.123:0/3900329026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c84147e50 0x7f2c8406a250 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2c8406f330 tx=0x7f2c80009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a28a02079b0a008 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c7bfff700 1 -- 172.21.15.123:0/3900329026 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c80011830 con 0x7f2c84147e50 2023-03-08T15:49:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c7bfff700 1 -- 172.21.15.123:0/3900329026 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c80011990 con 0x7f2c84147e50 2023-03-08T15:49:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.562+0000 7f2c7bfff700 1 -- 172.21.15.123:0/3900329026 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c80011d20 con 0x7f2c84147e50 2023-03-08T15:49:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.563+0000 7f2c8b80a700 1 -- 172.21.15.123:0/3900329026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c84147e50 msgr2=0x7f2c8406a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.563+0000 7f2c8b80a700 1 --2- 172.21.15.123:0/3900329026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c84147e50 0x7f2c8406a250 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2c8406f330 tx=0x7f2c80009b20 comp rx=0 tx=0).stop 2023-03-08T15:49:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.563+0000 7f2c8b80a700 1 -- 172.21.15.123:0/3900329026 shutdown_connections 2023-03-08T15:49:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.563+0000 7f2c8b80a700 1 --2- 172.21.15.123:0/3900329026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c84147e50 0x7f2c8406a250 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.563+0000 7f2c8b80a700 1 --2- 172.21.15.123:0/3900329026 >> v2:172.21.15.175:3300/0 conn(0x7f2c8406fef0 0x7f2c8414ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.563+0000 7f2c8b80a700 1 -- 172.21.15.123:0/3900329026 >> 172.21.15.123:0/3900329026 conn(0x7f2c8406b360 msgr2=0x7f2c8406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:35.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.563+0000 7f2c8b80a700 1 -- 172.21.15.123:0/3900329026 shutdown_connections 2023-03-08T15:49:35.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.563+0000 7f2c8b80a700 1 -- 172.21.15.123:0/3900329026 wait complete. 2023-03-08T15:49:35.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.564+0000 7f2c8b80a700 1 Processor -- start 2023-03-08T15:49:35.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.564+0000 7f2c8b80a700 1 -- start start 2023-03-08T15:49:35.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c8b80a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c8406fef0 0x7f2c840bd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c8b80a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c84147e50 0x7f2c840bc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c8b80a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c8414b250 0x7f2c8413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c8b80a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840b4a20 con 0x7f2c8406fef0 2023-03-08T15:49:35.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c8b80a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840b3d70 con 0x7f2c8414b250 2023-03-08T15:49:35.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c8b80a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840bd9f0 con 0x7f2c84147e50 2023-03-08T15:49:35.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c895a6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c8406fef0 0x7f2c840bd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c895a6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c8406fef0 0x7f2c840bd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57064/0 (socket says 172.21.15.123:57064) 2023-03-08T15:49:35.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c895a6700 1 -- 172.21.15.123:0/194463596 learned_addr learned my addr 172.21.15.123:0/194463596 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:35.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c895a6700 1 -- 172.21.15.123:0/194463596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c84147e50 msgr2=0x7f2c840bc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c895a6700 1 --2- 172.21.15.123:0/194463596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c84147e50 0x7f2c840bc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c895a6700 1 -- 172.21.15.123:0/194463596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c8414b250 msgr2=0x7f2c8413e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c89da7700 1 --2- 172.21.15.123:0/194463596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c8414b250 0x7f2c8413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c895a6700 1 --2- 172.21.15.123:0/194463596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c8414b250 0x7f2c8413e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c895a6700 1 -- 172.21.15.123:0/194463596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c800094a0 con 0x7f2c8406fef0 2023-03-08T15:49:35.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c89da7700 1 --2- 172.21.15.123:0/194463596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c8414b250 0x7f2c8413e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:49:35.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c895a6700 1 --2- 172.21.15.123:0/194463596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c8406fef0 0x7f2c840bd1d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2c80000c00 tx=0x7f2c80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:35.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c79ffb700 1 -- 172.21.15.123:0/194463596 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c800038a0 con 0x7f2c8406fef0 2023-03-08T15:49:35.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c79ffb700 1 -- 172.21.15.123:0/194463596 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8001f070 con 0x7f2c8406fef0 2023-03-08T15:49:35.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c8b80a700 1 -- 172.21.15.123:0/194463596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c84148220 con 0x7f2c8406fef0 2023-03-08T15:49:35.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c79ffb700 1 -- 172.21.15.123:0/194463596 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c80003c40 con 0x7f2c8406fef0 2023-03-08T15:49:35.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.565+0000 7f2c8b80a700 1 -- 172.21.15.123:0/194463596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c84072000 con 0x7f2c8406fef0 2023-03-08T15:49:35.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.566+0000 7f2c8b80a700 1 -- 172.21.15.123:0/194463596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c840728f0 con 0x7f2c8406fef0 2023-03-08T15:49:35.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.567+0000 7f2c79ffb700 1 -- 172.21.15.123:0/194463596 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f2c8000f050 con 0x7f2c8406fef0 2023-03-08T15:49:35.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.567+0000 7f2c79ffb700 1 --2- 172.21.15.123:0/194463596 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f2c680698d0 0x7f2c6806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.567+0000 7f2c79ffb700 1 -- 172.21.15.123:0/194463596 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2c80021070 con 0x7f2c8406fef0 2023-03-08T15:49:35.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.567+0000 7f2c88da5700 1 --2- 172.21.15.123:0/194463596 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f2c680698d0 0x7f2c6806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.567+0000 7f2c88da5700 1 --2- 172.21.15.123:0/194463596 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f2c680698d0 0x7f2c6806bd80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c8413fcc0 tx=0x7f2c74008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:35.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.571+0000 7f2c79ffb700 1 -- 172.21.15.123:0/194463596 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f2c80054ef0 con 0x7f2c8406fef0 2023-03-08T15:49:35.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.755+0000 7f2c8b80a700 1 -- 172.21.15.123:0/194463596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c84149040 con 0x7f2c8406fef0 2023-03-08T15:49:35.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.755+0000 7f2c79ffb700 1 -- 172.21.15.123:0/194463596 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14312 (secure 0 0 0) 0x7f2c80015020 con 0x7f2c8406fef0 2023-03-08T15:49:35.758 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:35.758 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":19,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:35.036472+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:49:35.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.758+0000 7f2c8b80a700 1 -- 172.21.15.123:0/194463596 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f2c680698d0 msgr2=0x7f2c6806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.758+0000 7f2c8b80a700 1 --2- 172.21.15.123:0/194463596 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f2c680698d0 0x7f2c6806bd80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c8413fcc0 tx=0x7f2c74008040 comp rx=0 tx=0).stop 2023-03-08T15:49:35.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.758+0000 7f2c8b80a700 1 -- 172.21.15.123:0/194463596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c8406fef0 msgr2=0x7f2c840bd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.758+0000 7f2c8b80a700 1 --2- 172.21.15.123:0/194463596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c8406fef0 0x7f2c840bd1d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2c80000c00 tx=0x7f2c80004750 comp rx=0 tx=0).stop 2023-03-08T15:49:35.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.758+0000 7f2c8b80a700 1 -- 172.21.15.123:0/194463596 shutdown_connections 2023-03-08T15:49:35.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.758+0000 7f2c8b80a700 1 --2- 172.21.15.123:0/194463596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c8414b250 0x7f2c8413e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.758+0000 7f2c8b80a700 1 --2- 172.21.15.123:0/194463596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c8406fef0 0x7f2c840bd1d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.758+0000 7f2c8b80a700 1 --2- 172.21.15.123:0/194463596 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f2c680698d0 0x7f2c6806bd80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.758+0000 7f2c8b80a700 1 --2- 172.21.15.123:0/194463596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c84147e50 0x7f2c840bc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.758+0000 7f2c8b80a700 1 -- 172.21.15.123:0/194463596 >> 172.21.15.123:0/194463596 conn(0x7f2c8406b360 msgr2=0x7f2c84148930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:35.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.758+0000 7f2c8b80a700 1 -- 172.21.15.123:0/194463596 shutdown_connections 2023-03-08T15:49:35.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.758+0000 7f2c8b80a700 1 -- 172.21.15.123:0/194463596 wait complete. 2023-03-08T15:49:35.772 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-08T15:49:26.011228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-08T15:49:32.528343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-08T15:49:35.772 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-08T15:49:35.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57b1fc7700 1 Processor -- start 2023-03-08T15:49:35.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57b1fc7700 1 -- start start 2023-03-08T15:49:35.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57b1fc7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57ac0bee10 0x7f57ac14ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57b1fc7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f57ac14bf50 0x7f57ac06dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57b1fc7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ac0b9280 con 0x7f57ac0be2a0 2023-03-08T15:49:35.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57b1fc7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ac0ba130 con 0x7f57ac14bf50 2023-03-08T15:49:35.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57b1fc7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac0b9670 con 0x7f57ac0bee10 2023-03-08T15:49:35.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57abfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f57ac14bf50 0x7f57ac06dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57aaffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f57ac0be2a0 0x7f57ac06d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36798/0 (socket says 172.21.15.123:36798) 2023-03-08T15:49:35.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57aaffd700 1 -- 172.21.15.123:0/200882503 learned_addr learned my addr 172.21.15.123:0/200882503 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:35.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57ab7fe700 1 --2- 172.21.15.123:0/200882503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57ac0bee10 0x7f57ac14ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57abfff700 1 -- 172.21.15.123:0/200882503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57ac0bee10 msgr2=0x7f57ac14ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:35.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57abfff700 1 --2- 172.21.15.123:0/200882503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57ac0bee10 0x7f57ac14ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57abfff700 1 -- 172.21.15.123:0/200882503 >> v1:172.21.15.123:6789/0 conn(0x7f57ac0be2a0 legacy=0x7f57ac06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57abfff700 1 -- 172.21.15.123:0/200882503 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac09dc80 con 0x7f57ac14bf50 2023-03-08T15:49:35.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57aa7fc700 1 -- 172.21.15.123:0/200882503 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532879866 0 0) 0x7f57ac0b9280 con 0x7f57ac0be2a0 2023-03-08T15:49:35.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57abfff700 1 --2- 172.21.15.123:0/200882503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57ac14bf50 0x7f57ac06dc80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009d90 tx=0x7f57a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b633c00b26811d server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:35.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57aa7fc700 1 -- 172.21.15.123:0/200882503 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a400e070 con 0x7f57ac14bf50 2023-03-08T15:49:35.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57aa7fc700 1 -- 172.21.15.123:0/200882503 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a400bbd0 con 0x7f57ac14bf50 2023-03-08T15:49:35.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57aa7fc700 1 -- 172.21.15.123:0/200882503 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4012430 con 0x7f57ac14bf50 2023-03-08T15:49:35.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57b1fc7700 1 -- 172.21.15.123:0/200882503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57ac14bf50 msgr2=0x7f57ac06dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57b1fc7700 1 --2- 172.21.15.123:0/200882503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57ac14bf50 0x7f57ac06dc80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009d90 tx=0x7f57a400b330 comp rx=0 tx=0).stop 2023-03-08T15:49:35.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57b1fc7700 1 -- 172.21.15.123:0/200882503 shutdown_connections 2023-03-08T15:49:35.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57b1fc7700 1 --2- 172.21.15.123:0/200882503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57ac14bf50 0x7f57ac06dc80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57b1fc7700 1 --2- 172.21.15.123:0/200882503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57ac0bee10 0x7f57ac14ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57b1fc7700 1 -- 172.21.15.123:0/200882503 >> 172.21.15.123:0/200882503 conn(0x7f57ac06aee0 msgr2=0x7f57ac0be700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:35.901 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.894+0000 7f57b1fc7700 1 -- 172.21.15.123:0/200882503 shutdown_connections 2023-03-08T15:49:35.901 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.895+0000 7f57b1fc7700 1 -- 172.21.15.123:0/200882503 wait complete. 2023-03-08T15:49:35.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.896+0000 7f57b1fc7700 1 Processor -- start 2023-03-08T15:49:35.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.896+0000 7f57b1fc7700 1 -- start start 2023-03-08T15:49:35.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.896+0000 7f57b1fc7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57ac0be2a0 0x7f57ac09f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.896+0000 7f57b1fc7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57ac0bee10 0x7f57ac06cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.896+0000 7f57b1fc7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57ac14bf50 0x7f57ac06b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.904 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.896+0000 7f57b1fc7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac06c8f0 con 0x7f57ac14bf50 2023-03-08T15:49:35.904 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.896+0000 7f57b1fc7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac06bb10 con 0x7f57ac0bee10 2023-03-08T15:49:35.904 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.896+0000 7f57b1fc7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac06bfc0 con 0x7f57ac0be2a0 2023-03-08T15:49:35.904 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.896+0000 7f57abfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57ac14bf50 0x7f57ac06b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.904 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.896+0000 7f57abfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57ac14bf50 0x7f57ac06b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57078/0 (socket says 172.21.15.123:57078) 2023-03-08T15:49:35.904 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.896+0000 7f57abfff700 1 -- 172.21.15.123:0/2511900483 learned_addr learned my addr 172.21.15.123:0/2511900483 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:35.904 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.897+0000 7f57ab7fe700 1 --2- 172.21.15.123:0/2511900483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57ac0be2a0 0x7f57ac09f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.897+0000 7f57aaffd700 1 --2- 172.21.15.123:0/2511900483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57ac0bee10 0x7f57ac06cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.897+0000 7f57abfff700 1 -- 172.21.15.123:0/2511900483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57ac0be2a0 msgr2=0x7f57ac09f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.897+0000 7f57abfff700 1 --2- 172.21.15.123:0/2511900483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57ac0be2a0 0x7f57ac09f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.897+0000 7f57abfff700 1 -- 172.21.15.123:0/2511900483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57ac0bee10 msgr2=0x7f57ac06cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:35.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.897+0000 7f57abfff700 1 --2- 172.21.15.123:0/2511900483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57ac0bee10 0x7f57ac06cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:35.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.897+0000 7f57abfff700 1 -- 172.21.15.123:0/2511900483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a4009a70 con 0x7f57ac14bf50 2023-03-08T15:49:35.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.897+0000 7f57ab7fe700 1 --2- 172.21.15.123:0/2511900483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57ac0be2a0 0x7f57ac09f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:35.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.897+0000 7f57abfff700 1 --2- 172.21.15.123:0/2511900483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57ac14bf50 0x7f57ac06b5d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0bf800 tx=0x7f57a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:35.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.897+0000 7f5793fff700 1 -- 172.21.15.123:0/2511900483 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4012430 con 0x7f57ac14bf50 2023-03-08T15:49:35.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.897+0000 7f5793fff700 1 -- 172.21.15.123:0/2511900483 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a4020070 con 0x7f57ac14bf50 2023-03-08T15:49:35.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.897+0000 7f57b1fc7700 1 -- 172.21.15.123:0/2511900483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac0b9930 con 0x7f57ac14bf50 2023-03-08T15:49:35.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.897+0000 7f5793fff700 1 -- 172.21.15.123:0/2511900483 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4004280 con 0x7f57ac14bf50 2023-03-08T15:49:35.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.897+0000 7f57b1fc7700 1 -- 172.21.15.123:0/2511900483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ac09df60 con 0x7f57ac14bf50 2023-03-08T15:49:35.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.898+0000 7f57b1fc7700 1 -- 172.21.15.123:0/2511900483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ac0b9c10 con 0x7f57ac14bf50 2023-03-08T15:49:35.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.898+0000 7f5793fff700 1 -- 172.21.15.123:0/2511900483 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f57a402e070 con 0x7f57ac14bf50 2023-03-08T15:49:35.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.899+0000 7f5793fff700 1 --2- 172.21.15.123:0/2511900483 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f57980698d0 0x7f579806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:35.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.899+0000 7f5793fff700 1 -- 172.21.15.123:0/2511900483 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f57a4022070 con 0x7f57ac14bf50 2023-03-08T15:49:35.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.899+0000 7f57ab7fe700 1 --2- 172.21.15.123:0/2511900483 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f57980698d0 0x7f579806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:35.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.899+0000 7f57ab7fe700 1 --2- 172.21.15.123:0/2511900483 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f57980698d0 0x7f579806bd80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f579c0099f0 tx=0x7f579c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:35.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:35.904+0000 7f5793fff700 1 -- 172.21.15.123:0/2511900483 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f57a4055280 con 0x7f57ac14bf50 2023-03-08T15:49:36.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.090+0000 7f57b1fc7700 1 -- 172.21.15.123:0/2511900483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57ac0744c0 con 0x7f57ac14bf50 2023-03-08T15:49:36.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.090+0000 7f5793fff700 1 -- 172.21.15.123:0/2511900483 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57a40588a0 con 0x7f57ac14bf50 2023-03-08T15:49:36.093 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-03-08T15:49:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.092+0000 7f57b1fc7700 1 -- 172.21.15.123:0/2511900483 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f57980698d0 msgr2=0x7f579806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.092+0000 7f57b1fc7700 1 --2- 172.21.15.123:0/2511900483 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f57980698d0 0x7f579806bd80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f579c0099f0 tx=0x7f579c008040 comp rx=0 tx=0).stop 2023-03-08T15:49:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.092+0000 7f57b1fc7700 1 -- 172.21.15.123:0/2511900483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57ac14bf50 msgr2=0x7f57ac06b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.092+0000 7f57b1fc7700 1 --2- 172.21.15.123:0/2511900483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57ac14bf50 0x7f57ac06b5d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0bf800 tx=0x7f57a4004ad0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.092+0000 7f57b1fc7700 1 -- 172.21.15.123:0/2511900483 shutdown_connections 2023-03-08T15:49:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.093+0000 7f57b1fc7700 1 --2- 172.21.15.123:0/2511900483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57ac14bf50 0x7f57ac06b5d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.093+0000 7f57b1fc7700 1 --2- 172.21.15.123:0/2511900483 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f57980698d0 0x7f579806bd80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.093+0000 7f57b1fc7700 1 --2- 172.21.15.123:0/2511900483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57ac0be2a0 0x7f57ac09f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.093+0000 7f57b1fc7700 1 --2- 172.21.15.123:0/2511900483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57ac0bee10 0x7f57ac06cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.093+0000 7f57b1fc7700 1 -- 172.21.15.123:0/2511900483 >> 172.21.15.123:0/2511900483 conn(0x7f57ac06aee0 msgr2=0x7f57ac071e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:36.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.093+0000 7f57b1fc7700 1 -- 172.21.15.123:0/2511900483 shutdown_connections 2023-03-08T15:49:36.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.093+0000 7f57b1fc7700 1 -- 172.21.15.123:0/2511900483 wait complete. 2023-03-08T15:49:36.107 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-08T15:49:36.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.227+0000 7f828c4c2700 1 Processor -- start 2023-03-08T15:49:36.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.227+0000 7f828c4c2700 1 -- start start 2023-03-08T15:49:36.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.228+0000 7f828c4c2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82841446c0 0x7f82840b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.228+0000 7f828c4c2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8284144a90 0x7f82840bd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.228+0000 7f828c4c2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82840b7fa0 con 0x7f82840ba560 2023-03-08T15:49:36.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.228+0000 7f828c4c2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82840b7130 con 0x7f8284144a90 2023-03-08T15:49:36.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.228+0000 7f828c4c2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82840bc030 con 0x7f82841446c0 2023-03-08T15:49:36.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.228+0000 7f8289a5d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8284144a90 0x7f82840bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.228+0000 7f8289a5d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8284144a90 0x7f82840bd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53426/0 (socket says 172.21.15.123:53426) 2023-03-08T15:49:36.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.228+0000 7f8289a5d700 1 -- 172.21.15.123:0/2394055798 learned_addr learned my addr 172.21.15.123:0/2394055798 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:36.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.228+0000 7f828a25e700 1 --2- 172.21.15.123:0/2394055798 >> v2:172.21.15.175:3300/0 conn(0x7f82841446c0 0x7f82840b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.228+0000 7f8289a5d700 1 -- 172.21.15.123:0/2394055798 >> v2:172.21.15.175:3300/0 conn(0x7f82841446c0 msgr2=0x7f82840b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.228+0000 7f8289a5d700 1 --2- 172.21.15.123:0/2394055798 >> v2:172.21.15.175:3300/0 conn(0x7f82841446c0 0x7f82840b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.228+0000 7f8289a5d700 1 -- 172.21.15.123:0/2394055798 >> v1:172.21.15.175:6789/0 conn(0x7f82840ba560 legacy=0x7f82840b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.228+0000 7f8289a5d700 1 -- 172.21.15.123:0/2394055798 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82840bc310 con 0x7f8284144a90 2023-03-08T15:49:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.228+0000 7f8289a5d700 1 --2- 172.21.15.123:0/2394055798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8284144a90 0x7f82840bd580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f828406ca90 tx=0x7f8278009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3aae73643d4133 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.229+0000 7f828925c700 1 -- 172.21.15.123:0/2394055798 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827800b870 con 0x7f8284144a90 2023-03-08T15:49:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.229+0000 7f828925c700 1 -- 172.21.15.123:0/2394055798 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827800b9d0 con 0x7f8284144a90 2023-03-08T15:49:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.229+0000 7f828925c700 1 -- 172.21.15.123:0/2394055798 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827800bd60 con 0x7f8284144a90 2023-03-08T15:49:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.229+0000 7f828c4c2700 1 -- 172.21.15.123:0/2394055798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8284144a90 msgr2=0x7f82840bd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.229+0000 7f828c4c2700 1 --2- 172.21.15.123:0/2394055798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8284144a90 0x7f82840bd580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f828406ca90 tx=0x7f8278009bd0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.229+0000 7f828c4c2700 1 -- 172.21.15.123:0/2394055798 shutdown_connections 2023-03-08T15:49:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.229+0000 7f828c4c2700 1 --2- 172.21.15.123:0/2394055798 >> v2:172.21.15.175:3300/0 conn(0x7f82841446c0 0x7f82840b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.229+0000 7f828c4c2700 1 --2- 172.21.15.123:0/2394055798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8284144a90 0x7f82840bd580 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.229+0000 7f828c4c2700 1 -- 172.21.15.123:0/2394055798 >> 172.21.15.123:0/2394055798 conn(0x7f8284071980 msgr2=0x7f8284071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.229+0000 7f828c4c2700 1 -- 172.21.15.123:0/2394055798 shutdown_connections 2023-03-08T15:49:36.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.229+0000 7f828c4c2700 1 -- 172.21.15.123:0/2394055798 wait complete. 2023-03-08T15:49:36.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.230+0000 7f828c4c2700 1 Processor -- start 2023-03-08T15:49:36.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.230+0000 7f828c4c2700 1 -- start start 2023-03-08T15:49:36.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828c4c2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82840ba560 0x7f8284149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828c4c2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82841446c0 0x7f82840c0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828c4c2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8284144a90 0x7f828413fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828c4c2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828414a000 con 0x7f82840ba560 2023-03-08T15:49:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828c4c2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8284142f80 con 0x7f8284144a90 2023-03-08T15:49:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828c4c2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8284143260 con 0x7f82841446c0 2023-03-08T15:49:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828a25e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82840ba560 0x7f8284149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828a25e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82840ba560 0x7f8284149ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53436/0 (socket says 172.21.15.123:53436) 2023-03-08T15:49:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828a25e700 1 -- 172.21.15.123:0/2816296242 learned_addr learned my addr 172.21.15.123:0/2816296242 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f8289a5d700 1 --2- 172.21.15.123:0/2816296242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82841446c0 0x7f82840c0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828aa5f700 1 --2- 172.21.15.123:0/2816296242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8284144a90 0x7f828413fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828a25e700 1 -- 172.21.15.123:0/2816296242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82841446c0 msgr2=0x7f82840c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828a25e700 1 --2- 172.21.15.123:0/2816296242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82841446c0 0x7f82840c0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828a25e700 1 -- 172.21.15.123:0/2816296242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8284144a90 msgr2=0x7f828413fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828a25e700 1 --2- 172.21.15.123:0/2816296242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8284144a90 0x7f828413fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828a25e700 1 -- 172.21.15.123:0/2816296242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8278009550 con 0x7f82840ba560 2023-03-08T15:49:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828a25e700 1 --2- 172.21.15.123:0/2816296242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82840ba560 0x7f8284149ac0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f828000e810 tx=0x7f828000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f8276ffd700 1 -- 172.21.15.123:0/2816296242 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280013610 con 0x7f82840ba560 2023-03-08T15:49:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f8276ffd700 1 -- 172.21.15.123:0/2816296242 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8280013770 con 0x7f82840ba560 2023-03-08T15:49:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f828c4c2700 1 -- 172.21.15.123:0/2816296242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828414db90 con 0x7f82840ba560 2023-03-08T15:49:36.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.231+0000 7f8276ffd700 1 -- 172.21.15.123:0/2816296242 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280013b20 con 0x7f82840ba560 2023-03-08T15:49:36.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.232+0000 7f828c4c2700 1 -- 172.21.15.123:0/2816296242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82840bc5f0 con 0x7f82840ba560 2023-03-08T15:49:36.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.232+0000 7f828c4c2700 1 -- 172.21.15.123:0/2816296242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828414dd20 con 0x7f82840ba560 2023-03-08T15:49:36.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.233+0000 7f8276ffd700 1 -- 172.21.15.123:0/2816296242 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f8280023070 con 0x7f82840ba560 2023-03-08T15:49:36.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.233+0000 7f8276ffd700 1 --2- 172.21.15.123:0/2816296242 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f82680698d0 0x7f826806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.233+0000 7f8276ffd700 1 -- 172.21.15.123:0/2816296242 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8280087130 con 0x7f82840ba560 2023-03-08T15:49:36.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.233+0000 7f8289a5d700 1 --2- 172.21.15.123:0/2816296242 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f82680698d0 0x7f826806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.234+0000 7f8289a5d700 1 --2- 172.21.15.123:0/2816296242 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f82680698d0 0x7f826806bd80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8278000c00 tx=0x7f8278008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:36.243 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.237+0000 7f8276ffd700 1 -- 172.21.15.123:0/2816296242 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f828414dd20 con 0x7f82840ba560 2023-03-08T15:49:36.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.421+0000 7f828c4c2700 1 -- 172.21.15.123:0/2816296242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f828414dd20 con 0x7f82840ba560 2023-03-08T15:49:36.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.421+0000 7f8276ffd700 1 -- 172.21.15.123:0/2816296242 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f828414dd20 con 0x7f82840ba560 2023-03-08T15:49:36.423 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-03-08T15:49:36.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.423+0000 7f828c4c2700 1 -- 172.21.15.123:0/2816296242 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f82680698d0 msgr2=0x7f826806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.423+0000 7f828c4c2700 1 --2- 172.21.15.123:0/2816296242 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f82680698d0 0x7f826806bd80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8278000c00 tx=0x7f8278008030 comp rx=0 tx=0).stop 2023-03-08T15:49:36.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.423+0000 7f828c4c2700 1 -- 172.21.15.123:0/2816296242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82840ba560 msgr2=0x7f8284149ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.423+0000 7f828c4c2700 1 --2- 172.21.15.123:0/2816296242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82840ba560 0x7f8284149ac0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f828000e810 tx=0x7f828000ebd0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.423+0000 7f828c4c2700 1 -- 172.21.15.123:0/2816296242 shutdown_connections 2023-03-08T15:49:36.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.423+0000 7f828c4c2700 1 --2- 172.21.15.123:0/2816296242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8284144a90 0x7f828413fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.423+0000 7f828c4c2700 1 --2- 172.21.15.123:0/2816296242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82840ba560 0x7f8284149ac0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.423+0000 7f828c4c2700 1 --2- 172.21.15.123:0/2816296242 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f82680698d0 0x7f826806bd80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.423+0000 7f828c4c2700 1 --2- 172.21.15.123:0/2816296242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82841446c0 0x7f82840c0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.423+0000 7f828c4c2700 1 -- 172.21.15.123:0/2816296242 >> 172.21.15.123:0/2816296242 conn(0x7f8284071980 msgr2=0x7f828414b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:36.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.423+0000 7f828c4c2700 1 -- 172.21.15.123:0/2816296242 shutdown_connections 2023-03-08T15:49:36.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.423+0000 7f828c4c2700 1 -- 172.21.15.123:0/2816296242 wait complete. 2023-03-08T15:49:36.436 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-08T15:49:36.555 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.554+0000 7fa035b25700 1 Processor -- start 2023-03-08T15:49:36.556 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.554+0000 7fa035b25700 1 -- start start 2023-03-08T15:49:36.564 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.554+0000 7fa035b25700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0300b8e60 0x7fa030155f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.564 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.554+0000 7fa035b25700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0300b9b50 con 0x7fa03014ad30 2023-03-08T15:49:36.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.554+0000 7fa035b25700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03014dbf0 con 0x7fa030144b40 2023-03-08T15:49:36.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.554+0000 7fa035b25700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03014e870 con 0x7fa0300b8e60 2023-03-08T15:49:36.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02effd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa03014ad30 0x7fa0300b8750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49546/0 (socket says 172.21.15.123:49546) 2023-03-08T15:49:36.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02effd700 1 -- 172.21.15.123:0/2991717414 learned_addr learned my addr 172.21.15.123:0/2991717414 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:36.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02e7fc700 1 -- 172.21.15.123:0/2991717414 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682874473 0 0) 0x7fa0300b9b50 con 0x7fa03014ad30 2023-03-08T15:49:36.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02ffff700 1 --2- 172.21.15.123:0/2991717414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0300b8e60 0x7fa030155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02e7fc700 1 -- 172.21.15.123:0/2991717414 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0180035b0 con 0x7fa03014ad30 2023-03-08T15:49:36.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02e7fc700 1 -- 172.21.15.123:0/2991717414 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 899472598 0 0) 0x7fa0180035b0 con 0x7fa03014ad30 2023-03-08T15:49:36.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02e7fc700 1 -- 172.21.15.123:0/2991717414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0300b8e60 msgr2=0x7fa030155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:36.567 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02e7fc700 1 --2- 172.21.15.123:0/2991717414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0300b8e60 0x7fa030155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02e7fc700 1 -- 172.21.15.123:0/2991717414 >> v1:172.21.15.175:6789/0 conn(0x7fa030144b40 legacy=0x7fa03014a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02e7fc700 1 -- 172.21.15.123:0/2991717414 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03014ded0 con 0x7fa03014ad30 2023-03-08T15:49:36.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02e7fc700 1 -- 172.21.15.123:0/2991717414 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7fa024001670 con 0x7fa03014ad30 2023-03-08T15:49:36.568 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02e7fc700 1 -- 172.21.15.123:0/2991717414 >> v1:172.21.15.123:6789/0 conn(0x7fa03014ad30 legacy=0x7fa0300b8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02e7fc700 1 --2- 172.21.15.123:0/2991717414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa018003a30 0x7fa018003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02e7fc700 1 --2- 172.21.15.123:0/2991717414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0300b8e60 0x7fa018004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02e7fc700 1 --2- 172.21.15.123:0/2991717414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa018004d90 0x7fa018005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.569 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02e7fc700 1 -- 172.21.15.123:0/2991717414 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03014e870 con 0x7fa018003a30 2023-03-08T15:49:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02e7fc700 1 -- 172.21.15.123:0/2991717414 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01800bac0 con 0x7fa018004d90 2023-03-08T15:49:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02e7fc700 1 -- 172.21.15.123:0/2991717414 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01800bc80 con 0x7fa0300b8e60 2023-03-08T15:49:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02f7fe700 1 --2- 172.21.15.123:0/2991717414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa018003a30 0x7fa018003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.570 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02effd700 1 --2- 172.21.15.123:0/2991717414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0300b8e60 0x7fa018004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.555+0000 7fa02ffff700 1 --2- 172.21.15.123:0/2991717414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa018004d90 0x7fa018005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa02f7fe700 1 -- 172.21.15.123:0/2991717414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0300b8e60 msgr2=0x7fa018004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:36.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa02f7fe700 1 --2- 172.21.15.123:0/2991717414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0300b8e60 0x7fa018004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.571 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa02f7fe700 1 -- 172.21.15.123:0/2991717414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa018004d90 msgr2=0x7fa018005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:36.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa02f7fe700 1 --2- 172.21.15.123:0/2991717414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa018004d90 0x7fa018005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa02f7fe700 1 -- 172.21.15.123:0/2991717414 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0180035b0 con 0x7fa018003a30 2023-03-08T15:49:36.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa02f7fe700 1 --2- 172.21.15.123:0/2991717414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa018003a30 0x7fa018003e40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa0200017c0 tx=0x7fa018005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4152d4b1c4c99969 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:36.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa02e7fc700 1 -- 172.21.15.123:0/2991717414 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0200052d0 con 0x7fa018003a30 2023-03-08T15:49:36.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa02e7fc700 1 -- 172.21.15.123:0/2991717414 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa020005430 con 0x7fa018003a30 2023-03-08T15:49:36.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa02e7fc700 1 -- 172.21.15.123:0/2991717414 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0200038c0 con 0x7fa018003a30 2023-03-08T15:49:36.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa035b25700 1 -- 172.21.15.123:0/2991717414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa018003a30 msgr2=0x7fa018003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa035b25700 1 --2- 172.21.15.123:0/2991717414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa018003a30 0x7fa018003e40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa0200017c0 tx=0x7fa018005880 comp rx=0 tx=0).stop 2023-03-08T15:49:36.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa02ffff700 1 -- 172.21.15.123:0/2991717414 reap_dead start 2023-03-08T15:49:36.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa035b25700 1 -- 172.21.15.123:0/2991717414 shutdown_connections 2023-03-08T15:49:36.574 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa035b25700 1 -- 172.21.15.123:0/2991717414 >> 172.21.15.123:0/2991717414 conn(0x7fa030071980 msgr2=0x7fa030071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:36.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa035b25700 1 -- 172.21.15.123:0/2991717414 shutdown_connections 2023-03-08T15:49:36.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.556+0000 7fa035b25700 1 -- 172.21.15.123:0/2991717414 wait complete. 2023-03-08T15:49:36.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.557+0000 7fa035b25700 1 Processor -- start 2023-03-08T15:49:36.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.558+0000 7fa035b25700 1 -- start start 2023-03-08T15:49:36.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.558+0000 7fa035b25700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa018003a30 0x7fa0301d7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.558+0000 7fa035b25700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0301d3ef0 0x7fa0301df950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.558+0000 7fa035b25700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0301dfe90 0x7fa0300a6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.558+0000 7fa035b25700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0301d7790 con 0x7fa018003a30 2023-03-08T15:49:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.558+0000 7fa035b25700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0301e02e0 con 0x7fa0301dfe90 2023-03-08T15:49:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.558+0000 7fa035b25700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0301d44b0 con 0x7fa0301d3ef0 2023-03-08T15:49:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.558+0000 7fa02f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa018003a30 0x7fa0301d7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.558+0000 7fa02f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa018003a30 0x7fa0301d7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53456/0 (socket says 172.21.15.123:53456) 2023-03-08T15:49:36.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.558+0000 7fa02f7fe700 1 -- 172.21.15.123:0/928306632 learned_addr learned my addr 172.21.15.123:0/928306632 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:36.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.558+0000 7fa02effd700 1 --2- 172.21.15.123:0/928306632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0301d3ef0 0x7fa0301df950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.558+0000 7fa02ffff700 1 --2- 172.21.15.123:0/928306632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0301dfe90 0x7fa0300a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.578 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.559+0000 7fa02f7fe700 1 -- 172.21.15.123:0/928306632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0301d3ef0 msgr2=0x7fa0301df950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.559+0000 7fa02f7fe700 1 --2- 172.21.15.123:0/928306632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0301d3ef0 0x7fa0301df950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.559+0000 7fa02f7fe700 1 -- 172.21.15.123:0/928306632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0301dfe90 msgr2=0x7fa0300a6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.559+0000 7fa02f7fe700 1 --2- 172.21.15.123:0/928306632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0301dfe90 0x7fa0300a6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.559+0000 7fa02f7fe700 1 -- 172.21.15.123:0/928306632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03014e490 con 0x7fa018003a30 2023-03-08T15:49:36.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.559+0000 7fa02f7fe700 1 --2- 172.21.15.123:0/928306632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa018003a30 0x7fa0301d7250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa020006b10 tx=0x7fa020001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:36.579 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.559+0000 7fa017fff700 1 -- 172.21.15.123:0/928306632 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa020007240 con 0x7fa018003a30 2023-03-08T15:49:36.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.559+0000 7fa017fff700 1 -- 172.21.15.123:0/928306632 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0200073a0 con 0x7fa018003a30 2023-03-08T15:49:36.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.559+0000 7fa035b25700 1 -- 172.21.15.123:0/928306632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03014e1b0 con 0x7fa018003a30 2023-03-08T15:49:36.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.559+0000 7fa017fff700 1 -- 172.21.15.123:0/928306632 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa020001290 con 0x7fa018003a30 2023-03-08T15:49:36.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.559+0000 7fa035b25700 1 -- 172.21.15.123:0/928306632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0300b7d40 con 0x7fa018003a30 2023-03-08T15:49:36.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.560+0000 7fa035b25700 1 -- 172.21.15.123:0/928306632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0300744c0 con 0x7fa018003a30 2023-03-08T15:49:36.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.560+0000 7fa017fff700 1 -- 172.21.15.123:0/928306632 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fa02002e070 con 0x7fa018003a30 2023-03-08T15:49:36.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.561+0000 7fa017fff700 1 --2- 172.21.15.123:0/928306632 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa01c0698d0 0x7fa01c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.561+0000 7fa017fff700 1 -- 172.21.15.123:0/928306632 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa020088030 con 0x7fa018003a30 2023-03-08T15:49:36.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.561+0000 7fa02effd700 1 --2- 172.21.15.123:0/928306632 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa01c0698d0 0x7fa01c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.561+0000 7fa02effd700 1 --2- 172.21.15.123:0/928306632 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa01c0698d0 0x7fa01c06bd80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa0300b11f0 tx=0x7fa024000ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:36.581 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.565+0000 7fa017fff700 1 -- 172.21.15.123:0/928306632 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fa020054150 con 0x7fa018003a30 2023-03-08T15:49:36.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.750+0000 7fa035b25700 1 -- 172.21.15.123:0/928306632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa0300bc410 con 0x7fa018003a30 2023-03-08T15:49:36.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.750+0000 7fa017fff700 1 -- 172.21.15.123:0/928306632 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa020057770 con 0x7fa018003a30 2023-03-08T15:49:36.752 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:36.752 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2023-03-08T15:49:36.752 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:49:36.752 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2023-03-08T15:49:36.752 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2023-03-08T15:49:36.752 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:49:36.752 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:49:36.753 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 2, 2023-03-08T15:49:36.753 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": "rbd" 2023-03-08T15:49:36.753 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:49:36.753 INFO:teuthology.orchestra.run.smithi123.stdout:] 2023-03-08T15:49:36.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.752+0000 7fa035b25700 1 -- 172.21.15.123:0/928306632 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa01c0698d0 msgr2=0x7fa01c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.752+0000 7fa035b25700 1 --2- 172.21.15.123:0/928306632 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa01c0698d0 0x7fa01c06bd80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa0300b11f0 tx=0x7fa024000ed0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.752+0000 7fa035b25700 1 -- 172.21.15.123:0/928306632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa018003a30 msgr2=0x7fa0301d7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.752+0000 7fa035b25700 1 --2- 172.21.15.123:0/928306632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa018003a30 0x7fa0301d7250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa020006b10 tx=0x7fa020001120 comp rx=0 tx=0).stop 2023-03-08T15:49:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.752+0000 7fa035b25700 1 -- 172.21.15.123:0/928306632 shutdown_connections 2023-03-08T15:49:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.752+0000 7fa035b25700 1 --2- 172.21.15.123:0/928306632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0301dfe90 0x7fa0300a6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.752+0000 7fa035b25700 1 --2- 172.21.15.123:0/928306632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa018003a30 0x7fa0301d7250 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.752+0000 7fa035b25700 1 --2- 172.21.15.123:0/928306632 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa01c0698d0 0x7fa01c06bd80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.752+0000 7fa035b25700 1 --2- 172.21.15.123:0/928306632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0301d3ef0 0x7fa0301df950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.752+0000 7fa035b25700 1 -- 172.21.15.123:0/928306632 >> 172.21.15.123:0/928306632 conn(0x7fa030071980 msgr2=0x7fa030142bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.752+0000 7fa035b25700 1 -- 172.21.15.123:0/928306632 shutdown_connections 2023-03-08T15:49:36.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.752+0000 7fa035b25700 1 -- 172.21.15.123:0/928306632 wait complete. 2023-03-08T15:49:36.765 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-08T15:49:36.765 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-08T15:49:36.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.887+0000 7fad1b2e5700 1 Processor -- start 2023-03-08T15:49:36.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.887+0000 7fad1b2e5700 1 -- start start 2023-03-08T15:49:36.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad1b2e5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fad14148130 0x7fad1406b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad1b2e5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fad14147510 0x7fad140bd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad1b2e5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad140b7180 con 0x7fad140b3c30 2023-03-08T15:49:36.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad1b2e5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad14141cd0 con 0x7fad14147510 2023-03-08T15:49:36.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad1b2e5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad140b8c40 con 0x7fad14148130 2023-03-08T15:49:36.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad18880700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fad14147510 0x7fad140bd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad19882700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fad140b3c30 0x7fad1414aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49560/0 (socket says 172.21.15.123:49560) 2023-03-08T15:49:36.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad19882700 1 -- 172.21.15.123:0/1410965291 learned_addr learned my addr 172.21.15.123:0/1410965291 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:36.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad19081700 1 --2- 172.21.15.123:0/1410965291 >> v2:172.21.15.175:3300/0 conn(0x7fad14148130 0x7fad1406b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad18880700 1 -- 172.21.15.123:0/1410965291 >> v2:172.21.15.175:3300/0 conn(0x7fad14148130 msgr2=0x7fad1406b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:36.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad18880700 1 --2- 172.21.15.123:0/1410965291 >> v2:172.21.15.175:3300/0 conn(0x7fad14148130 0x7fad1406b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad18880700 1 -- 172.21.15.123:0/1410965291 >> v1:172.21.15.123:6789/0 conn(0x7fad140b3c30 legacy=0x7fad1414aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad18880700 1 -- 172.21.15.123:0/1410965291 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1406ba10 con 0x7fad14147510 2023-03-08T15:49:36.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad0bfff700 1 -- 172.21.15.123:0/1410965291 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178672200 0 0) 0x7fad140b7180 con 0x7fad140b3c30 2023-03-08T15:49:36.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad18880700 1 --2- 172.21.15.123:0/1410965291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad14147510 0x7fad140bd420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fad14073d50 tx=0x7fad04009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae6ef73f34bfdf7 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:36.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad0bfff700 1 -- 172.21.15.123:0/1410965291 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad04011830 con 0x7fad14147510 2023-03-08T15:49:36.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad0bfff700 1 -- 172.21.15.123:0/1410965291 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad04011990 con 0x7fad14147510 2023-03-08T15:49:36.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.888+0000 7fad0bfff700 1 -- 172.21.15.123:0/1410965291 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad04011d20 con 0x7fad14147510 2023-03-08T15:49:36.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.889+0000 7fad1b2e5700 1 -- 172.21.15.123:0/1410965291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad14147510 msgr2=0x7fad140bd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.893 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.889+0000 7fad1b2e5700 1 --2- 172.21.15.123:0/1410965291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad14147510 0x7fad140bd420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fad14073d50 tx=0x7fad04009b20 comp rx=0 tx=0).stop 2023-03-08T15:49:36.893 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.889+0000 7fad1b2e5700 1 -- 172.21.15.123:0/1410965291 shutdown_connections 2023-03-08T15:49:36.893 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.889+0000 7fad1b2e5700 1 --2- 172.21.15.123:0/1410965291 >> v2:172.21.15.175:3300/0 conn(0x7fad14148130 0x7fad1406b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.893 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.889+0000 7fad1b2e5700 1 --2- 172.21.15.123:0/1410965291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad14147510 0x7fad140bd420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.893 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.889+0000 7fad1b2e5700 1 -- 172.21.15.123:0/1410965291 >> 172.21.15.123:0/1410965291 conn(0x7fad140ba3c0 msgr2=0x7fad140bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:36.893 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.889+0000 7fad1b2e5700 1 -- 172.21.15.123:0/1410965291 shutdown_connections 2023-03-08T15:49:36.893 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.889+0000 7fad1b2e5700 1 -- 172.21.15.123:0/1410965291 wait complete. 2023-03-08T15:49:36.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.890+0000 7fad1b2e5700 1 Processor -- start 2023-03-08T15:49:36.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.890+0000 7fad1b2e5700 1 -- start start 2023-03-08T15:49:36.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.890+0000 7fad1b2e5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad140b3c30 0x7fad14141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.890+0000 7fad1b2e5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad14147510 0x7fad14144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.890+0000 7fad1b2e5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad14148130 0x7fad140b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad1b2e5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad14142480 con 0x7fad140b3c30 2023-03-08T15:49:36.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad1b2e5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad14142a30 con 0x7fad14148130 2023-03-08T15:49:36.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad1b2e5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad140bc6b0 con 0x7fad14147510 2023-03-08T15:49:36.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad19081700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad140b3c30 0x7fad14141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad19081700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad140b3c30 0x7fad14141f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53470/0 (socket says 172.21.15.123:53470) 2023-03-08T15:49:36.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad19081700 1 -- 172.21.15.123:0/2091485893 learned_addr learned my addr 172.21.15.123:0/2091485893 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:36.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad18880700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad14147510 0x7fad14144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad19882700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad14148130 0x7fad140b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad19081700 1 -- 172.21.15.123:0/2091485893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad14147510 msgr2=0x7fad14144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad19081700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad14147510 0x7fad14144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad19081700 1 -- 172.21.15.123:0/2091485893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad14148130 msgr2=0x7fad140b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:36.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad19081700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad14148130 0x7fad140b76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:36.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad19081700 1 -- 172.21.15.123:0/2091485893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040094a0 con 0x7fad140b3c30 2023-03-08T15:49:36.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad18880700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad14147510 0x7fad14144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:36.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad19882700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad14148130 0x7fad140b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:36.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad19081700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad140b3c30 0x7fad14141f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fad1000e870 tx=0x7fad1000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:36.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad09ffb700 1 -- 172.21.15.123:0/2091485893 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad10009590 con 0x7fad140b3c30 2023-03-08T15:49:36.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad09ffb700 1 -- 172.21.15.123:0/2091485893 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1000ee70 con 0x7fad140b3c30 2023-03-08T15:49:36.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad1b2e5700 1 -- 172.21.15.123:0/2091485893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad140b6e10 con 0x7fad140b3c30 2023-03-08T15:49:36.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad09ffb700 1 -- 172.21.15.123:0/2091485893 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1000ca50 con 0x7fad140b3c30 2023-03-08T15:49:36.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.891+0000 7fad1b2e5700 1 -- 172.21.15.123:0/2091485893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad140b8960 con 0x7fad140b3c30 2023-03-08T15:49:36.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.892+0000 7fad1b2e5700 1 -- 172.21.15.123:0/2091485893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad14071eb0 con 0x7fad140b3c30 2023-03-08T15:49:36.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.893+0000 7fad09ffb700 1 -- 172.21.15.123:0/2091485893 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fad10019030 con 0x7fad140b3c30 2023-03-08T15:49:36.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.893+0000 7fad09ffb700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7facf80698d0 0x7facf806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:36.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.893+0000 7fad09ffb700 1 -- 172.21.15.123:0/2091485893 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fad10087190 con 0x7fad140b3c30 2023-03-08T15:49:36.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.893+0000 7fad18880700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7facf80698d0 0x7facf806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:36.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.894+0000 7fad18880700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7facf80698d0 0x7facf806bd80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fad040090b0 tx=0x7fad04008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:36.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:36.897+0000 7fad09ffb700 1 -- 172.21.15.123:0/2091485893 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fad100532b0 con 0x7fad140b3c30 2023-03-08T15:49:37.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:37.086+0000 7fad1b2e5700 1 -- 172.21.15.123:0/2091485893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fad140b5ba0 con 0x7fad140b3c30 2023-03-08T15:49:38.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.053+0000 7fad09ffb700 1 -- 172.21.15.123:0/2091485893 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7fad100568d0 con 0x7fad140b3c30 2023-03-08T15:49:38.058 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.057+0000 7fad1b2e5700 1 -- 172.21.15.123:0/2091485893 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7facf80698d0 msgr2=0x7facf806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:38.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.057+0000 7fad1b2e5700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7facf80698d0 0x7facf806bd80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fad040090b0 tx=0x7fad04008030 comp rx=0 tx=0).stop 2023-03-08T15:49:38.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.057+0000 7fad1b2e5700 1 -- 172.21.15.123:0/2091485893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad140b3c30 msgr2=0x7fad14141f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:38.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.057+0000 7fad1b2e5700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad140b3c30 0x7fad14141f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fad1000e870 tx=0x7fad1000ec30 comp rx=0 tx=0).stop 2023-03-08T15:49:38.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.058+0000 7fad1b2e5700 1 -- 172.21.15.123:0/2091485893 shutdown_connections 2023-03-08T15:49:38.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.058+0000 7fad1b2e5700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad14148130 0x7fad140b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:38.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.058+0000 7fad1b2e5700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad140b3c30 0x7fad14141f40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:38.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.058+0000 7fad1b2e5700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7facf80698d0 0x7facf806bd80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:38.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.058+0000 7fad1b2e5700 1 --2- 172.21.15.123:0/2091485893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad14147510 0x7fad14144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:38.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.058+0000 7fad1b2e5700 1 -- 172.21.15.123:0/2091485893 >> 172.21.15.123:0/2091485893 conn(0x7fad140ba3c0 msgr2=0x7fad140b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:38.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.059+0000 7fad1b2e5700 1 -- 172.21.15.123:0/2091485893 shutdown_connections 2023-03-08T15:49:38.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.059+0000 7fad1b2e5700 1 -- 172.21.15.123:0/2091485893 wait complete. 2023-03-08T15:49:38.061 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2023-03-08T15:49:38.075 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-03-08T15:49:38.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.206+0000 7f5d3b103700 1 Processor -- start 2023-03-08T15:49:38.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.206+0000 7f5d3b103700 1 -- start start 2023-03-08T15:49:38.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d3b103700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5d340bb350 0x7f5d341446b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:38.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d3b103700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5d34144bf0 0x7f5d340bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:38.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d3b103700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d340be1f0 0x7f5d3414e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:38.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d3b103700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3414dc00 con 0x7f5d34144bf0 2023-03-08T15:49:38.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d3b103700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3406bb70 con 0x7f5d340bb350 2023-03-08T15:49:38.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d3b103700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d340b9fc0 con 0x7f5d340be1f0 2023-03-08T15:49:38.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d33fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5d34144bf0 0x7f5d340bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:38.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d33fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5d34144bf0 0x7f5d340bdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53480/0 (socket says 172.21.15.123:53480) 2023-03-08T15:49:38.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d33fff700 1 -- 172.21.15.123:0/1591164227 learned_addr learned my addr 172.21.15.123:0/1591164227 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:38.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d396a0700 1 --2- 172.21.15.123:0/1591164227 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d340be1f0 0x7f5d3414e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:38.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d38e9f700 1 --2- 172.21.15.123:0/1591164227 >> v2:172.21.15.175:3300/0 conn(0x7f5d340bb350 0x7f5d341446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:38.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d33fff700 1 -- 172.21.15.123:0/1591164227 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d340be1f0 msgr2=0x7f5d3414e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:38.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d33fff700 1 --2- 172.21.15.123:0/1591164227 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d340be1f0 0x7f5d3414e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:38.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d33fff700 1 -- 172.21.15.123:0/1591164227 >> v2:172.21.15.175:3300/0 conn(0x7f5d340bb350 msgr2=0x7f5d341446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:38.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d33fff700 1 --2- 172.21.15.123:0/1591164227 >> v2:172.21.15.175:3300/0 conn(0x7f5d340bb350 0x7f5d341446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:38.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d33fff700 1 -- 172.21.15.123:0/1591164227 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d340ba2a0 con 0x7f5d34144bf0 2023-03-08T15:49:38.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d33fff700 1 --2- 172.21.15.123:0/1591164227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d34144bf0 0x7f5d340bdcb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5d340703b0 tx=0x7f5d20009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5173a019365a6c5f server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:38.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d337fe700 1 -- 172.21.15.123:0/1591164227 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000b870 con 0x7f5d34144bf0 2023-03-08T15:49:38.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d337fe700 1 -- 172.21.15.123:0/1591164227 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2000b9d0 con 0x7f5d34144bf0 2023-03-08T15:49:38.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.207+0000 7f5d337fe700 1 -- 172.21.15.123:0/1591164227 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000bd60 con 0x7f5d34144bf0 2023-03-08T15:49:38.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.208+0000 7f5d3b103700 1 -- 172.21.15.123:0/1591164227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d34144bf0 msgr2=0x7f5d340bdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:38.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.208+0000 7f5d3b103700 1 --2- 172.21.15.123:0/1591164227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d34144bf0 0x7f5d340bdcb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5d340703b0 tx=0x7f5d20009bd0 comp rx=0 tx=0).stop 2023-03-08T15:49:38.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.208+0000 7f5d3b103700 1 -- 172.21.15.123:0/1591164227 shutdown_connections 2023-03-08T15:49:38.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.208+0000 7f5d3b103700 1 --2- 172.21.15.123:0/1591164227 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d340be1f0 0x7f5d3414e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:38.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.208+0000 7f5d3b103700 1 --2- 172.21.15.123:0/1591164227 >> v2:172.21.15.175:3300/0 conn(0x7f5d340bb350 0x7f5d341446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:38.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.208+0000 7f5d3b103700 1 --2- 172.21.15.123:0/1591164227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d34144bf0 0x7f5d340bdcb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:38.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.208+0000 7f5d3b103700 1 -- 172.21.15.123:0/1591164227 >> 172.21.15.123:0/1591164227 conn(0x7f5d3406a250 msgr2=0x7f5d3406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:38.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.208+0000 7f5d3b103700 1 -- 172.21.15.123:0/1591164227 shutdown_connections 2023-03-08T15:49:38.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.208+0000 7f5d3b103700 1 -- 172.21.15.123:0/1591164227 wait complete. 2023-03-08T15:49:38.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.209+0000 7f5d3b103700 1 Processor -- start 2023-03-08T15:49:38.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.209+0000 7f5d3b103700 1 -- start start 2023-03-08T15:49:38.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d3b103700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d340bb350 0x7f5d3414ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:38.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d3b103700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d340be1f0 0x7f5d341d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:38.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d3b103700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d34144bf0 0x7f5d34133aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:38.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d3b103700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3414bf80 con 0x7f5d340bb350 2023-03-08T15:49:38.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d3b103700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d341e02c0 con 0x7f5d34144bf0 2023-03-08T15:49:38.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d3b103700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3414d950 con 0x7f5d340be1f0 2023-03-08T15:49:38.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d38e9f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d340bb350 0x7f5d3414ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:38.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d38e9f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d340bb350 0x7f5d3414ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53486/0 (socket says 172.21.15.123:53486) 2023-03-08T15:49:38.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d38e9f700 1 -- 172.21.15.123:0/1924865495 learned_addr learned my addr 172.21.15.123:0/1924865495 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:38.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d33fff700 1 --2- 172.21.15.123:0/1924865495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d340be1f0 0x7f5d341d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:38.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d396a0700 1 --2- 172.21.15.123:0/1924865495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d34144bf0 0x7f5d34133aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:38.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d38e9f700 1 -- 172.21.15.123:0/1924865495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d340be1f0 msgr2=0x7f5d341d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:38.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d38e9f700 1 --2- 172.21.15.123:0/1924865495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d340be1f0 0x7f5d341d4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:38.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d38e9f700 1 -- 172.21.15.123:0/1924865495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d34144bf0 msgr2=0x7f5d34133aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:38.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d38e9f700 1 --2- 172.21.15.123:0/1924865495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d34144bf0 0x7f5d34133aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:38.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d38e9f700 1 -- 172.21.15.123:0/1924865495 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d20009550 con 0x7f5d340bb350 2023-03-08T15:49:38.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d38e9f700 1 --2- 172.21.15.123:0/1924865495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d340bb350 0x7f5d3414ba40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800e810 tx=0x7f5d2800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:38.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d317fa700 1 -- 172.21.15.123:0/1924865495 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800c070 con 0x7f5d340bb350 2023-03-08T15:49:38.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d317fa700 1 -- 172.21.15.123:0/1924865495 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d28013610 con 0x7f5d340bb350 2023-03-08T15:49:38.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d3b103700 1 -- 172.21.15.123:0/1924865495 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d340bb720 con 0x7f5d340bb350 2023-03-08T15:49:38.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.210+0000 7f5d317fa700 1 -- 172.21.15.123:0/1924865495 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d280139a0 con 0x7f5d340bb350 2023-03-08T15:49:38.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.211+0000 7f5d3b103700 1 -- 172.21.15.123:0/1924865495 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d340ba580 con 0x7f5d340bb350 2023-03-08T15:49:38.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.211+0000 7f5d3b103700 1 -- 172.21.15.123:0/1924865495 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3414e5d0 con 0x7f5d340bb350 2023-03-08T15:49:38.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.212+0000 7f5d317fa700 1 -- 172.21.15.123:0/1924865495 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f5d28023070 con 0x7f5d340bb350 2023-03-08T15:49:38.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.212+0000 7f5d317fa700 1 --2- 172.21.15.123:0/1924865495 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5d180698d0 0x7f5d1806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:38.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.212+0000 7f5d33fff700 1 --2- 172.21.15.123:0/1924865495 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5d180698d0 0x7f5d1806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:38.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.212+0000 7f5d317fa700 1 -- 172.21.15.123:0/1924865495 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f5d28087200 con 0x7f5d340bb350 2023-03-08T15:49:38.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.213+0000 7f5d33fff700 1 --2- 172.21.15.123:0/1924865495 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5d180698d0 0x7f5d1806bd80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d340703b0 tx=0x7f5d20008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:38.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.217+0000 7f5d317fa700 1 -- 172.21.15.123:0/1924865495 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f5d28053130 con 0x7f5d340bb350 2023-03-08T15:49:38.310 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:49:38.313 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:49:38.315 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:49:38.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:38.413+0000 7f5d3b103700 1 -- 172.21.15.123:0/1924865495 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5d340744c0 con 0x7f5d340bb350 2023-03-08T15:49:39.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.054+0000 7f5d317fa700 1 -- 172.21.15.123:0/1924865495 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5d2800f040 con 0x7f5d340bb350 2023-03-08T15:49:39.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.059+0000 7f5d3b103700 1 -- 172.21.15.123:0/1924865495 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5d180698d0 msgr2=0x7f5d1806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.059+0000 7f5d3b103700 1 --2- 172.21.15.123:0/1924865495 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5d180698d0 0x7f5d1806bd80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d340703b0 tx=0x7f5d20008030 comp rx=0 tx=0).stop 2023-03-08T15:49:39.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.059+0000 7f5d3b103700 1 -- 172.21.15.123:0/1924865495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d340bb350 msgr2=0x7f5d3414ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.062 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.059+0000 7f5d3b103700 1 --2- 172.21.15.123:0/1924865495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d340bb350 0x7f5d3414ba40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800e810 tx=0x7f5d2800eb20 comp rx=0 tx=0).stop 2023-03-08T15:49:39.062 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.060+0000 7f5d3b103700 1 -- 172.21.15.123:0/1924865495 shutdown_connections 2023-03-08T15:49:39.062 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.060+0000 7f5d3b103700 1 --2- 172.21.15.123:0/1924865495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d34144bf0 0x7f5d34133aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.062 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.060+0000 7f5d3b103700 1 --2- 172.21.15.123:0/1924865495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d340bb350 0x7f5d3414ba40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.062 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.060+0000 7f5d3b103700 1 --2- 172.21.15.123:0/1924865495 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5d180698d0 0x7f5d1806bd80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.062 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.060+0000 7f5d3b103700 1 --2- 172.21.15.123:0/1924865495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d340be1f0 0x7f5d341d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.062 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.060+0000 7f5d3b103700 1 -- 172.21.15.123:0/1924865495 >> 172.21.15.123:0/1924865495 conn(0x7f5d3406a250 msgr2=0x7f5d340bc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.060+0000 7f5d3b103700 1 -- 172.21.15.123:0/1924865495 shutdown_connections 2023-03-08T15:49:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.061+0000 7f5d3b103700 1 -- 172.21.15.123:0/1924865495 wait complete. 2023-03-08T15:49:39.071 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2023-03-08T15:49:39.084 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-08T15:49:39.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.248+0000 7f69b5a54700 1 Processor -- start 2023-03-08T15:49:39.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.248+0000 7f69b5a54700 1 -- start start 2023-03-08T15:49:39.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.248+0000 7f69b5a54700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69b0147e50 0x7f69b006a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69b5a54700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b014a810 con 0x7f69b014b420 2023-03-08T15:49:39.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69b5a54700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b0071a40 con 0x7f69b006fef0 2023-03-08T15:49:39.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69b5a54700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b0071d20 con 0x7f69b0147e50 2023-03-08T15:49:39.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69af7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f69b014b420 0x7f69b0155040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49576/0 (socket says 172.21.15.123:49576) 2023-03-08T15:49:39.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69af7fe700 1 -- 172.21.15.123:0/2795219516 learned_addr learned my addr 172.21.15.123:0/2795219516 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:39.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69aeffd700 1 --2- 172.21.15.123:0/2795219516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69b0147e50 0x7f69b006a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69adffb700 1 -- 172.21.15.123:0/2795219516 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174403283 0 0) 0x7f69b014a810 con 0x7f69b014b420 2023-03-08T15:49:39.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69adffb700 1 -- 172.21.15.123:0/2795219516 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69980035b0 con 0x7f69b014b420 2023-03-08T15:49:39.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69adffb700 1 -- 172.21.15.123:0/2795219516 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4246324656 0 0) 0x7f69980035b0 con 0x7f69b014b420 2023-03-08T15:49:39.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69adffb700 1 -- 172.21.15.123:0/2795219516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69b0147e50 msgr2=0x7f69b006a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:39.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69adffb700 1 --2- 172.21.15.123:0/2795219516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69b0147e50 0x7f69b006a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69adffb700 1 -- 172.21.15.123:0/2795219516 >> v1:172.21.15.175:6789/0 conn(0x7f69b006fef0 legacy=0x7f69b014ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69adffb700 1 -- 172.21.15.123:0/2795219516 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b0072000 con 0x7f69b014b420 2023-03-08T15:49:39.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69adffb700 1 -- 172.21.15.123:0/2795219516 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f69a80019f0 con 0x7f69b014b420 2023-03-08T15:49:39.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69adffb700 1 -- 172.21.15.123:0/2795219516 >> v1:172.21.15.123:6789/0 conn(0x7f69b014b420 legacy=0x7f69b0155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69adffb700 1 --2- 172.21.15.123:0/2795219516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6998003a30 0x7f6998003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69adffb700 1 --2- 172.21.15.123:0/2795219516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69b0147e50 0x7f6998004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69adffb700 1 --2- 172.21.15.123:0/2795219516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6998004d90 0x7f6998005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69adffb700 1 -- 172.21.15.123:0/2795219516 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b0071d20 con 0x7f6998004d90 2023-03-08T15:49:39.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69adffb700 1 -- 172.21.15.123:0/2795219516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699800bac0 con 0x7f6998003a30 2023-03-08T15:49:39.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69adffb700 1 -- 172.21.15.123:0/2795219516 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699800bc50 con 0x7f69b0147e50 2023-03-08T15:49:39.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69af7fe700 1 --2- 172.21.15.123:0/2795219516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6998004d90 0x7f6998005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69aeffd700 1 --2- 172.21.15.123:0/2795219516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6998003a30 0x7f6998003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.249+0000 7f69ae7fc700 1 --2- 172.21.15.123:0/2795219516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69b0147e50 0x7f6998004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69af7fe700 1 -- 172.21.15.123:0/2795219516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69b0147e50 msgr2=0x7f6998004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:39.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69af7fe700 1 --2- 172.21.15.123:0/2795219516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69b0147e50 0x7f6998004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69af7fe700 1 -- 172.21.15.123:0/2795219516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6998003a30 msgr2=0x7f6998003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:39.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69af7fe700 1 --2- 172.21.15.123:0/2795219516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6998003a30 0x7f6998003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69af7fe700 1 -- 172.21.15.123:0/2795219516 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69980035b0 con 0x7f6998004d90 2023-03-08T15:49:39.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69af7fe700 1 --2- 172.21.15.123:0/2795219516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6998004d90 0x7f6998005200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f69a800a830 tx=0x7f6998005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8faaf7a40463a70 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:39.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69adffb700 1 -- 172.21.15.123:0/2795219516 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a800a2f0 con 0x7f6998004d90 2023-03-08T15:49:39.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69adffb700 1 -- 172.21.15.123:0/2795219516 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a8012600 con 0x7f6998004d90 2023-03-08T15:49:39.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69adffb700 1 -- 172.21.15.123:0/2795219516 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a80129b0 con 0x7f6998004d90 2023-03-08T15:49:39.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69b5a54700 1 -- 172.21.15.123:0/2795219516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6998004d90 msgr2=0x7f6998005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69b5a54700 1 --2- 172.21.15.123:0/2795219516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6998004d90 0x7f6998005200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f69a800a830 tx=0x7f6998005880 comp rx=0 tx=0).stop 2023-03-08T15:49:39.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69af7fe700 1 -- 172.21.15.123:0/2795219516 reap_dead start 2023-03-08T15:49:39.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69b5a54700 1 -- 172.21.15.123:0/2795219516 shutdown_connections 2023-03-08T15:49:39.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69b5a54700 1 -- 172.21.15.123:0/2795219516 >> 172.21.15.123:0/2795219516 conn(0x7f69b006b360 msgr2=0x7f69b006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:39.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69b5a54700 1 -- 172.21.15.123:0/2795219516 shutdown_connections 2023-03-08T15:49:39.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.250+0000 7f69b5a54700 1 -- 172.21.15.123:0/2795219516 wait complete. 2023-03-08T15:49:39.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.251+0000 7f69b5a54700 1 Processor -- start 2023-03-08T15:49:39.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.252+0000 7f69b5a54700 1 -- start start 2023-03-08T15:49:39.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.252+0000 7f69b5a54700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69b014a240 0x7f69b01df890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.252+0000 7f69b5a54700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69b0149bf0 0x7f69b01e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.252+0000 7f69b5a54700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69b00b6f50 0x7f69b00b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.252+0000 7f69b5a54700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b01405a0 con 0x7f69b0149bf0 2023-03-08T15:49:39.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.252+0000 7f69b5a54700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b01e2e60 con 0x7f69b014a240 2023-03-08T15:49:39.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.252+0000 7f69b5a54700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b00b55a0 con 0x7f69b00b6f50 2023-03-08T15:49:39.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.252+0000 7f69ae7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69b0149bf0 0x7f69b01e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.252+0000 7f69ae7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69b0149bf0 0x7f69b01e38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53506/0 (socket says 172.21.15.123:53506) 2023-03-08T15:49:39.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.252+0000 7f69ae7fc700 1 -- 172.21.15.123:0/1559521676 learned_addr learned my addr 172.21.15.123:0/1559521676 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:39.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.252+0000 7f69af7fe700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69b00b6f50 0x7f69b00b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.252+0000 7f69aeffd700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69b014a240 0x7f69b01df890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.252+0000 7f69ae7fc700 1 -- 172.21.15.123:0/1559521676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69b00b6f50 msgr2=0x7f69b00b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.252+0000 7f69ae7fc700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69b00b6f50 0x7f69b00b73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.253+0000 7f69ae7fc700 1 -- 172.21.15.123:0/1559521676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69b014a240 msgr2=0x7f69b01df890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.253+0000 7f69ae7fc700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69b014a240 0x7f69b01df890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.253+0000 7f69ae7fc700 1 -- 172.21.15.123:0/1559521676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b00728f0 con 0x7f69b0149bf0 2023-03-08T15:49:39.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.253+0000 7f69af7fe700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69b00b6f50 0x7f69b00b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:39.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.253+0000 7f69aeffd700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69b014a240 0x7f69b01df890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:39.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.253+0000 7f69ae7fc700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69b0149bf0 0x7f69b01e38b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f69a400f820 tx=0x7f69a400fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:39.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.253+0000 7f6997fff700 1 -- 172.21.15.123:0/1559521676 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a40052e0 con 0x7f69b0149bf0 2023-03-08T15:49:39.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.253+0000 7f6997fff700 1 -- 172.21.15.123:0/1559521676 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a4005440 con 0x7f69b0149bf0 2023-03-08T15:49:39.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.253+0000 7f69b5a54700 1 -- 172.21.15.123:0/1559521676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b0148220 con 0x7f69b0149bf0 2023-03-08T15:49:39.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.253+0000 7f6997fff700 1 -- 172.21.15.123:0/1559521676 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a40038a0 con 0x7f69b0149bf0 2023-03-08T15:49:39.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.253+0000 7f69b5a54700 1 -- 172.21.15.123:0/1559521676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b00b45f0 con 0x7f69b0149bf0 2023-03-08T15:49:39.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.254+0000 7f69b5a54700 1 -- 172.21.15.123:0/1559521676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b006ae30 con 0x7f69b0149bf0 2023-03-08T15:49:39.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.254+0000 7f6997fff700 1 -- 172.21.15.123:0/1559521676 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f69a4003a00 con 0x7f69b0149bf0 2023-03-08T15:49:39.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.255+0000 7f6997fff700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f699c069900 0x7f699c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.255+0000 7f69aeffd700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f699c069900 0x7f699c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.255+0000 7f6997fff700 1 -- 172.21.15.123:0/1559521676 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f69a40875d0 con 0x7f69b0149bf0 2023-03-08T15:49:39.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.255+0000 7f69aeffd700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f699c069900 0x7f699c06bdb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009c60 tx=0x7f69a0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:39.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.259+0000 7f6997fff700 1 -- 172.21.15.123:0/1559521676 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f69a4053310 con 0x7f69b0149bf0 2023-03-08T15:49:39.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.487+0000 7f69b5a54700 1 -- 172.21.15.123:0/1559521676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f69b00744c0 con 0x7f69b0149bf0 2023-03-08T15:49:39.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.492+0000 7f6997fff700 1 -- 172.21.15.123:0/1559521676 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f69a4056930 con 0x7f69b0149bf0 2023-03-08T15:49:39.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.496+0000 7f69b5a54700 1 -- 172.21.15.123:0/1559521676 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f699c069900 msgr2=0x7f699c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.496+0000 7f69b5a54700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f699c069900 0x7f699c06bdb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009c60 tx=0x7f69a0008040 comp rx=0 tx=0).stop 2023-03-08T15:49:39.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.496+0000 7f69b5a54700 1 -- 172.21.15.123:0/1559521676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69b0149bf0 msgr2=0x7f69b01e38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.496+0000 7f69b5a54700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69b0149bf0 0x7f69b01e38b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f69a400f820 tx=0x7f69a400fbe0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.498 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.496+0000 7f69b5a54700 1 -- 172.21.15.123:0/1559521676 shutdown_connections 2023-03-08T15:49:39.498 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.496+0000 7f69b5a54700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f699c069900 0x7f699c06bdb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.498 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.496+0000 7f69b5a54700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69b00b6f50 0x7f69b00b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.497+0000 7f69b5a54700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69b014a240 0x7f69b01df890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.497+0000 7f69b5a54700 1 --2- 172.21.15.123:0/1559521676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69b0149bf0 0x7f69b01e38b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.497+0000 7f69b5a54700 1 -- 172.21.15.123:0/1559521676 >> 172.21.15.123:0/1559521676 conn(0x7f69b006b360 msgr2=0x7f69b006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:39.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.497+0000 7f69b5a54700 1 -- 172.21.15.123:0/1559521676 shutdown_connections 2023-03-08T15:49:39.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.497+0000 7f69b5a54700 1 -- 172.21.15.123:0/1559521676 wait complete. 2023-03-08T15:49:39.514 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 3 and data pool 4 2023-03-08T15:49:39.521 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:49:39.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.639+0000 7f7b3a871700 1 Processor -- start 2023-03-08T15:49:39.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.639+0000 7f7b3a871700 1 -- start start 2023-03-08T15:49:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.640+0000 7f7b3a871700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b341446c0 0x7f7b340b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.640+0000 7f7b3a871700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b340b7fa0 con 0x7f7b34144a90 2023-03-08T15:49:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.640+0000 7f7b3a871700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b340b7130 con 0x7f7b340ba560 2023-03-08T15:49:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.640+0000 7f7b3a871700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340bdc90 con 0x7f7b341446c0 2023-03-08T15:49:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.640+0000 7f7b337fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7b34144a90 0x7f7b340bd580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49588/0 (socket says 172.21.15.123:49588) 2023-03-08T15:49:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.640+0000 7f7b337fe700 1 -- 172.21.15.123:0/3861314690 learned_addr learned my addr 172.21.15.123:0/3861314690 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.640+0000 7f7b33fff700 1 --2- 172.21.15.123:0/3861314690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b341446c0 0x7f7b340b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.640+0000 7f7b32ffd700 1 -- 172.21.15.123:0/3861314690 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696661867 0 0) 0x7f7b340b7fa0 con 0x7f7b34144a90 2023-03-08T15:49:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.640+0000 7f7b32ffd700 1 -- 172.21.15.123:0/3861314690 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b1c0035b0 con 0x7f7b34144a90 2023-03-08T15:49:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.640+0000 7f7b32ffd700 1 -- 172.21.15.123:0/3861314690 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161988035 0 0) 0x7f7b340b7130 con 0x7f7b340ba560 2023-03-08T15:49:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.640+0000 7f7b32ffd700 1 -- 172.21.15.123:0/3861314690 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b340b7fa0 con 0x7f7b340ba560 2023-03-08T15:49:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.640+0000 7f7b33fff700 1 -- 172.21.15.123:0/3861314690 >> v1:172.21.15.175:6789/0 conn(0x7f7b340ba560 legacy=0x7f7b34154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.640+0000 7f7b33fff700 1 -- 172.21.15.123:0/3861314690 >> v1:172.21.15.123:6789/0 conn(0x7f7b34144a90 legacy=0x7f7b340bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.640+0000 7f7b33fff700 1 -- 172.21.15.123:0/3861314690 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b340bc030 con 0x7f7b341446c0 2023-03-08T15:49:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.640+0000 7f7b33fff700 1 --2- 172.21.15.123:0/3861314690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b341446c0 0x7f7b340b6bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009870 tx=0x7f7b28009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1af49fb67870eb8e server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.641+0000 7f7b32ffd700 1 -- 172.21.15.123:0/3861314690 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b28011830 con 0x7f7b341446c0 2023-03-08T15:49:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.641+0000 7f7b32ffd700 1 -- 172.21.15.123:0/3861314690 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b28011990 con 0x7f7b341446c0 2023-03-08T15:49:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.641+0000 7f7b32ffd700 1 -- 172.21.15.123:0/3861314690 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b28011d20 con 0x7f7b341446c0 2023-03-08T15:49:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.641+0000 7f7b3a871700 1 -- 172.21.15.123:0/3861314690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b341446c0 msgr2=0x7f7b340b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.641+0000 7f7b3a871700 1 --2- 172.21.15.123:0/3861314690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b341446c0 0x7f7b340b6bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009870 tx=0x7f7b28009b80 comp rx=0 tx=0).stop 2023-03-08T15:49:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.641+0000 7f7b3a871700 1 -- 172.21.15.123:0/3861314690 shutdown_connections 2023-03-08T15:49:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.641+0000 7f7b3a871700 1 --2- 172.21.15.123:0/3861314690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b341446c0 0x7f7b340b6bf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.641+0000 7f7b3a871700 1 -- 172.21.15.123:0/3861314690 >> 172.21.15.123:0/3861314690 conn(0x7f7b34071980 msgr2=0x7f7b34071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:39.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.641+0000 7f7b3a871700 1 -- 172.21.15.123:0/3861314690 shutdown_connections 2023-03-08T15:49:39.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.641+0000 7f7b3a871700 1 -- 172.21.15.123:0/3861314690 wait complete. 2023-03-08T15:49:39.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.642+0000 7f7b3a871700 1 Processor -- start 2023-03-08T15:49:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.642+0000 7f7b3a871700 1 -- start start 2023-03-08T15:49:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b3a871700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b340ba560 0x7f7b34142340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b3a871700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b341446c0 0x7f7b340bffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b3a871700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b34144a90 0x7f7b340bf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b3a871700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340c0500 con 0x7f7b34144a90 2023-03-08T15:49:39.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b3a871700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340c0ba0 con 0x7f7b340ba560 2023-03-08T15:49:39.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b3a871700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b340c0e40 con 0x7f7b341446c0 2023-03-08T15:49:39.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b38e0e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b34144a90 0x7f7b340bf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b38e0e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b34144a90 0x7f7b340bf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53522/0 (socket says 172.21.15.123:53522) 2023-03-08T15:49:39.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b38e0e700 1 -- 172.21.15.123:0/2506218397 learned_addr learned my addr 172.21.15.123:0/2506218397 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:39.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b337fe700 1 --2- 172.21.15.123:0/2506218397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b341446c0 0x7f7b340bffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b33fff700 1 --2- 172.21.15.123:0/2506218397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b340ba560 0x7f7b34142340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b38e0e700 1 -- 172.21.15.123:0/2506218397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b341446c0 msgr2=0x7f7b340bffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b38e0e700 1 --2- 172.21.15.123:0/2506218397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b341446c0 0x7f7b340bffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b38e0e700 1 -- 172.21.15.123:0/2506218397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b340ba560 msgr2=0x7f7b34142340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b38e0e700 1 --2- 172.21.15.123:0/2506218397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b340ba560 0x7f7b34142340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b38e0e700 1 -- 172.21.15.123:0/2506218397 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b280094a0 con 0x7f7b34144a90 2023-03-08T15:49:39.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.643+0000 7f7b38e0e700 1 --2- 172.21.15.123:0/2506218397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b34144a90 0x7f7b340bf050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c00cc20 tx=0x7f7b2c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:39.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.644+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2506218397 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c00ac20 con 0x7f7b34144a90 2023-03-08T15:49:39.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.644+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2506218397 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c00ad80 con 0x7f7b34144a90 2023-03-08T15:49:39.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.644+0000 7f7b3a871700 1 -- 172.21.15.123:0/2506218397 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b340bc5f0 con 0x7f7b34144a90 2023-03-08T15:49:39.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.644+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2506218397 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c003c20 con 0x7f7b34144a90 2023-03-08T15:49:39.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.644+0000 7f7b3a871700 1 -- 172.21.15.123:0/2506218397 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b340bc310 con 0x7f7b34144a90 2023-03-08T15:49:39.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.645+0000 7f7b3a871700 1 -- 172.21.15.123:0/2506218397 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3414db40 con 0x7f7b34144a90 2023-03-08T15:49:39.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.645+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2506218397 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f7b2c010050 con 0x7f7b34144a90 2023-03-08T15:49:39.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.645+0000 7f7b30ff9700 1 --2- 172.21.15.123:0/2506218397 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7b200698d0 0x7f7b2006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.645+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2506218397 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b2c087660 con 0x7f7b34144a90 2023-03-08T15:49:39.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.645+0000 7f7b33fff700 1 --2- 172.21.15.123:0/2506218397 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7b200698d0 0x7f7b2006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.646+0000 7f7b33fff700 1 --2- 172.21.15.123:0/2506218397 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7b200698d0 0x7f7b2006bd80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b280097c0 tx=0x7f7b2801c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:39.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.650+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2506218397 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f7b2c053430 con 0x7f7b34144a90 2023-03-08T15:49:39.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.838+0000 7f7b3a871700 1 -- 172.21.15.123:0/2506218397 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b340744c0 con 0x7f7b34144a90 2023-03-08T15:49:39.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.839+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2506218397 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17968 (secure 0 0 0) 0x7f7b2c056a50 con 0x7f7b34144a90 2023-03-08T15:49:39.841 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:39.841 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:39.488711+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:49:37.104720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-08T15:49:38.431537+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:49:39.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.841+0000 7f7b3a871700 1 -- 172.21.15.123:0/2506218397 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7b200698d0 msgr2=0x7f7b2006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.841+0000 7f7b3a871700 1 --2- 172.21.15.123:0/2506218397 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7b200698d0 0x7f7b2006bd80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b280097c0 tx=0x7f7b2801c040 comp rx=0 tx=0).stop 2023-03-08T15:49:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.841+0000 7f7b3a871700 1 -- 172.21.15.123:0/2506218397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b34144a90 msgr2=0x7f7b340bf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.841+0000 7f7b3a871700 1 --2- 172.21.15.123:0/2506218397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b34144a90 0x7f7b340bf050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c00cc20 tx=0x7f7b2c00a060 comp rx=0 tx=0).stop 2023-03-08T15:49:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.841+0000 7f7b3a871700 1 -- 172.21.15.123:0/2506218397 shutdown_connections 2023-03-08T15:49:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.841+0000 7f7b3a871700 1 --2- 172.21.15.123:0/2506218397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b34144a90 0x7f7b340bf050 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.841+0000 7f7b3a871700 1 --2- 172.21.15.123:0/2506218397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b340ba560 0x7f7b34142340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.841+0000 7f7b3a871700 1 --2- 172.21.15.123:0/2506218397 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7b200698d0 0x7f7b2006bd80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.841+0000 7f7b3a871700 1 --2- 172.21.15.123:0/2506218397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b341446c0 0x7f7b340bffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.841+0000 7f7b3a871700 1 -- 172.21.15.123:0/2506218397 >> 172.21.15.123:0/2506218397 conn(0x7f7b34071980 msgr2=0x7f7b34071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:39.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.841+0000 7f7b3a871700 1 -- 172.21.15.123:0/2506218397 shutdown_connections 2023-03-08T15:49:39.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.841+0000 7f7b3a871700 1 -- 172.21.15.123:0/2506218397 wait complete. 2023-03-08T15:49:39.854 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:49:39.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.971+0000 7f5292ee7700 1 Processor -- start 2023-03-08T15:49:39.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.971+0000 7f5292ee7700 1 -- start start 2023-03-08T15:49:39.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.972+0000 7f5292ee7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f528c072010 0x7f528c144740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.972+0000 7f5292ee7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f528c144c80 0x7f528c0bad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.972+0000 7f5292ee7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528c0ba8f0 con 0x7f528c071c40 2023-03-08T15:49:39.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.972+0000 7f5292ee7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528c072460 con 0x7f528c144c80 2023-03-08T15:49:39.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.972+0000 7f5292ee7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528c06bc00 con 0x7f528c072010 2023-03-08T15:49:39.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.972+0000 7f5291484700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f528c144c80 0x7f528c0bad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.972+0000 7f5290c83700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f528c071c40 0x7f528c14dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49590/0 (socket says 172.21.15.123:49590) 2023-03-08T15:49:39.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.972+0000 7f5290c83700 1 -- 172.21.15.123:0/291600303 learned_addr learned my addr 172.21.15.123:0/291600303 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:39.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.972+0000 7f5291484700 1 -- 172.21.15.123:0/291600303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f528c072010 msgr2=0x7f528c144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:39.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.972+0000 7f528bfff700 1 --2- 172.21.15.123:0/291600303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f528c072010 0x7f528c144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.972+0000 7f5291484700 1 --2- 172.21.15.123:0/291600303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f528c072010 0x7f528c144740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.976 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.972+0000 7f5291484700 1 -- 172.21.15.123:0/291600303 >> v1:172.21.15.123:6789/0 conn(0x7f528c071c40 legacy=0x7f528c14dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.972+0000 7f528b7fe700 1 -- 172.21.15.123:0/291600303 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743068162 0 0) 0x7f528c0ba8f0 con 0x7f528c071c40 2023-03-08T15:49:39.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.972+0000 7f5291484700 1 -- 172.21.15.123:0/291600303 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c14e4b0 con 0x7f528c144c80 2023-03-08T15:49:39.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.973+0000 7f5291484700 1 --2- 172.21.15.123:0/291600303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f528c144c80 0x7f528c0bad80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5284009d90 tx=0x7f528400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b293e1c24b488e17 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:39.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.973+0000 7f528b7fe700 1 -- 172.21.15.123:0/291600303 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400e070 con 0x7f528c144c80 2023-03-08T15:49:39.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.973+0000 7f528b7fe700 1 -- 172.21.15.123:0/291600303 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528400bbd0 con 0x7f528c144c80 2023-03-08T15:49:39.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.973+0000 7f528b7fe700 1 -- 172.21.15.123:0/291600303 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284012430 con 0x7f528c144c80 2023-03-08T15:49:39.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.973+0000 7f5292ee7700 1 -- 172.21.15.123:0/291600303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f528c144c80 msgr2=0x7f528c0bad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.973+0000 7f5292ee7700 1 --2- 172.21.15.123:0/291600303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f528c144c80 0x7f528c0bad80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5284009d90 tx=0x7f528400b330 comp rx=0 tx=0).stop 2023-03-08T15:49:39.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.973+0000 7f5292ee7700 1 -- 172.21.15.123:0/291600303 shutdown_connections 2023-03-08T15:49:39.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.973+0000 7f5292ee7700 1 --2- 172.21.15.123:0/291600303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f528c144c80 0x7f528c0bad80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.973+0000 7f5292ee7700 1 --2- 172.21.15.123:0/291600303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f528c072010 0x7f528c144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.973+0000 7f5292ee7700 1 -- 172.21.15.123:0/291600303 >> 172.21.15.123:0/291600303 conn(0x7f528c06a250 msgr2=0x7f528c06a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:39.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.973+0000 7f5292ee7700 1 -- 172.21.15.123:0/291600303 shutdown_connections 2023-03-08T15:49:39.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.973+0000 7f5292ee7700 1 -- 172.21.15.123:0/291600303 wait complete. 2023-03-08T15:49:39.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.974+0000 7f5292ee7700 1 Processor -- start 2023-03-08T15:49:39.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.974+0000 7f5292ee7700 1 -- start start 2023-03-08T15:49:39.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f5292ee7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f528c071c40 0x7f528c1e3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f5292ee7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f528c072010 0x7f528c1465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f5292ee7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f528c144c80 0x7f528c1e00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f5292ee7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528c1dfc40 con 0x7f528c144c80 2023-03-08T15:49:39.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f5292ee7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528c1e36a0 con 0x7f528c072010 2023-03-08T15:49:39.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f5292ee7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528c1e3bd0 con 0x7f528c071c40 2023-03-08T15:49:39.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f5291484700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f528c144c80 0x7f528c1e00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f5291484700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f528c144c80 0x7f528c1e00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53528/0 (socket says 172.21.15.123:53528) 2023-03-08T15:49:39.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f5291484700 1 -- 172.21.15.123:0/787809490 learned_addr learned my addr 172.21.15.123:0/787809490 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:39.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f5290c83700 1 --2- 172.21.15.123:0/787809490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f528c071c40 0x7f528c1e3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f528bfff700 1 --2- 172.21.15.123:0/787809490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f528c072010 0x7f528c1465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f5291484700 1 -- 172.21.15.123:0/787809490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f528c071c40 msgr2=0x7f528c1e3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f5291484700 1 --2- 172.21.15.123:0/787809490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f528c071c40 0x7f528c1e3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f5291484700 1 -- 172.21.15.123:0/787809490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f528c072010 msgr2=0x7f528c1465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:39.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f5291484700 1 --2- 172.21.15.123:0/787809490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f528c072010 0x7f528c1465b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:39.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.975+0000 7f5291484700 1 -- 172.21.15.123:0/787809490 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5284009a70 con 0x7f528c144c80 2023-03-08T15:49:39.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.976+0000 7f5291484700 1 --2- 172.21.15.123:0/787809490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f528c144c80 0x7f528c1e00d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f528c06b0b0 tx=0x7f5284004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:39.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.976+0000 7f52897fa700 1 -- 172.21.15.123:0/787809490 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284012430 con 0x7f528c144c80 2023-03-08T15:49:39.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.976+0000 7f52897fa700 1 -- 172.21.15.123:0/787809490 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5284020070 con 0x7f528c144c80 2023-03-08T15:49:39.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.976+0000 7f5292ee7700 1 -- 172.21.15.123:0/787809490 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f528c14ea70 con 0x7f528c144c80 2023-03-08T15:49:39.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.976+0000 7f52897fa700 1 -- 172.21.15.123:0/787809490 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284003ea0 con 0x7f528c144c80 2023-03-08T15:49:39.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.976+0000 7f5292ee7700 1 -- 172.21.15.123:0/787809490 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f528c14e790 con 0x7f528c144c80 2023-03-08T15:49:39.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.977+0000 7f5292ee7700 1 -- 172.21.15.123:0/787809490 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528c0bb2c0 con 0x7f528c144c80 2023-03-08T15:49:39.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.977+0000 7f52897fa700 1 -- 172.21.15.123:0/787809490 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f528402e070 con 0x7f528c144c80 2023-03-08T15:49:39.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.978+0000 7f52897fa700 1 --2- 172.21.15.123:0/787809490 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f52780698d0 0x7f527806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:39.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.978+0000 7f5290c83700 1 --2- 172.21.15.123:0/787809490 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f52780698d0 0x7f527806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:39.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.978+0000 7f52897fa700 1 -- 172.21.15.123:0/787809490 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5284022070 con 0x7f528c144c80 2023-03-08T15:49:39.984 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.978+0000 7f5290c83700 1 --2- 172.21.15.123:0/787809490 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f52780698d0 0x7f527806bd80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f527c000f60 tx=0x7f527c007be0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:39.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:39.982+0000 7f52897fa700 1 -- 172.21.15.123:0/787809490 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f5284055300 con 0x7f528c144c80 2023-03-08T15:49:40.171 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.169+0000 7f5292ee7700 1 -- 172.21.15.123:0/787809490 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f528c1dfdf0 con 0x7f528c144c80 2023-03-08T15:49:40.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.171+0000 7f52897fa700 1 -- 172.21.15.123:0/787809490 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17968 (secure 0 0 0) 0x7f528c1dfdf0 con 0x7f528c144c80 2023-03-08T15:49:40.172 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:40.172 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:39.488711+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:49:37.104720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-08T15:49:38.431537+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:49:40.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.172+0000 7f5292ee7700 1 -- 172.21.15.123:0/787809490 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f52780698d0 msgr2=0x7f527806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:40.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.172+0000 7f5292ee7700 1 --2- 172.21.15.123:0/787809490 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f52780698d0 0x7f527806bd80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f527c000f60 tx=0x7f527c007be0 comp rx=0 tx=0).stop 2023-03-08T15:49:40.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.172+0000 7f5292ee7700 1 -- 172.21.15.123:0/787809490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f528c144c80 msgr2=0x7f528c1e00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:40.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.172+0000 7f5292ee7700 1 --2- 172.21.15.123:0/787809490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f528c144c80 0x7f528c1e00d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f528c06b0b0 tx=0x7f5284004ad0 comp rx=0 tx=0).stop 2023-03-08T15:49:40.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.173+0000 7f5292ee7700 1 -- 172.21.15.123:0/787809490 shutdown_connections 2023-03-08T15:49:40.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.173+0000 7f5292ee7700 1 --2- 172.21.15.123:0/787809490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f528c144c80 0x7f528c1e00d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:40.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.173+0000 7f5292ee7700 1 --2- 172.21.15.123:0/787809490 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f52780698d0 0x7f527806bd80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:40.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.173+0000 7f5292ee7700 1 --2- 172.21.15.123:0/787809490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f528c071c40 0x7f528c1e3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:40.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.173+0000 7f5292ee7700 1 --2- 172.21.15.123:0/787809490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f528c072010 0x7f528c1465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:40.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.173+0000 7f5292ee7700 1 -- 172.21.15.123:0/787809490 >> 172.21.15.123:0/787809490 conn(0x7f528c06a250 msgr2=0x7f528c13ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:40.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.173+0000 7f5292ee7700 1 -- 172.21.15.123:0/787809490 shutdown_connections 2023-03-08T15:49:40.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.173+0000 7f5292ee7700 1 -- 172.21.15.123:0/787809490 wait complete. 2023-03-08T15:49:40.186 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-08T15:49:40.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.306+0000 7f3c9702c700 1 Processor -- start 2023-03-08T15:49:40.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.307+0000 7f3c9702c700 1 -- start start 2023-03-08T15:49:40.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.307+0000 7f3c9702c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3c90072760 0x7f3c9006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:40.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.307+0000 7f3c9702c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c90071df0 0x7f3c9014aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:40.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.307+0000 7f3c9702c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c90070670 con 0x7f3c900ba280 2023-03-08T15:49:40.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.307+0000 7f3c9702c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c90070a40 con 0x7f3c90072760 2023-03-08T15:49:40.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.307+0000 7f3c9702c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c90070c50 con 0x7f3c90071df0 2023-03-08T15:49:40.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.307+0000 7f3c8ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3c90072760 0x7f3c9006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:40.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.307+0000 7f3c8ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3c90072760 0x7f3c9006fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53540/0 (socket says 172.21.15.123:53540) 2023-03-08T15:49:40.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.307+0000 7f3c8ffff700 1 -- 172.21.15.123:0/184214563 learned_addr learned my addr 172.21.15.123:0/184214563 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:40.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.308+0000 7f3c955c9700 1 --2- 172.21.15.123:0/184214563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c90071df0 0x7f3c9014aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:40.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.308+0000 7f3c8ffff700 1 -- 172.21.15.123:0/184214563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c90071df0 msgr2=0x7f3c9014aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:40.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.308+0000 7f3c8ffff700 1 --2- 172.21.15.123:0/184214563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c90071df0 0x7f3c9014aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:40.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.308+0000 7f3c8ffff700 1 -- 172.21.15.123:0/184214563 >> v1:172.21.15.175:6789/0 conn(0x7f3c900ba280 legacy=0x7f3c90141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:40.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.308+0000 7f3c8ffff700 1 -- 172.21.15.123:0/184214563 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c900ba650 con 0x7f3c90072760 2023-03-08T15:49:40.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.308+0000 7f3c8ffff700 1 --2- 172.21.15.123:0/184214563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c90072760 0x7f3c9006fff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0098f0 tx=0x7f3c7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566eb26d214eb9c3 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:40.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.308+0000 7f3c8f7fe700 1 -- 172.21.15.123:0/184214563 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c004230 con 0x7f3c90072760 2023-03-08T15:49:40.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.308+0000 7f3c8f7fe700 1 -- 172.21.15.123:0/184214563 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c004390 con 0x7f3c90072760 2023-03-08T15:49:40.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.308+0000 7f3c8f7fe700 1 -- 172.21.15.123:0/184214563 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c0036a0 con 0x7f3c90072760 2023-03-08T15:49:40.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.308+0000 7f3c9702c700 1 -- 172.21.15.123:0/184214563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c90072760 msgr2=0x7f3c9006fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:40.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.308+0000 7f3c9702c700 1 --2- 172.21.15.123:0/184214563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c90072760 0x7f3c9006fff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0098f0 tx=0x7f3c7c009c00 comp rx=0 tx=0).stop 2023-03-08T15:49:40.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.308+0000 7f3c9702c700 1 -- 172.21.15.123:0/184214563 shutdown_connections 2023-03-08T15:49:40.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.308+0000 7f3c9702c700 1 --2- 172.21.15.123:0/184214563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c90071df0 0x7f3c9014aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:40.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.308+0000 7f3c9702c700 1 --2- 172.21.15.123:0/184214563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c90072760 0x7f3c9006fff0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:40.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.308+0000 7f3c9702c700 1 -- 172.21.15.123:0/184214563 >> 172.21.15.123:0/184214563 conn(0x7f3c9006b360 msgr2=0x7f3c9006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:40.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.309+0000 7f3c9702c700 1 -- 172.21.15.123:0/184214563 shutdown_connections 2023-03-08T15:49:40.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.309+0000 7f3c9702c700 1 -- 172.21.15.123:0/184214563 wait complete. 2023-03-08T15:49:40.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.309+0000 7f3c9702c700 1 Processor -- start 2023-03-08T15:49:40.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.310+0000 7f3c9702c700 1 -- start start 2023-03-08T15:49:40.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.310+0000 7f3c9702c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c90071df0 0x7f3c90139820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:40.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.310+0000 7f3c9702c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c900ba280 0x7f3c90142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:40.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.310+0000 7f3c9702c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c90142f70 0x7f3c90138810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:40.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.310+0000 7f3c9702c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c90139d60 con 0x7f3c900ba280 2023-03-08T15:49:40.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.310+0000 7f3c9702c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c901437a0 con 0x7f3c90142f70 2023-03-08T15:49:40.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.310+0000 7f3c9702c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c900be4a0 con 0x7f3c90071df0 2023-03-08T15:49:40.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.310+0000 7f3c8ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c900ba280 0x7f3c90142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:40.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.310+0000 7f3c8ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c900ba280 0x7f3c90142a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53556/0 (socket says 172.21.15.123:53556) 2023-03-08T15:49:40.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.310+0000 7f3c8ffff700 1 -- 172.21.15.123:0/4164819045 learned_addr learned my addr 172.21.15.123:0/4164819045 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:40.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.310+0000 7f3c955c9700 1 --2- 172.21.15.123:0/4164819045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c90142f70 0x7f3c90138810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:40.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.310+0000 7f3c94dc8700 1 --2- 172.21.15.123:0/4164819045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c90071df0 0x7f3c90139820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:40.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.311+0000 7f3c8ffff700 1 -- 172.21.15.123:0/4164819045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c90071df0 msgr2=0x7f3c90139820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:40.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.311+0000 7f3c8ffff700 1 --2- 172.21.15.123:0/4164819045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c90071df0 0x7f3c90139820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:40.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.311+0000 7f3c8ffff700 1 -- 172.21.15.123:0/4164819045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c90142f70 msgr2=0x7f3c90138810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:40.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.311+0000 7f3c8ffff700 1 --2- 172.21.15.123:0/4164819045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c90142f70 0x7f3c90138810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:40.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.311+0000 7f3c8ffff700 1 -- 172.21.15.123:0/4164819045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c009550 con 0x7f3c900ba280 2023-03-08T15:49:40.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.311+0000 7f3c955c9700 1 --2- 172.21.15.123:0/4164819045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c90142f70 0x7f3c90138810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:40.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.311+0000 7f3c8ffff700 1 --2- 172.21.15.123:0/4164819045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c900ba280 0x7f3c90142a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c004000 tx=0x7f3c7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:40.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.311+0000 7f3c8d7fa700 1 -- 172.21.15.123:0/4164819045 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c003cc0 con 0x7f3c900ba280 2023-03-08T15:49:40.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.311+0000 7f3c8d7fa700 1 -- 172.21.15.123:0/4164819045 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c01f070 con 0x7f3c900ba280 2023-03-08T15:49:40.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.311+0000 7f3c9702c700 1 -- 172.21.15.123:0/4164819045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c90141d20 con 0x7f3c900ba280 2023-03-08T15:49:40.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.311+0000 7f3c8d7fa700 1 -- 172.21.15.123:0/4164819045 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c00b8a0 con 0x7f3c900ba280 2023-03-08T15:49:40.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.311+0000 7f3c9702c700 1 -- 172.21.15.123:0/4164819045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c90141b90 con 0x7f3c900ba280 2023-03-08T15:49:40.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.312+0000 7f3c9702c700 1 -- 172.21.15.123:0/4164819045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9014aff0 con 0x7f3c900ba280 2023-03-08T15:49:40.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.312+0000 7f3c8d7fa700 1 -- 172.21.15.123:0/4164819045 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f3c7c02a020 con 0x7f3c900ba280 2023-03-08T15:49:40.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.313+0000 7f3c8d7fa700 1 --2- 172.21.15.123:0/4164819045 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3c740698d0 0x7f3c7406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:40.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.313+0000 7f3c8d7fa700 1 -- 172.21.15.123:0/4164819045 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c7c088d60 con 0x7f3c900ba280 2023-03-08T15:49:40.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.313+0000 7f3c94dc8700 1 --2- 172.21.15.123:0/4164819045 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3c740698d0 0x7f3c7406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:40.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.313+0000 7f3c94dc8700 1 --2- 172.21.15.123:0/4164819045 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3c740698d0 0x7f3c7406bd80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009870 tx=0x7f3c84008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:40.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.317+0000 7f3c8d7fa700 1 -- 172.21.15.123:0/4164819045 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f3c7c054b30 con 0x7f3c900ba280 2023-03-08T15:49:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:40.548+0000 7f3c9702c700 1 -- 172.21.15.123:0/4164819045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3c9014aff0 con 0x7f3c900ba280 2023-03-08T15:49:41.503 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.501+0000 7f3c8d7fa700 1 -- 172.21.15.123:0/4164819045 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3c7c058150 con 0x7f3c900ba280 2023-03-08T15:49:41.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.504+0000 7f3c9702c700 1 -- 172.21.15.123:0/4164819045 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3c740698d0 msgr2=0x7f3c7406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:41.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.504+0000 7f3c9702c700 1 --2- 172.21.15.123:0/4164819045 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3c740698d0 0x7f3c7406bd80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009870 tx=0x7f3c84008040 comp rx=0 tx=0).stop 2023-03-08T15:49:41.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.504+0000 7f3c9702c700 1 -- 172.21.15.123:0/4164819045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c900ba280 msgr2=0x7f3c90142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:41.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.504+0000 7f3c9702c700 1 --2- 172.21.15.123:0/4164819045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c900ba280 0x7f3c90142a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c004000 tx=0x7f3c7c004750 comp rx=0 tx=0).stop 2023-03-08T15:49:41.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.504+0000 7f3c9702c700 1 -- 172.21.15.123:0/4164819045 shutdown_connections 2023-03-08T15:49:41.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.504+0000 7f3c9702c700 1 --2- 172.21.15.123:0/4164819045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c90142f70 0x7f3c90138810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:41.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.504+0000 7f3c9702c700 1 --2- 172.21.15.123:0/4164819045 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3c740698d0 0x7f3c7406bd80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:41.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.504+0000 7f3c9702c700 1 --2- 172.21.15.123:0/4164819045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c90071df0 0x7f3c90139820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:41.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.504+0000 7f3c9702c700 1 --2- 172.21.15.123:0/4164819045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c900ba280 0x7f3c90142a30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:41.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.504+0000 7f3c9702c700 1 -- 172.21.15.123:0/4164819045 >> 172.21.15.123:0/4164819045 conn(0x7f3c9006b360 msgr2=0x7f3c9013a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:41.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.504+0000 7f3c9702c700 1 -- 172.21.15.123:0/4164819045 shutdown_connections 2023-03-08T15:49:41.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.504+0000 7f3c9702c700 1 -- 172.21.15.123:0/4164819045 wait complete. 2023-03-08T15:49:41.519 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-03-08T15:49:41.520 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-03-08T15:49:41.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.644+0000 7ff709aa7700 1 Processor -- start 2023-03-08T15:49:41.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.644+0000 7ff709aa7700 1 -- start start 2023-03-08T15:49:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.645+0000 7ff709aa7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff704142680 0x7ff70414b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.645+0000 7ff709aa7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7040ba690 con 0x7ff7040b92f0 2023-03-08T15:49:41.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.645+0000 7ff709aa7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff704072330 con 0x7ff7040b7f80 2023-03-08T15:49:41.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.645+0000 7ff709aa7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040b9750 con 0x7ff704142680 2023-03-08T15:49:41.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.645+0000 7ff703fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff7040b92f0 0x7ff704152d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49598/0 (socket says 172.21.15.123:49598) 2023-03-08T15:49:41.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.645+0000 7ff703fff700 1 -- 172.21.15.123:0/2626215706 learned_addr learned my addr 172.21.15.123:0/2626215706 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:41.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.645+0000 7ff7037fe700 1 --2- 172.21.15.123:0/2626215706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff704142680 0x7ff70414b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:41.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.645+0000 7ff7027fc700 1 -- 172.21.15.123:0/2626215706 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012570343 0 0) 0x7ff7040ba690 con 0x7ff7040b92f0 2023-03-08T15:49:41.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.645+0000 7ff7027fc700 1 -- 172.21.15.123:0/2626215706 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6ec0035b0 con 0x7ff7040b92f0 2023-03-08T15:49:41.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 -- 172.21.15.123:0/2626215706 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2348714460 0 0) 0x7ff6ec0035b0 con 0x7ff7040b92f0 2023-03-08T15:49:41.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 -- 172.21.15.123:0/2626215706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff704142680 msgr2=0x7ff70414b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:41.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 --2- 172.21.15.123:0/2626215706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff704142680 0x7ff70414b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:41.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 -- 172.21.15.123:0/2626215706 >> v1:172.21.15.175:6789/0 conn(0x7ff7040b7f80 legacy=0x7ff704071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:41.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 -- 172.21.15.123:0/2626215706 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7040ba8e0 con 0x7ff7040b92f0 2023-03-08T15:49:41.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 -- 172.21.15.123:0/2626215706 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7ff6fc0019f0 con 0x7ff7040b92f0 2023-03-08T15:49:41.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 -- 172.21.15.123:0/2626215706 >> v1:172.21.15.123:6789/0 conn(0x7ff7040b92f0 legacy=0x7ff704152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:41.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 --2- 172.21.15.123:0/2626215706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff704142680 0x7ff6ec003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:41.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 --2- 172.21.15.123:0/2626215706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ec003f70 0x7ff6ec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:41.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 --2- 172.21.15.123:0/2626215706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6ec004d90 0x7ff6ec005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:41.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 -- 172.21.15.123:0/2626215706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec00bac0 con 0x7ff6ec003f70 2023-03-08T15:49:41.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 -- 172.21.15.123:0/2626215706 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec00bc30 con 0x7ff6ec004d90 2023-03-08T15:49:41.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 -- 172.21.15.123:0/2626215706 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec00bdf0 con 0x7ff704142680 2023-03-08T15:49:41.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff702ffd700 1 --2- 172.21.15.123:0/2626215706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ec003f70 0x7ff6ec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:41.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff703fff700 1 --2- 172.21.15.123:0/2626215706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6ec004d90 0x7ff6ec005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:41.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7037fe700 1 --2- 172.21.15.123:0/2626215706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff704142680 0x7ff6ec003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:41.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff702ffd700 1 -- 172.21.15.123:0/2626215706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff704142680 msgr2=0x7ff6ec003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:41.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff702ffd700 1 --2- 172.21.15.123:0/2626215706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff704142680 0x7ff6ec003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:41.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff702ffd700 1 -- 172.21.15.123:0/2626215706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6ec004d90 msgr2=0x7ff6ec005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:41.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff702ffd700 1 --2- 172.21.15.123:0/2626215706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6ec004d90 0x7ff6ec005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:41.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff702ffd700 1 -- 172.21.15.123:0/2626215706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec0035b0 con 0x7ff6ec003f70 2023-03-08T15:49:41.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7037fe700 1 --2- 172.21.15.123:0/2626215706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff704142680 0x7ff6ec003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:41.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff703fff700 1 --2- 172.21.15.123:0/2626215706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6ec004d90 0x7ff6ec005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:41.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff702ffd700 1 --2- 172.21.15.123:0/2626215706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ec003f70 0x7ff6ec004850 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4007fd0 tx=0x7ff6ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43c90d2d7a1402f server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:41.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 -- 172.21.15.123:0/2626215706 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f400c660 con 0x7ff6ec003f70 2023-03-08T15:49:41.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 -- 172.21.15.123:0/2626215706 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f400c7c0 con 0x7ff6ec003f70 2023-03-08T15:49:41.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.646+0000 7ff7027fc700 1 -- 172.21.15.123:0/2626215706 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f400cb70 con 0x7ff6ec003f70 2023-03-08T15:49:41.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.647+0000 7ff709aa7700 1 -- 172.21.15.123:0/2626215706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ec003f70 msgr2=0x7ff6ec004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:41.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.647+0000 7ff709aa7700 1 --2- 172.21.15.123:0/2626215706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6ec003f70 0x7ff6ec004850 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4007fd0 tx=0x7ff6ec005880 comp rx=0 tx=0).stop 2023-03-08T15:49:41.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.647+0000 7ff703fff700 1 -- 172.21.15.123:0/2626215706 reap_dead start 2023-03-08T15:49:41.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.647+0000 7ff709aa7700 1 -- 172.21.15.123:0/2626215706 shutdown_connections 2023-03-08T15:49:41.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.647+0000 7ff709aa7700 1 -- 172.21.15.123:0/2626215706 >> 172.21.15.123:0/2626215706 conn(0x7ff70406b360 msgr2=0x7ff70406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:41.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.647+0000 7ff709aa7700 1 -- 172.21.15.123:0/2626215706 shutdown_connections 2023-03-08T15:49:41.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.647+0000 7ff709aa7700 1 -- 172.21.15.123:0/2626215706 wait complete. 2023-03-08T15:49:41.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.648+0000 7ff709aa7700 1 Processor -- start 2023-03-08T15:49:41.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.648+0000 7ff709aa7700 1 -- start start 2023-03-08T15:49:41.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff709aa7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6ec003f70 0x7ff704149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:41.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff709aa7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff704146bb0 0x7ff7041483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:41.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff709aa7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7041e1220 0x7ff704140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:41.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff709aa7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff704147020 con 0x7ff7041e1220 2023-03-08T15:49:41.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff709aa7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff704140660 con 0x7ff704146bb0 2023-03-08T15:49:41.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff709aa7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff704146440 con 0x7ff6ec003f70 2023-03-08T15:49:41.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff703fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7041e1220 0x7ff704140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:41.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff703fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7041e1220 0x7ff704140120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53578/0 (socket says 172.21.15.123:53578) 2023-03-08T15:49:41.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff703fff700 1 -- 172.21.15.123:0/755284658 learned_addr learned my addr 172.21.15.123:0/755284658 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:41.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff7037fe700 1 --2- 172.21.15.123:0/755284658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6ec003f70 0x7ff704149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:41.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff702ffd700 1 --2- 172.21.15.123:0/755284658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff704146bb0 0x7ff7041483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:41.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff703fff700 1 -- 172.21.15.123:0/755284658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6ec003f70 msgr2=0x7ff704149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:41.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff703fff700 1 --2- 172.21.15.123:0/755284658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6ec003f70 0x7ff704149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:41.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff703fff700 1 -- 172.21.15.123:0/755284658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff704146bb0 msgr2=0x7ff7041483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:41.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff703fff700 1 --2- 172.21.15.123:0/755284658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff704146bb0 0x7ff7041483e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:41.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff703fff700 1 -- 172.21.15.123:0/755284658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff704142a50 con 0x7ff7041e1220 2023-03-08T15:49:41.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff703fff700 1 --2- 172.21.15.123:0/755284658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7041e1220 0x7ff704140120 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff70406b2f0 tx=0x7ff6fc00e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:41.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff6ebfff700 1 -- 172.21.15.123:0/755284658 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc017070 con 0x7ff7041e1220 2023-03-08T15:49:41.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff6ebfff700 1 -- 172.21.15.123:0/755284658 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc00ede0 con 0x7ff7041e1220 2023-03-08T15:49:41.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff709aa7700 1 -- 172.21.15.123:0/755284658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7040b8dd0 con 0x7ff7041e1220 2023-03-08T15:49:41.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff6ebfff700 1 -- 172.21.15.123:0/755284658 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc013420 con 0x7ff7041e1220 2023-03-08T15:49:41.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.649+0000 7ff709aa7700 1 -- 172.21.15.123:0/755284658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7040bad10 con 0x7ff7041e1220 2023-03-08T15:49:41.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.650+0000 7ff709aa7700 1 -- 172.21.15.123:0/755284658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff704147b40 con 0x7ff7041e1220 2023-03-08T15:49:41.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.651+0000 7ff6ebfff700 1 -- 172.21.15.123:0/755284658 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7ff6fc013580 con 0x7ff7041e1220 2023-03-08T15:49:41.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.651+0000 7ff6ebfff700 1 --2- 172.21.15.123:0/755284658 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff6f00698d0 0x7ff6f006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:41.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.651+0000 7ff6ebfff700 1 -- 172.21.15.123:0/755284658 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6fc087500 con 0x7ff7041e1220 2023-03-08T15:49:41.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.651+0000 7ff7037fe700 1 --2- 172.21.15.123:0/755284658 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff6f00698d0 0x7ff6f006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:41.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.651+0000 7ff7037fe700 1 --2- 172.21.15.123:0/755284658 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff6f00698d0 0x7ff6f006bd80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009b30 tx=0x7ff6f8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:41.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.655+0000 7ff6ebfff700 1 -- 172.21.15.123:0/755284658 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7ff704147b40 con 0x7ff7041e1220 2023-03-08T15:49:41.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:41.885+0000 7ff709aa7700 1 -- 172.21.15.123:0/755284658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff704147b40 con 0x7ff7041e1220 2023-03-08T15:49:42.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.506+0000 7ff6ebfff700 1 -- 172.21.15.123:0/755284658 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff704147b40 con 0x7ff7041e1220 2023-03-08T15:49:42.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.508+0000 7ff709aa7700 1 -- 172.21.15.123:0/755284658 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff6f00698d0 msgr2=0x7ff6f006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:42.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.508+0000 7ff709aa7700 1 --2- 172.21.15.123:0/755284658 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff6f00698d0 0x7ff6f006bd80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009b30 tx=0x7ff6f8008040 comp rx=0 tx=0).stop 2023-03-08T15:49:42.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.508+0000 7ff709aa7700 1 -- 172.21.15.123:0/755284658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7041e1220 msgr2=0x7ff704140120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:42.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.508+0000 7ff709aa7700 1 --2- 172.21.15.123:0/755284658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7041e1220 0x7ff704140120 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff70406b2f0 tx=0x7ff6fc00e4f0 comp rx=0 tx=0).stop 2023-03-08T15:49:42.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.508+0000 7ff709aa7700 1 -- 172.21.15.123:0/755284658 shutdown_connections 2023-03-08T15:49:42.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.508+0000 7ff709aa7700 1 --2- 172.21.15.123:0/755284658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7041e1220 0x7ff704140120 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:42.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.508+0000 7ff709aa7700 1 --2- 172.21.15.123:0/755284658 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff6f00698d0 0x7ff6f006bd80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:42.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.508+0000 7ff709aa7700 1 --2- 172.21.15.123:0/755284658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6ec003f70 0x7ff704149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:42.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.508+0000 7ff709aa7700 1 --2- 172.21.15.123:0/755284658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff704146bb0 0x7ff7041483e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:42.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.508+0000 7ff709aa7700 1 -- 172.21.15.123:0/755284658 >> 172.21.15.123:0/755284658 conn(0x7ff70406b360 msgr2=0x7ff7040b5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:42.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.509+0000 7ff709aa7700 1 -- 172.21.15.123:0/755284658 shutdown_connections 2023-03-08T15:49:42.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.509+0000 7ff709aa7700 1 -- 172.21.15.123:0/755284658 wait complete. 2023-03-08T15:49:42.524 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-03-08T15:49:42.524 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-08T15:49:42.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.647+0000 7fe7b18b9700 1 Processor -- start 2023-03-08T15:49:42.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.647+0000 7fe7b18b9700 1 -- start start 2023-03-08T15:49:42.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7b18b9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe7ac06b530 0x7fe7ac0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:42.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7b18b9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7ac140980 0x7fe7ac140de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:42.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7b18b9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7ac071280 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7b18b9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ac071630 con 0x7fe7ac06b530 2023-03-08T15:49:42.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7b18b9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac14a720 con 0x7fe7ac140980 2023-03-08T15:49:42.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7aa7fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe7ac06f8d0 0x7fe7ac14a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49608/0 (socket says 172.21.15.123:49608) 2023-03-08T15:49:42.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7aa7fc700 1 -- 172.21.15.123:0/3240098555 learned_addr learned my addr 172.21.15.123:0/3240098555 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:42.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7ab7fe700 1 --2- 172.21.15.123:0/3240098555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7ac140980 0x7fe7ac140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:42.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7aaffd700 1 --2- 172.21.15.123:0/3240098555 >> v2:172.21.15.175:3300/0 conn(0x7fe7ac06b530 0x7fe7ac0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:42.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7a9ffb700 1 -- 172.21.15.123:0/3240098555 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463761002 0 0) 0x7fe7ac071280 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7a9ffb700 1 -- 172.21.15.123:0/3240098555 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7940035b0 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7a9ffb700 1 -- 172.21.15.123:0/3240098555 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3070039718 0 0) 0x7fe7940035b0 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7aaffd700 1 -- 172.21.15.123:0/3240098555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7ac140980 msgr2=0x7fe7ac140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:42.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7aaffd700 1 --2- 172.21.15.123:0/3240098555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7ac140980 0x7fe7ac140de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:42.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7aaffd700 1 -- 172.21.15.123:0/3240098555 >> v1:172.21.15.123:6789/0 conn(0x7fe7ac06f8d0 legacy=0x7fe7ac14a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:42.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.648+0000 7fe7aaffd700 1 -- 172.21.15.123:0/3240098555 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac072020 con 0x7fe7ac06b530 2023-03-08T15:49:42.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.649+0000 7fe7aaffd700 1 --2- 172.21.15.123:0/3240098555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7ac06b530 0x7fe7ac0b3ab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009840 tx=0x7fe7a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=341a10cbe621f7b6 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:42.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.649+0000 7fe7a9ffb700 1 -- 172.21.15.123:0/3240098555 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c001670 con 0x7fe7ac06b530 2023-03-08T15:49:42.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.649+0000 7fe7a9ffb700 1 -- 172.21.15.123:0/3240098555 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a0004030 con 0x7fe7ac06b530 2023-03-08T15:49:42.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.649+0000 7fe7a9ffb700 1 -- 172.21.15.123:0/3240098555 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a00043c0 con 0x7fe7ac06b530 2023-03-08T15:49:42.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.649+0000 7fe7b18b9700 1 -- 172.21.15.123:0/3240098555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7ac06b530 msgr2=0x7fe7ac0b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:42.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.649+0000 7fe7b18b9700 1 --2- 172.21.15.123:0/3240098555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7ac06b530 0x7fe7ac0b3ab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009840 tx=0x7fe7a0009b50 comp rx=0 tx=0).stop 2023-03-08T15:49:42.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.649+0000 7fe7b18b9700 1 -- 172.21.15.123:0/3240098555 shutdown_connections 2023-03-08T15:49:42.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.649+0000 7fe7b18b9700 1 --2- 172.21.15.123:0/3240098555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7ac140980 0x7fe7ac140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:42.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.649+0000 7fe7b18b9700 1 --2- 172.21.15.123:0/3240098555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7ac06b530 0x7fe7ac0b3ab0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:42.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.649+0000 7fe7b18b9700 1 -- 172.21.15.123:0/3240098555 >> 172.21.15.123:0/3240098555 conn(0x7fe7ac0ba3c0 msgr2=0x7fe7ac0bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:42.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.649+0000 7fe7b18b9700 1 -- 172.21.15.123:0/3240098555 shutdown_connections 2023-03-08T15:49:42.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.649+0000 7fe7b18b9700 1 -- 172.21.15.123:0/3240098555 wait complete. 2023-03-08T15:49:42.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.650+0000 7fe7b18b9700 1 Processor -- start 2023-03-08T15:49:42.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7b18b9700 1 -- start start 2023-03-08T15:49:42.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7b18b9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7ac06b530 0x7fe7ac13b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:42.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7b18b9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ac06f8d0 0x7fe7ac13d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:42.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7b18b9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7ac140980 0x7fe7ac0b9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:42.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7b18b9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0b9540 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7b18b9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac13caa0 con 0x7fe7ac140980 2023-03-08T15:49:42.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7b18b9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0b8bd0 con 0x7fe7ac06b530 2023-03-08T15:49:42.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7aa7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ac06f8d0 0x7fe7ac13d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:42.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7aa7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ac06f8d0 0x7fe7ac13d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53590/0 (socket says 172.21.15.123:53590) 2023-03-08T15:49:42.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7aa7fc700 1 -- 172.21.15.123:0/2181761961 learned_addr learned my addr 172.21.15.123:0/2181761961 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:42.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7aaffd700 1 --2- 172.21.15.123:0/2181761961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7ac06b530 0x7fe7ac13b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:42.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7ab7fe700 1 --2- 172.21.15.123:0/2181761961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7ac140980 0x7fe7ac0b9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:42.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7aa7fc700 1 -- 172.21.15.123:0/2181761961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7ac06b530 msgr2=0x7fe7ac13b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:42.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7aa7fc700 1 --2- 172.21.15.123:0/2181761961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7ac06b530 0x7fe7ac13b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:42.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7aa7fc700 1 -- 172.21.15.123:0/2181761961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7ac140980 msgr2=0x7fe7ac0b9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:42.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7aa7fc700 1 --2- 172.21.15.123:0/2181761961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7ac140980 0x7fe7ac0b9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:42.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.651+0000 7fe7aa7fc700 1 -- 172.21.15.123:0/2181761961 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a00094a0 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.652+0000 7fe7aa7fc700 1 --2- 172.21.15.123:0/2181761961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ac06f8d0 0x7fe7ac13d730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00c7e0 tx=0x7fe79c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:42.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.652+0000 7fe793fff700 1 -- 172.21.15.123:0/2181761961 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c004c80 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.652+0000 7fe793fff700 1 -- 172.21.15.123:0/2181761961 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c004de0 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.652+0000 7fe7b18b9700 1 -- 172.21.15.123:0/2181761961 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ac071820 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.652+0000 7fe793fff700 1 -- 172.21.15.123:0/2181761961 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0072f0 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.652+0000 7fe7b18b9700 1 -- 172.21.15.123:0/2181761961 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ac06fe60 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.653+0000 7fe7b18b9700 1 -- 172.21.15.123:0/2181761961 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ac071b00 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.653+0000 7fe793fff700 1 -- 172.21.15.123:0/2181761961 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fe79c010070 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.653+0000 7fe793fff700 1 --2- 172.21.15.123:0/2181761961 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe798069900 0x7fe79806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:42.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.653+0000 7fe793fff700 1 -- 172.21.15.123:0/2181761961 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe79c086880 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.653+0000 7fe7aaffd700 1 --2- 172.21.15.123:0/2181761961 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe798069900 0x7fe79806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:42.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.654+0000 7fe7aaffd700 1 --2- 172.21.15.123:0/2181761961 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe798069900 0x7fe79806bdb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0000c00 tx=0x7fe7a0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:42.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.658+0000 7fe793fff700 1 -- 172.21.15.123:0/2181761961 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fe79c052540 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.886+0000 7fe7b18b9700 1 -- 172.21.15.123:0/2181761961 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7ac0744c0 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.887+0000 7fe793fff700 1 -- 172.21.15.123:0/2181761961 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3915 (secure 0 0 0) 0x7fe79c018030 con 0x7fe7ac06f8d0 2023-03-08T15:49:42.888 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:42.889 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/108043707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":108043707},{"type":"v1","addr":"172.21.15.123:6835","nonce":108043707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1787308526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1787308526},{"type":"v1","addr":"172.21.15.123:6837","nonce":1787308526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-08T15:49:39.489034+0000","modified":"2023-03-08T15:49:42.501407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6833/1018957090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1018957090},{"type":"v1","addr":"172.21.15.175:6833","nonce":1018957090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-08T15:49:42.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.889+0000 7fe7b18b9700 1 -- 172.21.15.123:0/2181761961 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe798069900 msgr2=0x7fe79806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:42.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.889+0000 7fe7b18b9700 1 --2- 172.21.15.123:0/2181761961 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe798069900 0x7fe79806bdb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0000c00 tx=0x7fe7a0008030 comp rx=0 tx=0).stop 2023-03-08T15:49:42.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.889+0000 7fe7b18b9700 1 -- 172.21.15.123:0/2181761961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ac06f8d0 msgr2=0x7fe7ac13d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:42.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.889+0000 7fe7b18b9700 1 --2- 172.21.15.123:0/2181761961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ac06f8d0 0x7fe7ac13d730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00c7e0 tx=0x7fe79c00cba0 comp rx=0 tx=0).stop 2023-03-08T15:49:42.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.889+0000 7fe7b18b9700 1 -- 172.21.15.123:0/2181761961 shutdown_connections 2023-03-08T15:49:42.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.889+0000 7fe7b18b9700 1 --2- 172.21.15.123:0/2181761961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7ac140980 0x7fe7ac0b9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:42.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.889+0000 7fe7b18b9700 1 --2- 172.21.15.123:0/2181761961 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe798069900 0x7fe79806bdb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:42.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.889+0000 7fe7b18b9700 1 --2- 172.21.15.123:0/2181761961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7ac06b530 0x7fe7ac13b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:42.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.889+0000 7fe7b18b9700 1 --2- 172.21.15.123:0/2181761961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ac06f8d0 0x7fe7ac13d730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:42.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.889+0000 7fe7b18b9700 1 -- 172.21.15.123:0/2181761961 >> 172.21.15.123:0/2181761961 conn(0x7fe7ac0ba3c0 msgr2=0x7fe7ac0bccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:42.891 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.889+0000 7fe7b18b9700 1 -- 172.21.15.123:0/2181761961 shutdown_connections 2023-03-08T15:49:42.892 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:42.889+0000 7fe7b18b9700 1 -- 172.21.15.123:0/2181761961 wait complete. 2023-03-08T15:49:42.892 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2023-03-08T15:49:42.902 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:49:43.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.021+0000 7f9a71f1d700 1 Processor -- start 2023-03-08T15:49:43.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.021+0000 7f9a71f1d700 1 -- start start 2023-03-08T15:49:43.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.021+0000 7f9a71f1d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9a6c147e50 0x7f9a6c06a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a71f1d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6c14a810 con 0x7f9a6c06fef0 2023-03-08T15:49:43.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a71f1d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6c071a40 con 0x7f9a6c14b420 2023-03-08T15:49:43.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a71f1d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6c071d20 con 0x7f9a6c147e50 2023-03-08T15:49:43.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6affd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9a6c06fef0 0x7f9a6c14ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49614/0 (socket says 172.21.15.123:49614) 2023-03-08T15:49:43.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6affd700 1 -- 172.21.15.123:0/1897011188 learned_addr learned my addr 172.21.15.123:0/1897011188 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:43.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6b7fe700 1 --2- 172.21.15.123:0/1897011188 >> v2:172.21.15.175:3300/0 conn(0x7f9a6c147e50 0x7f9a6c06a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782477653 0 0) 0x7f9a6c14a810 con 0x7f9a6c06fef0 2023-03-08T15:49:43.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a540035b0 con 0x7f9a6c06fef0 2023-03-08T15:49:43.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817618268 0 0) 0x7f9a6c071a40 con 0x7f9a6c14b420 2023-03-08T15:49:43.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a6c14a810 con 0x7f9a6c14b420 2023-03-08T15:49:43.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2767098776 0 0) 0x7f9a540035b0 con 0x7f9a6c06fef0 2023-03-08T15:49:43.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 >> v2:172.21.15.175:3300/0 conn(0x7f9a6c147e50 msgr2=0x7f9a6c06a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:43.027 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 --2- 172.21.15.123:0/1897011188 >> v2:172.21.15.175:3300/0 conn(0x7f9a6c147e50 0x7f9a6c06a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 >> v1:172.21.15.175:6789/0 conn(0x7f9a6c14b420 legacy=0x7f9a6c155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c072000 con 0x7f9a6c06fef0 2023-03-08T15:49:43.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f9a60001670 con 0x7f9a6c06fef0 2023-03-08T15:49:43.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6b7fe700 1 --2- 172.21.15.123:0/1897011188 >> v2:172.21.15.175:3300/0 conn(0x7f9a6c147e50 0x7f9a6c06a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:43.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 >> v1:172.21.15.123:6789/0 conn(0x7f9a6c06fef0 legacy=0x7f9a6c14ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 --2- 172.21.15.123:0/1897011188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a54003b90 0x7f9a54003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.028 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 --2- 172.21.15.123:0/1897011188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a54004850 0x7f9a54004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 --2- 172.21.15.123:0/1897011188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a54005200 0x7f9a5400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c071d20 con 0x7f9a54005200 2023-03-08T15:49:43.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5400c060 con 0x7f9a54003b90 2023-03-08T15:49:43.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5400c220 con 0x7f9a54004850 2023-03-08T15:49:43.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6bfff700 1 --2- 172.21.15.123:0/1897011188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a54005200 0x7f9a5400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6b7fe700 1 --2- 172.21.15.123:0/1897011188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a54003b90 0x7f9a54003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.022+0000 7f9a6affd700 1 --2- 172.21.15.123:0/1897011188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a54004850 0x7f9a54004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.029 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.023+0000 7f9a6bfff700 1 -- 172.21.15.123:0/1897011188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a54004850 msgr2=0x7f9a54004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:43.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.023+0000 7f9a6bfff700 1 --2- 172.21.15.123:0/1897011188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a54004850 0x7f9a54004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.023+0000 7f9a6bfff700 1 -- 172.21.15.123:0/1897011188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a54003b90 msgr2=0x7f9a54003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:43.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.023+0000 7f9a6bfff700 1 --2- 172.21.15.123:0/1897011188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a54003b90 0x7f9a54003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.023+0000 7f9a6bfff700 1 -- 172.21.15.123:0/1897011188 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a540035b0 con 0x7f9a54005200 2023-03-08T15:49:43.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.023+0000 7f9a6bfff700 1 -- 172.21.15.123:0/1897011188 reap_dead start 2023-03-08T15:49:43.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.023+0000 7f9a6bfff700 1 --2- 172.21.15.123:0/1897011188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a54005200 0x7f9a5400ba10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c06b0e0 tx=0x7f9a54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5bf06fbe9e35b6 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:43.030 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.023+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a64001f30 con 0x7f9a54005200 2023-03-08T15:49:43.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.023+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6400ce30 con 0x7f9a54005200 2023-03-08T15:49:43.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.023+0000 7f9a6a7fc700 1 -- 172.21.15.123:0/1897011188 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a64003c20 con 0x7f9a54005200 2023-03-08T15:49:43.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.023+0000 7f9a71f1d700 1 -- 172.21.15.123:0/1897011188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a54005200 msgr2=0x7f9a5400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.023+0000 7f9a71f1d700 1 --2- 172.21.15.123:0/1897011188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a54005200 0x7f9a5400ba10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c06b0e0 tx=0x7f9a54005880 comp rx=0 tx=0).stop 2023-03-08T15:49:43.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.023+0000 7f9a71f1d700 1 -- 172.21.15.123:0/1897011188 shutdown_connections 2023-03-08T15:49:43.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.023+0000 7f9a71f1d700 1 --2- 172.21.15.123:0/1897011188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a54005200 0x7f9a5400ba10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.023+0000 7f9a71f1d700 1 -- 172.21.15.123:0/1897011188 >> 172.21.15.123:0/1897011188 conn(0x7f9a6c06b360 msgr2=0x7f9a6c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:43.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.024+0000 7f9a71f1d700 1 -- 172.21.15.123:0/1897011188 shutdown_connections 2023-03-08T15:49:43.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.024+0000 7f9a71f1d700 1 -- 172.21.15.123:0/1897011188 wait complete. 2023-03-08T15:49:43.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.025+0000 7f9a71f1d700 1 Processor -- start 2023-03-08T15:49:43.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.025+0000 7f9a71f1d700 1 -- start start 2023-03-08T15:49:43.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a71f1d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a54005200 0x7f9a6c1d50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a71f1d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a6c1e2e00 0x7f9a6c0bb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a71f1d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c0bcb00 0x7f9a6c13e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a71f1d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c1d55e0 con 0x7f9a6c1e2e00 2023-03-08T15:49:43.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a71f1d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0bb570 con 0x7f9a54005200 2023-03-08T15:49:43.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a71f1d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c1d3ef0 con 0x7f9a6c0bcb00 2023-03-08T15:49:43.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a6affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a6c1e2e00 0x7f9a6c0bb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a6affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a6c1e2e00 0x7f9a6c0bb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53608/0 (socket says 172.21.15.123:53608) 2023-03-08T15:49:43.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a6affd700 1 -- 172.21.15.123:0/1346655848 learned_addr learned my addr 172.21.15.123:0/1346655848 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:43.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a6b7fe700 1 --2- 172.21.15.123:0/1346655848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a54005200 0x7f9a6c1d50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a6bfff700 1 --2- 172.21.15.123:0/1346655848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c0bcb00 0x7f9a6c13e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a6affd700 1 -- 172.21.15.123:0/1346655848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c0bcb00 msgr2=0x7f9a6c13e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a6affd700 1 --2- 172.21.15.123:0/1346655848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c0bcb00 0x7f9a6c13e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a6affd700 1 -- 172.21.15.123:0/1346655848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a54005200 msgr2=0x7f9a6c1d50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a6affd700 1 --2- 172.21.15.123:0/1346655848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a54005200 0x7f9a6c1d50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a6affd700 1 -- 172.21.15.123:0/1346655848 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c0728f0 con 0x7f9a6c1e2e00 2023-03-08T15:49:43.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a6b7fe700 1 --2- 172.21.15.123:0/1346655848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a54005200 0x7f9a6c1d50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:43.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.026+0000 7f9a6affd700 1 --2- 172.21.15.123:0/1346655848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a6c1e2e00 0x7f9a6c0bb9b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9a60007340 tx=0x7f9a60007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:43.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.027+0000 7f9a53fff700 1 -- 172.21.15.123:0/1346655848 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60001af0 con 0x7f9a6c1e2e00 2023-03-08T15:49:43.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.027+0000 7f9a53fff700 1 -- 172.21.15.123:0/1346655848 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6000f660 con 0x7f9a6c1e2e00 2023-03-08T15:49:43.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.027+0000 7f9a71f1d700 1 -- 172.21.15.123:0/1346655848 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6c148220 con 0x7f9a6c1e2e00 2023-03-08T15:49:43.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.027+0000 7f9a53fff700 1 -- 172.21.15.123:0/1346655848 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6000f9f0 con 0x7f9a6c1e2e00 2023-03-08T15:49:43.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.027+0000 7f9a71f1d700 1 -- 172.21.15.123:0/1346655848 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6c0b45f0 con 0x7f9a6c1e2e00 2023-03-08T15:49:43.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.027+0000 7f9a71f1d700 1 -- 172.21.15.123:0/1346655848 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6c0744c0 con 0x7f9a6c1e2e00 2023-03-08T15:49:43.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.028+0000 7f9a53fff700 1 -- 172.21.15.123:0/1346655848 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f9a6000fb50 con 0x7f9a6c1e2e00 2023-03-08T15:49:43.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.028+0000 7f9a53fff700 1 --2- 172.21.15.123:0/1346655848 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f9a58069900 0x7f9a5806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.029+0000 7f9a53fff700 1 -- 172.21.15.123:0/1346655848 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a60087720 con 0x7f9a6c1e2e00 2023-03-08T15:49:43.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.029+0000 7f9a6b7fe700 1 --2- 172.21.15.123:0/1346655848 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f9a58069900 0x7f9a5806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.029+0000 7f9a6b7fe700 1 --2- 172.21.15.123:0/1346655848 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f9a58069900 0x7f9a5806bdb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009d70 tx=0x7f9a5c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:43.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.033+0000 7f9a53fff700 1 -- 172.21.15.123:0/1346655848 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f9a600534f0 con 0x7f9a6c1e2e00 2023-03-08T15:49:43.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.223+0000 7f9a71f1d700 1 -- 172.21.15.123:0/1346655848 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a6c0b3b30 con 0x7f9a6c1e2e00 2023-03-08T15:49:43.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.224+0000 7f9a53fff700 1 -- 172.21.15.123:0/1346655848 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f9a60056b10 con 0x7f9a6c1e2e00 2023-03-08T15:49:43.226 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:43.226 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:40.490671+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:49:37.104720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-08T15:49:38.431537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:49:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.226+0000 7f9a71f1d700 1 -- 172.21.15.123:0/1346655848 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f9a58069900 msgr2=0x7f9a5806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.226+0000 7f9a71f1d700 1 --2- 172.21.15.123:0/1346655848 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f9a58069900 0x7f9a5806bdb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009d70 tx=0x7f9a5c008040 comp rx=0 tx=0).stop 2023-03-08T15:49:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.226+0000 7f9a71f1d700 1 -- 172.21.15.123:0/1346655848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a6c1e2e00 msgr2=0x7f9a6c0bb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.226+0000 7f9a71f1d700 1 --2- 172.21.15.123:0/1346655848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a6c1e2e00 0x7f9a6c0bb9b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9a60007340 tx=0x7f9a60007650 comp rx=0 tx=0).stop 2023-03-08T15:49:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.226+0000 7f9a71f1d700 1 -- 172.21.15.123:0/1346655848 shutdown_connections 2023-03-08T15:49:43.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.226+0000 7f9a71f1d700 1 --2- 172.21.15.123:0/1346655848 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f9a58069900 0x7f9a5806bdb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.226+0000 7f9a71f1d700 1 --2- 172.21.15.123:0/1346655848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c0bcb00 0x7f9a6c13e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.226+0000 7f9a71f1d700 1 --2- 172.21.15.123:0/1346655848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a54005200 0x7f9a6c1d50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.226+0000 7f9a71f1d700 1 --2- 172.21.15.123:0/1346655848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a6c1e2e00 0x7f9a6c0bb9b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.226+0000 7f9a71f1d700 1 -- 172.21.15.123:0/1346655848 >> 172.21.15.123:0/1346655848 conn(0x7f9a6c06b360 msgr2=0x7f9a6c0b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:43.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.226+0000 7f9a71f1d700 1 -- 172.21.15.123:0/1346655848 shutdown_connections 2023-03-08T15:49:43.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.226+0000 7f9a71f1d700 1 -- 172.21.15.123:0/1346655848 wait complete. 2023-03-08T15:49:43.240 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-08T15:49:43.240 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-08T15:49:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.358+0000 7f68df435700 1 Processor -- start 2023-03-08T15:49:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.359+0000 7f68df435700 1 -- start start 2023-03-08T15:49:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.359+0000 7f68df435700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f68d806fef0 0x7f68d814ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.359+0000 7f68df435700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68d814b250 0x7f68d8155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.359+0000 7f68df435700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d814b6f0 con 0x7f68d8147e50 2023-03-08T15:49:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.359+0000 7f68df435700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d806a960 con 0x7f68d806fef0 2023-03-08T15:49:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.359+0000 7f68df435700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d814a810 con 0x7f68d814b250 2023-03-08T15:49:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.359+0000 7f68dc9d0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f68d806fef0 0x7f68d814ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.359+0000 7f68dc9d0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f68d806fef0 0x7f68d814ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53622/0 (socket says 172.21.15.123:53622) 2023-03-08T15:49:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.359+0000 7f68dc9d0700 1 -- 172.21.15.123:0/3746933443 learned_addr learned my addr 172.21.15.123:0/3746933443 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.359+0000 7f68dd9d2700 1 --2- 172.21.15.123:0/3746933443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68d814b250 0x7f68d8155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.360+0000 7f68dc9d0700 1 -- 172.21.15.123:0/3746933443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68d814b250 msgr2=0x7f68d8155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.360+0000 7f68dc9d0700 1 --2- 172.21.15.123:0/3746933443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68d814b250 0x7f68d8155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.360+0000 7f68dc9d0700 1 -- 172.21.15.123:0/3746933443 >> v1:172.21.15.175:6789/0 conn(0x7f68d8147e50 legacy=0x7f68d806a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.360+0000 7f68dc9d0700 1 -- 172.21.15.123:0/3746933443 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d8071a40 con 0x7f68d806fef0 2023-03-08T15:49:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.360+0000 7f68dc9d0700 1 --2- 172.21.15.123:0/3746933443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d806fef0 0x7f68d814ad10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f68d40098f0 tx=0x7f68d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef17a3563591222 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.360+0000 7f68cffff700 1 -- 172.21.15.123:0/3746933443 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4011830 con 0x7f68d806fef0 2023-03-08T15:49:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.360+0000 7f68cffff700 1 -- 172.21.15.123:0/3746933443 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d4011990 con 0x7f68d806fef0 2023-03-08T15:49:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.360+0000 7f68cffff700 1 -- 172.21.15.123:0/3746933443 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4011d20 con 0x7f68d806fef0 2023-03-08T15:49:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.360+0000 7f68df435700 1 -- 172.21.15.123:0/3746933443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d806fef0 msgr2=0x7f68d814ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.360+0000 7f68df435700 1 --2- 172.21.15.123:0/3746933443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d806fef0 0x7f68d814ad10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f68d40098f0 tx=0x7f68d4009c00 comp rx=0 tx=0).stop 2023-03-08T15:49:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.360+0000 7f68df435700 1 -- 172.21.15.123:0/3746933443 shutdown_connections 2023-03-08T15:49:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.360+0000 7f68df435700 1 --2- 172.21.15.123:0/3746933443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68d814b250 0x7f68d8155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.360+0000 7f68df435700 1 --2- 172.21.15.123:0/3746933443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d806fef0 0x7f68d814ad10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.360+0000 7f68df435700 1 -- 172.21.15.123:0/3746933443 >> 172.21.15.123:0/3746933443 conn(0x7f68d806b360 msgr2=0x7f68d806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.361+0000 7f68df435700 1 -- 172.21.15.123:0/3746933443 shutdown_connections 2023-03-08T15:49:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.361+0000 7f68df435700 1 -- 172.21.15.123:0/3746933443 wait complete. 2023-03-08T15:49:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68df435700 1 Processor -- start 2023-03-08T15:49:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68df435700 1 -- start start 2023-03-08T15:49:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68df435700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68d806fef0 0x7f68d8140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68df435700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d8147e50 0x7f68d81d60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68df435700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68d814b250 0x7f68d81e3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68df435700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d8140050 con 0x7f68d8147e50 2023-03-08T15:49:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68df435700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d81d6610 con 0x7f68d806fef0 2023-03-08T15:49:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68df435700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d813a870 con 0x7f68d814b250 2023-03-08T15:49:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68dc9d0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d8147e50 0x7f68d81d60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68dc9d0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d8147e50 0x7f68d81d60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53628/0 (socket says 172.21.15.123:53628) 2023-03-08T15:49:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68dc9d0700 1 -- 172.21.15.123:0/278532124 learned_addr learned my addr 172.21.15.123:0/278532124 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68dd1d1700 1 --2- 172.21.15.123:0/278532124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68d806fef0 0x7f68d8140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68dd9d2700 1 --2- 172.21.15.123:0/278532124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68d814b250 0x7f68d81e3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68dc9d0700 1 -- 172.21.15.123:0/278532124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68d814b250 msgr2=0x7f68d81e3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68dc9d0700 1 --2- 172.21.15.123:0/278532124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68d814b250 0x7f68d81e3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68dc9d0700 1 -- 172.21.15.123:0/278532124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68d806fef0 msgr2=0x7f68d8140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68dc9d0700 1 --2- 172.21.15.123:0/278532124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68d806fef0 0x7f68d8140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68dc9d0700 1 -- 172.21.15.123:0/278532124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d4009550 con 0x7f68d8147e50 2023-03-08T15:49:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.362+0000 7f68dd1d1700 1 --2- 172.21.15.123:0/278532124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68d806fef0 0x7f68d8140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.363+0000 7f68dc9d0700 1 --2- 172.21.15.123:0/278532124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d8147e50 0x7f68d81d60d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f68d4000c00 tx=0x7f68d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:43.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.363+0000 7f68cdffb700 1 -- 172.21.15.123:0/278532124 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4004480 con 0x7f68d8147e50 2023-03-08T15:49:43.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.363+0000 7f68cdffb700 1 -- 172.21.15.123:0/278532124 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d401f070 con 0x7f68d8147e50 2023-03-08T15:49:43.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.363+0000 7f68df435700 1 -- 172.21.15.123:0/278532124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d8072000 con 0x7f68d8147e50 2023-03-08T15:49:43.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.363+0000 7f68cdffb700 1 -- 172.21.15.123:0/278532124 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d40038c0 con 0x7f68d8147e50 2023-03-08T15:49:43.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.363+0000 7f68df435700 1 -- 172.21.15.123:0/278532124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d8071d20 con 0x7f68d8147e50 2023-03-08T15:49:43.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.364+0000 7f68df435700 1 -- 172.21.15.123:0/278532124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d8148220 con 0x7f68d8147e50 2023-03-08T15:49:43.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.364+0000 7f68cdffb700 1 -- 172.21.15.123:0/278532124 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f68d402a020 con 0x7f68d8147e50 2023-03-08T15:49:43.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.365+0000 7f68cdffb700 1 --2- 172.21.15.123:0/278532124 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f68bc0698d0 0x7f68bc06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.365+0000 7f68cdffb700 1 -- 172.21.15.123:0/278532124 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68d4088c10 con 0x7f68d8147e50 2023-03-08T15:49:43.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.365+0000 7f68dd1d1700 1 --2- 172.21.15.123:0/278532124 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f68bc0698d0 0x7f68bc06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.365+0000 7f68dd1d1700 1 --2- 172.21.15.123:0/278532124 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f68bc0698d0 0x7f68bc06bd80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f68c8000f60 tx=0x7f68c8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:43.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.369+0000 7f68cdffb700 1 -- 172.21.15.123:0/278532124 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f68d40549e0 con 0x7f68d8147e50 2023-03-08T15:49:43.552 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.551+0000 7f68df435700 1 -- 172.21.15.123:0/278532124 --> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68d81e32d0 con 0x7f68bc0698d0 2023-03-08T15:49:43.560 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.559+0000 7f68cdffb700 1 -- 172.21.15.123:0/278532124 <== mgr.4098 v2:172.21.15.123:6832/142884 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286685 (secure 0 0 0) 0x7f68d81e32d0 con 0x7f68bc0698d0 2023-03-08T15:49:43.563 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:43.564 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.562+0000 7f68df435700 1 -- 172.21.15.123:0/278532124 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f68bc0698d0 msgr2=0x7f68bc06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.562+0000 7f68df435700 1 --2- 172.21.15.123:0/278532124 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f68bc0698d0 0x7f68bc06bd80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f68c8000f60 tx=0x7f68c8009040 comp rx=0 tx=0).stop 2023-03-08T15:49:43.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.562+0000 7f68df435700 1 -- 172.21.15.123:0/278532124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d8147e50 msgr2=0x7f68d81d60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.562+0000 7f68df435700 1 --2- 172.21.15.123:0/278532124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d8147e50 0x7f68d81d60d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f68d4000c00 tx=0x7f68d4004750 comp rx=0 tx=0).stop 2023-03-08T15:49:43.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.562+0000 7f68df435700 1 -- 172.21.15.123:0/278532124 shutdown_connections 2023-03-08T15:49:43.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.562+0000 7f68df435700 1 --2- 172.21.15.123:0/278532124 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f68bc0698d0 0x7f68bc06bd80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.562+0000 7f68df435700 1 --2- 172.21.15.123:0/278532124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68d814b250 0x7f68d81e3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.565 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.562+0000 7f68df435700 1 --2- 172.21.15.123:0/278532124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68d806fef0 0x7f68d8140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.562+0000 7f68df435700 1 --2- 172.21.15.123:0/278532124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d8147e50 0x7f68d81d60d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.562+0000 7f68df435700 1 -- 172.21.15.123:0/278532124 >> 172.21.15.123:0/278532124 conn(0x7f68d806b360 msgr2=0x7f68d81496b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:43.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.562+0000 7f68df435700 1 -- 172.21.15.123:0/278532124 shutdown_connections 2023-03-08T15:49:43.566 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.562+0000 7f68df435700 1 -- 172.21.15.123:0/278532124 wait complete. 2023-03-08T15:49:43.566 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-03-08T15:49:43.575 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-03-08T15:49:41.972679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66280,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908440,"statfs":{"total":773094113280,"available":773026242560,"internally_reserved":0,"allocated":3186688,"data_stored":1902188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000906"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515200+0000","last_change":"2023-03-08T15:49:39.500574+0000","last_active":"2023-03-08T15:49:40.515200+0000","last_peered":"2023-03-08T15:49:40.515200+0000","last_clean":"2023-03-08T15:49:40.515200+0000","last_became_active":"2023-03-08T15:49:39.500324+0000","last_became_peered":"2023-03-08T15:49:39.500324+0000","last_unstale":"2023-03-08T15:49:40.515200+0000","last_undegraded":"2023-03-08T15:49:40.515200+0000","last_fullsized":"2023-03-08T15:49:40.515200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:54.873584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516498+0000","last_change":"2023-03-08T15:49:39.510529+0000","last_active":"2023-03-08T15:49:40.516498+0000","last_peered":"2023-03-08T15:49:40.516498+0000","last_clean":"2023-03-08T15:49:40.516498+0000","last_became_active":"2023-03-08T15:49:39.510227+0000","last_became_peered":"2023-03-08T15:49:39.510227+0000","last_unstale":"2023-03-08T15:49:40.516498+0000","last_undegraded":"2023-03-08T15:49:40.516498+0000","last_fullsized":"2023-03-08T15:49:40.516498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498504+0000","last_change":"2023-03-08T15:49:39.507276+0000","last_active":"2023-03-08T15:49:40.498504+0000","last_peered":"2023-03-08T15:49:40.498504+0000","last_clean":"2023-03-08T15:49:40.498504+0000","last_became_active":"2023-03-08T15:49:39.506954+0000","last_became_peered":"2023-03-08T15:49:39.506954+0000","last_unstale":"2023-03-08T15:49:40.498504+0000","last_undegraded":"2023-03-08T15:49:40.498504+0000","last_fullsized":"2023-03-08T15:49:40.498504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516428+0000","last_change":"2023-03-08T15:49:39.511677+0000","last_active":"2023-03-08T15:49:40.516428+0000","last_peered":"2023-03-08T15:49:40.516428+0000","last_clean":"2023-03-08T15:49:40.516428+0000","last_became_active":"2023-03-08T15:49:39.508018+0000","last_became_peered":"2023-03-08T15:49:39.508018+0000","last_unstale":"2023-03-08T15:49:40.516428+0000","last_undegraded":"2023-03-08T15:49:40.516428+0000","last_fullsized":"2023-03-08T15:49:40.516428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:08:10.089458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515126+0000","last_change":"2023-03-08T15:49:39.509835+0000","last_active":"2023-03-08T15:49:40.515126+0000","last_peered":"2023-03-08T15:49:40.515126+0000","last_clean":"2023-03-08T15:49:40.515126+0000","last_became_active":"2023-03-08T15:49:39.507785+0000","last_became_peered":"2023-03-08T15:49:39.507785+0000","last_unstale":"2023-03-08T15:49:40.515126+0000","last_undegraded":"2023-03-08T15:49:40.515126+0000","last_fullsized":"2023-03-08T15:49:40.515126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:41:05.974121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498456+0000","last_change":"2023-03-08T15:49:39.514008+0000","last_active":"2023-03-08T15:49:40.498456+0000","last_peered":"2023-03-08T15:49:40.498456+0000","last_clean":"2023-03-08T15:49:40.498456+0000","last_became_active":"2023-03-08T15:49:39.508486+0000","last_became_peered":"2023-03-08T15:49:39.508486+0000","last_unstale":"2023-03-08T15:49:40.498456+0000","last_undegraded":"2023-03-08T15:49:40.498456+0000","last_fullsized":"2023-03-08T15:49:40.498456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:00:34.312638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515812+0000","last_change":"2023-03-08T15:49:39.517513+0000","last_active":"2023-03-08T15:49:40.515812+0000","last_peered":"2023-03-08T15:49:40.515812+0000","last_clean":"2023-03-08T15:49:40.515812+0000","last_became_active":"2023-03-08T15:49:39.517157+0000","last_became_peered":"2023-03-08T15:49:39.517157+0000","last_unstale":"2023-03-08T15:49:40.515812+0000","last_undegraded":"2023-03-08T15:49:40.515812+0000","last_fullsized":"2023-03-08T15:49:40.515812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515450+0000","last_change":"2023-03-08T15:49:39.515299+0000","last_active":"2023-03-08T15:49:40.515450+0000","last_peered":"2023-03-08T15:49:40.515450+0000","last_clean":"2023-03-08T15:49:40.515450+0000","last_became_active":"2023-03-08T15:49:39.515005+0000","last_became_peered":"2023-03-08T15:49:39.515005+0000","last_unstale":"2023-03-08T15:49:40.515450+0000","last_undegraded":"2023-03-08T15:49:40.515450+0000","last_fullsized":"2023-03-08T15:49:40.515450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:07:36.774920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515469+0000","last_change":"2023-03-08T15:49:39.511832+0000","last_active":"2023-03-08T15:49:40.515469+0000","last_peered":"2023-03-08T15:49:40.515469+0000","last_clean":"2023-03-08T15:49:40.515469+0000","last_became_active":"2023-03-08T15:49:39.511580+0000","last_became_peered":"2023-03-08T15:49:39.511580+0000","last_unstale":"2023-03-08T15:49:40.515469+0000","last_undegraded":"2023-03-08T15:49:40.515469+0000","last_fullsized":"2023-03-08T15:49:40.515469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516671+0000","last_change":"2023-03-08T15:49:39.509905+0000","last_active":"2023-03-08T15:49:40.516671+0000","last_peered":"2023-03-08T15:49:40.516671+0000","last_clean":"2023-03-08T15:49:40.516671+0000","last_became_active":"2023-03-08T15:49:39.509656+0000","last_became_peered":"2023-03-08T15:49:39.509656+0000","last_unstale":"2023-03-08T15:49:40.516671+0000","last_undegraded":"2023-03-08T15:49:40.516671+0000","last_fullsized":"2023-03-08T15:49:40.516671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:02:38.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498546+0000","last_change":"2023-03-08T15:49:39.512652+0000","last_active":"2023-03-08T15:49:40.498546+0000","last_peered":"2023-03-08T15:49:40.498546+0000","last_clean":"2023-03-08T15:49:40.498546+0000","last_became_active":"2023-03-08T15:49:39.512339+0000","last_became_peered":"2023-03-08T15:49:39.512339+0000","last_unstale":"2023-03-08T15:49:40.498546+0000","last_undegraded":"2023-03-08T15:49:40.498546+0000","last_fullsized":"2023-03-08T15:49:40.498546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515136+0000","last_change":"2023-03-08T15:49:39.501468+0000","last_active":"2023-03-08T15:49:40.515136+0000","last_peered":"2023-03-08T15:49:40.515136+0000","last_clean":"2023-03-08T15:49:40.515136+0000","last_became_active":"2023-03-08T15:49:39.501217+0000","last_became_peered":"2023-03-08T15:49:39.501217+0000","last_unstale":"2023-03-08T15:49:40.515136+0000","last_undegraded":"2023-03-08T15:49:40.515136+0000","last_fullsized":"2023-03-08T15:49:40.515136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:04.540991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515081+0000","last_change":"2023-03-08T15:49:39.500058+0000","last_active":"2023-03-08T15:49:40.515081+0000","last_peered":"2023-03-08T15:49:40.515081+0000","last_clean":"2023-03-08T15:49:40.515081+0000","last_became_active":"2023-03-08T15:49:39.499799+0000","last_became_peered":"2023-03-08T15:49:39.499799+0000","last_unstale":"2023-03-08T15:49:40.515081+0000","last_undegraded":"2023-03-08T15:49:40.515081+0000","last_fullsized":"2023-03-08T15:49:40.515081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:22.868366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516068+0000","last_change":"2023-03-08T15:49:39.509813+0000","last_active":"2023-03-08T15:49:40.516068+0000","last_peered":"2023-03-08T15:49:40.516068+0000","last_clean":"2023-03-08T15:49:40.516068+0000","last_became_active":"2023-03-08T15:49:39.509515+0000","last_became_peered":"2023-03-08T15:49:39.509515+0000","last_unstale":"2023-03-08T15:49:40.516068+0000","last_undegraded":"2023-03-08T15:49:40.516068+0000","last_fullsized":"2023-03-08T15:49:40.516068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516019+0000","last_change":"2023-03-08T15:49:39.517988+0000","last_active":"2023-03-08T15:49:40.516019+0000","last_peered":"2023-03-08T15:49:40.516019+0000","last_clean":"2023-03-08T15:49:40.516019+0000","last_became_active":"2023-03-08T15:49:39.517729+0000","last_became_peered":"2023-03-08T15:49:39.517729+0000","last_unstale":"2023-03-08T15:49:40.516019+0000","last_undegraded":"2023-03-08T15:49:40.516019+0000","last_fullsized":"2023-03-08T15:49:40.516019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498160+0000","last_change":"2023-03-08T15:49:39.507303+0000","last_active":"2023-03-08T15:49:40.498160+0000","last_peered":"2023-03-08T15:49:40.498160+0000","last_clean":"2023-03-08T15:49:40.498160+0000","last_became_active":"2023-03-08T15:49:39.506847+0000","last_became_peered":"2023-03-08T15:49:39.506847+0000","last_unstale":"2023-03-08T15:49:40.498160+0000","last_undegraded":"2023-03-08T15:49:40.498160+0000","last_fullsized":"2023-03-08T15:49:40.498160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:55:21.101920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515522+0000","last_change":"2023-03-08T15:49:39.511674+0000","last_active":"2023-03-08T15:49:40.515522+0000","last_peered":"2023-03-08T15:49:40.515522+0000","last_clean":"2023-03-08T15:49:40.515522+0000","last_became_active":"2023-03-08T15:49:39.511293+0000","last_became_peered":"2023-03-08T15:49:39.511293+0000","last_unstale":"2023-03-08T15:49:40.515522+0000","last_undegraded":"2023-03-08T15:49:40.515522+0000","last_fullsized":"2023-03-08T15:49:40.515522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:15:10.927104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498599+0000","last_change":"2023-03-08T15:49:39.507528+0000","last_active":"2023-03-08T15:49:40.498599+0000","last_peered":"2023-03-08T15:49:40.498599+0000","last_clean":"2023-03-08T15:49:40.498599+0000","last_became_active":"2023-03-08T15:49:39.507193+0000","last_became_peered":"2023-03-08T15:49:39.507193+0000","last_unstale":"2023-03-08T15:49:40.498599+0000","last_undegraded":"2023-03-08T15:49:40.498599+0000","last_fullsized":"2023-03-08T15:49:40.498599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:09:02.915110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515398+0000","last_change":"2023-03-08T15:49:39.503980+0000","last_active":"2023-03-08T15:49:40.515398+0000","last_peered":"2023-03-08T15:49:40.515398+0000","last_clean":"2023-03-08T15:49:40.515398+0000","last_became_active":"2023-03-08T15:49:39.503703+0000","last_became_peered":"2023-03-08T15:49:39.503703+0000","last_unstale":"2023-03-08T15:49:40.515398+0000","last_undegraded":"2023-03-08T15:49:40.515398+0000","last_fullsized":"2023-03-08T15:49:40.515398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:45.599141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498726+0000","last_change":"2023-03-08T15:49:39.505726+0000","last_active":"2023-03-08T15:49:40.498726+0000","last_peered":"2023-03-08T15:49:40.498726+0000","last_clean":"2023-03-08T15:49:40.498726+0000","last_became_active":"2023-03-08T15:49:39.505103+0000","last_became_peered":"2023-03-08T15:49:39.505103+0000","last_unstale":"2023-03-08T15:49:40.498726+0000","last_undegraded":"2023-03-08T15:49:40.498726+0000","last_fullsized":"2023-03-08T15:49:40.498726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:01:00.216256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516218+0000","last_change":"2023-03-08T15:49:39.520100+0000","last_active":"2023-03-08T15:49:40.516218+0000","last_peered":"2023-03-08T15:49:40.516218+0000","last_clean":"2023-03-08T15:49:40.516218+0000","last_became_active":"2023-03-08T15:49:39.519799+0000","last_became_peered":"2023-03-08T15:49:39.519799+0000","last_unstale":"2023-03-08T15:49:40.516218+0000","last_undegraded":"2023-03-08T15:49:40.516218+0000","last_fullsized":"2023-03-08T15:49:40.516218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515704+0000","last_change":"2023-03-08T15:49:39.513354+0000","last_active":"2023-03-08T15:49:40.515704+0000","last_peered":"2023-03-08T15:49:40.515704+0000","last_clean":"2023-03-08T15:49:40.515704+0000","last_became_active":"2023-03-08T15:49:39.513104+0000","last_became_peered":"2023-03-08T15:49:39.513104+0000","last_unstale":"2023-03-08T15:49:40.515704+0000","last_undegraded":"2023-03-08T15:49:40.515704+0000","last_fullsized":"2023-03-08T15:49:40.515704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497212+0000","last_change":"2023-03-08T15:49:39.505113+0000","last_active":"2023-03-08T15:49:40.497212+0000","last_peered":"2023-03-08T15:49:40.497212+0000","last_clean":"2023-03-08T15:49:40.497212+0000","last_became_active":"2023-03-08T15:49:39.504875+0000","last_became_peered":"2023-03-08T15:49:39.504875+0000","last_unstale":"2023-03-08T15:49:40.497212+0000","last_undegraded":"2023-03-08T15:49:40.497212+0000","last_fullsized":"2023-03-08T15:49:40.497212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:03:30.032957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516293+0000","last_change":"2023-03-08T15:49:39.520457+0000","last_active":"2023-03-08T15:49:40.516293+0000","last_peered":"2023-03-08T15:49:40.516293+0000","last_clean":"2023-03-08T15:49:40.516293+0000","last_became_active":"2023-03-08T15:49:39.520170+0000","last_became_peered":"2023-03-08T15:49:39.520170+0000","last_unstale":"2023-03-08T15:49:40.516293+0000","last_undegraded":"2023-03-08T15:49:40.516293+0000","last_fullsized":"2023-03-08T15:49:40.516293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499040+0000","last_change":"2023-03-08T15:49:39.505287+0000","last_active":"2023-03-08T15:49:40.499040+0000","last_peered":"2023-03-08T15:49:40.499040+0000","last_clean":"2023-03-08T15:49:40.499040+0000","last_became_active":"2023-03-08T15:49:39.505030+0000","last_became_peered":"2023-03-08T15:49:39.505030+0000","last_unstale":"2023-03-08T15:49:40.499040+0000","last_undegraded":"2023-03-08T15:49:40.499040+0000","last_fullsized":"2023-03-08T15:49:40.499040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:42:50.682185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499114+0000","last_change":"2023-03-08T15:49:39.509614+0000","last_active":"2023-03-08T15:49:40.499114+0000","last_peered":"2023-03-08T15:49:40.499114+0000","last_clean":"2023-03-08T15:49:40.499114+0000","last_became_active":"2023-03-08T15:49:39.509049+0000","last_became_peered":"2023-03-08T15:49:39.509049+0000","last_unstale":"2023-03-08T15:49:40.499114+0000","last_undegraded":"2023-03-08T15:49:40.499114+0000","last_fullsized":"2023-03-08T15:49:40.499114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516066+0000","last_change":"2023-03-08T15:49:39.518389+0000","last_active":"2023-03-08T15:49:40.516066+0000","last_peered":"2023-03-08T15:49:40.516066+0000","last_clean":"2023-03-08T15:49:40.516066+0000","last_became_active":"2023-03-08T15:49:39.518107+0000","last_became_peered":"2023-03-08T15:49:39.518107+0000","last_unstale":"2023-03-08T15:49:40.516066+0000","last_undegraded":"2023-03-08T15:49:40.516066+0000","last_fullsized":"2023-03-08T15:49:40.516066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498736+0000","last_change":"2023-03-08T15:49:39.076740+0000","last_active":"2023-03-08T15:49:40.498736+0000","last_peered":"2023-03-08T15:49:40.498736+0000","last_clean":"2023-03-08T15:49:40.498736+0000","last_became_active":"2023-03-08T15:49:39.075420+0000","last_became_peered":"2023-03-08T15:49:39.075420+0000","last_unstale":"2023-03-08T15:49:40.498736+0000","last_undegraded":"2023-03-08T15:49:40.498736+0000","last_fullsized":"2023-03-08T15:49:40.498736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:39:52.448950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497861+0000","last_change":"2023-03-08T15:49:39.506581+0000","last_active":"2023-03-08T15:49:40.497861+0000","last_peered":"2023-03-08T15:49:40.497861+0000","last_clean":"2023-03-08T15:49:40.497861+0000","last_became_active":"2023-03-08T15:49:39.505867+0000","last_became_peered":"2023-03-08T15:49:39.505867+0000","last_unstale":"2023-03-08T15:49:40.497861+0000","last_undegraded":"2023-03-08T15:49:40.497861+0000","last_fullsized":"2023-03-08T15:49:40.497861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:41:05.974121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498634+0000","last_change":"2023-03-08T15:49:39.064465+0000","last_active":"2023-03-08T15:49:40.498634+0000","last_peered":"2023-03-08T15:49:40.498634+0000","last_clean":"2023-03-08T15:49:40.498634+0000","last_became_active":"2023-03-08T15:49:39.064180+0000","last_became_peered":"2023-03-08T15:49:39.064180+0000","last_unstale":"2023-03-08T15:49:40.498634+0000","last_undegraded":"2023-03-08T15:49:40.498634+0000","last_fullsized":"2023-03-08T15:49:40.498634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515371+0000","last_change":"2023-03-08T15:49:39.517781+0000","last_active":"2023-03-08T15:49:40.515371+0000","last_peered":"2023-03-08T15:49:40.515371+0000","last_clean":"2023-03-08T15:49:40.515371+0000","last_became_active":"2023-03-08T15:49:39.517522+0000","last_became_peered":"2023-03-08T15:49:39.517522+0000","last_unstale":"2023-03-08T15:49:40.515371+0000","last_undegraded":"2023-03-08T15:49:40.515371+0000","last_fullsized":"2023-03-08T15:49:40.515371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:59:37.837477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497190+0000","last_change":"2023-03-08T15:49:39.073238+0000","last_active":"2023-03-08T15:49:40.497190+0000","last_peered":"2023-03-08T15:49:40.497190+0000","last_clean":"2023-03-08T15:49:40.497190+0000","last_became_active":"2023-03-08T15:49:39.072946+0000","last_became_peered":"2023-03-08T15:49:39.072946+0000","last_unstale":"2023-03-08T15:49:40.497190+0000","last_undegraded":"2023-03-08T15:49:40.497190+0000","last_fullsized":"2023-03-08T15:49:40.497190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:07:57.155564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516703+0000","last_change":"2023-03-08T15:49:39.511074+0000","last_active":"2023-03-08T15:49:40.516703+0000","last_peered":"2023-03-08T15:49:40.516703+0000","last_clean":"2023-03-08T15:49:40.516703+0000","last_became_active":"2023-03-08T15:49:39.510818+0000","last_became_peered":"2023-03-08T15:49:39.510818+0000","last_unstale":"2023-03-08T15:49:40.516703+0000","last_undegraded":"2023-03-08T15:49:40.516703+0000","last_fullsized":"2023-03-08T15:49:40.516703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:04.540991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515561+0000","last_change":"2023-03-08T15:49:39.070465+0000","last_active":"2023-03-08T15:49:40.515561+0000","last_peered":"2023-03-08T15:49:40.515561+0000","last_clean":"2023-03-08T15:49:40.515561+0000","last_became_active":"2023-03-08T15:49:39.069996+0000","last_became_peered":"2023-03-08T15:49:39.069996+0000","last_unstale":"2023-03-08T15:49:40.515561+0000","last_undegraded":"2023-03-08T15:49:40.515561+0000","last_fullsized":"2023-03-08T15:49:40.515561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:53.868715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497272+0000","last_change":"2023-03-08T15:49:39.506567+0000","last_active":"2023-03-08T15:49:40.497272+0000","last_peered":"2023-03-08T15:49:40.497272+0000","last_clean":"2023-03-08T15:49:40.497272+0000","last_became_active":"2023-03-08T15:49:39.506069+0000","last_became_peered":"2023-03-08T15:49:39.506069+0000","last_unstale":"2023-03-08T15:49:40.497272+0000","last_undegraded":"2023-03-08T15:49:40.497272+0000","last_fullsized":"2023-03-08T15:49:40.497272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:02:38.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516579+0000","last_change":"2023-03-08T15:49:39.071437+0000","last_active":"2023-03-08T15:49:40.516579+0000","last_peered":"2023-03-08T15:49:40.516579+0000","last_clean":"2023-03-08T15:49:40.516579+0000","last_became_active":"2023-03-08T15:49:39.071152+0000","last_became_peered":"2023-03-08T15:49:39.071152+0000","last_unstale":"2023-03-08T15:49:40.516579+0000","last_undegraded":"2023-03-08T15:49:40.516579+0000","last_fullsized":"2023-03-08T15:49:40.516579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:21.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497294+0000","last_change":"2023-03-08T15:49:39.517658+0000","last_active":"2023-03-08T15:49:40.497294+0000","last_peered":"2023-03-08T15:49:40.497294+0000","last_clean":"2023-03-08T15:49:40.497294+0000","last_became_active":"2023-03-08T15:49:39.517399+0000","last_became_peered":"2023-03-08T15:49:39.517399+0000","last_unstale":"2023-03-08T15:49:40.497294+0000","last_undegraded":"2023-03-08T15:49:40.497294+0000","last_fullsized":"2023-03-08T15:49:40.497294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:07:36.774920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516663+0000","last_change":"2023-03-08T15:49:39.067519+0000","last_active":"2023-03-08T15:49:40.516663+0000","last_peered":"2023-03-08T15:49:40.516663+0000","last_clean":"2023-03-08T15:49:40.516663+0000","last_became_active":"2023-03-08T15:49:39.067254+0000","last_became_peered":"2023-03-08T15:49:39.067254+0000","last_unstale":"2023-03-08T15:49:40.516663+0000","last_undegraded":"2023-03-08T15:49:40.516663+0000","last_fullsized":"2023-03-08T15:49:40.516663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498632+0000","last_change":"2023-03-08T15:49:39.504530+0000","last_active":"2023-03-08T15:49:40.498632+0000","last_peered":"2023-03-08T15:49:40.498632+0000","last_clean":"2023-03-08T15:49:40.498632+0000","last_became_active":"2023-03-08T15:49:39.504282+0000","last_became_peered":"2023-03-08T15:49:39.504282+0000","last_unstale":"2023-03-08T15:49:40.498632+0000","last_undegraded":"2023-03-08T15:49:40.498632+0000","last_fullsized":"2023-03-08T15:49:40.498632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:11:06.014260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498452+0000","last_change":"2023-03-08T15:49:39.077464+0000","last_active":"2023-03-08T15:49:40.498452+0000","last_peered":"2023-03-08T15:49:40.498452+0000","last_clean":"2023-03-08T15:49:40.498452+0000","last_became_active":"2023-03-08T15:49:39.077166+0000","last_became_peered":"2023-03-08T15:49:39.077166+0000","last_unstale":"2023-03-08T15:49:40.498452+0000","last_undegraded":"2023-03-08T15:49:40.498452+0000","last_fullsized":"2023-03-08T15:49:40.498452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498301+0000","last_change":"2023-03-08T15:49:39.503655+0000","last_active":"2023-03-08T15:49:40.498301+0000","last_peered":"2023-03-08T15:49:40.498301+0000","last_clean":"2023-03-08T15:49:40.498301+0000","last_became_active":"2023-03-08T15:49:39.503231+0000","last_became_peered":"2023-03-08T15:49:39.503231+0000","last_unstale":"2023-03-08T15:49:40.498301+0000","last_undegraded":"2023-03-08T15:49:40.498301+0000","last_fullsized":"2023-03-08T15:49:40.498301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:17:21.576214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516115+0000","last_change":"2023-03-08T15:49:39.079358+0000","last_active":"2023-03-08T15:49:40.516115+0000","last_peered":"2023-03-08T15:49:40.516115+0000","last_clean":"2023-03-08T15:49:40.516115+0000","last_became_active":"2023-03-08T15:49:39.079094+0000","last_became_peered":"2023-03-08T15:49:39.079094+0000","last_unstale":"2023-03-08T15:49:40.516115+0000","last_undegraded":"2023-03-08T15:49:40.516115+0000","last_fullsized":"2023-03-08T15:49:40.516115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:03.536123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497687+0000","last_change":"2023-03-08T15:49:39.506844+0000","last_active":"2023-03-08T15:49:40.497687+0000","last_peered":"2023-03-08T15:49:40.497687+0000","last_clean":"2023-03-08T15:49:40.497687+0000","last_became_active":"2023-03-08T15:49:39.506035+0000","last_became_peered":"2023-03-08T15:49:39.506035+0000","last_unstale":"2023-03-08T15:49:40.497687+0000","last_undegraded":"2023-03-08T15:49:40.497687+0000","last_fullsized":"2023-03-08T15:49:40.497687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515656+0000","last_change":"2023-03-08T15:49:39.072231+0000","last_active":"2023-03-08T15:49:40.515656+0000","last_peered":"2023-03-08T15:49:40.515656+0000","last_clean":"2023-03-08T15:49:40.515656+0000","last_became_active":"2023-03-08T15:49:39.071935+0000","last_became_peered":"2023-03-08T15:49:39.071935+0000","last_unstale":"2023-03-08T15:49:40.515656+0000","last_undegraded":"2023-03-08T15:49:40.515656+0000","last_fullsized":"2023-03-08T15:49:40.515656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:21.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516172+0000","last_change":"2023-03-08T15:49:39.518337+0000","last_active":"2023-03-08T15:49:40.516172+0000","last_peered":"2023-03-08T15:49:40.516172+0000","last_clean":"2023-03-08T15:49:40.516172+0000","last_became_active":"2023-03-08T15:49:39.517689+0000","last_became_peered":"2023-03-08T15:49:39.517689+0000","last_unstale":"2023-03-08T15:49:40.516172+0000","last_undegraded":"2023-03-08T15:49:40.516172+0000","last_fullsized":"2023-03-08T15:49:40.516172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515907+0000","last_change":"2023-03-08T15:49:39.076491+0000","last_active":"2023-03-08T15:49:40.515907+0000","last_peered":"2023-03-08T15:49:40.515907+0000","last_clean":"2023-03-08T15:49:40.515907+0000","last_became_active":"2023-03-08T15:49:39.076238+0000","last_became_peered":"2023-03-08T15:49:39.076238+0000","last_unstale":"2023-03-08T15:49:40.515907+0000","last_undegraded":"2023-03-08T15:49:40.515907+0000","last_fullsized":"2023-03-08T15:49:40.515907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:13:15.662118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515323+0000","last_change":"2023-03-08T15:49:39.508617+0000","last_active":"2023-03-08T15:49:40.515323+0000","last_peered":"2023-03-08T15:49:40.515323+0000","last_clean":"2023-03-08T15:49:40.515323+0000","last_became_active":"2023-03-08T15:49:39.508246+0000","last_became_peered":"2023-03-08T15:49:39.508246+0000","last_unstale":"2023-03-08T15:49:40.515323+0000","last_undegraded":"2023-03-08T15:49:40.515323+0000","last_fullsized":"2023-03-08T15:49:40.515323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:07:36.774920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515652+0000","last_change":"2023-03-08T15:49:39.072472+0000","last_active":"2023-03-08T15:49:40.515652+0000","last_peered":"2023-03-08T15:49:40.515652+0000","last_clean":"2023-03-08T15:49:40.515652+0000","last_became_active":"2023-03-08T15:49:39.072182+0000","last_became_peered":"2023-03-08T15:49:39.072182+0000","last_unstale":"2023-03-08T15:49:40.515652+0000","last_undegraded":"2023-03-08T15:49:40.515652+0000","last_fullsized":"2023-03-08T15:49:40.515652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:02:08.526616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498081+0000","last_change":"2023-03-08T15:49:39.517141+0000","last_active":"2023-03-08T15:49:40.498081+0000","last_peered":"2023-03-08T15:49:40.498081+0000","last_clean":"2023-03-08T15:49:40.498081+0000","last_became_active":"2023-03-08T15:49:39.516875+0000","last_became_peered":"2023-03-08T15:49:39.516875+0000","last_unstale":"2023-03-08T15:49:40.498081+0000","last_undegraded":"2023-03-08T15:49:40.498081+0000","last_fullsized":"2023-03-08T15:49:40.498081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515921+0000","last_change":"2023-03-08T15:49:39.072643+0000","last_active":"2023-03-08T15:49:40.515921+0000","last_peered":"2023-03-08T15:49:40.515921+0000","last_clean":"2023-03-08T15:49:40.515921+0000","last_became_active":"2023-03-08T15:49:39.072348+0000","last_became_peered":"2023-03-08T15:49:39.072348+0000","last_unstale":"2023-03-08T15:49:40.515921+0000","last_undegraded":"2023-03-08T15:49:40.515921+0000","last_fullsized":"2023-03-08T15:49:40.515921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:08:09.084589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515584+0000","last_change":"2023-03-08T15:49:39.518066+0000","last_active":"2023-03-08T15:49:40.515584+0000","last_peered":"2023-03-08T15:49:40.515584+0000","last_clean":"2023-03-08T15:49:40.515584+0000","last_became_active":"2023-03-08T15:49:39.517777+0000","last_became_peered":"2023-03-08T15:49:39.517777+0000","last_unstale":"2023-03-08T15:49:40.515584+0000","last_undegraded":"2023-03-08T15:49:40.515584+0000","last_fullsized":"2023-03-08T15:49:40.515584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516345+0000","last_change":"2023-03-08T15:49:39.078315+0000","last_active":"2023-03-08T15:49:40.516345+0000","last_peered":"2023-03-08T15:49:40.516345+0000","last_clean":"2023-03-08T15:49:40.516345+0000","last_became_active":"2023-03-08T15:49:39.078043+0000","last_became_peered":"2023-03-08T15:49:39.078043+0000","last_unstale":"2023-03-08T15:49:40.516345+0000","last_undegraded":"2023-03-08T15:49:40.516345+0000","last_fullsized":"2023-03-08T15:49:40.516345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:11:05.009391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498117+0000","last_change":"2023-03-08T15:49:39.513221+0000","last_active":"2023-03-08T15:49:40.498117+0000","last_peered":"2023-03-08T15:49:40.498117+0000","last_clean":"2023-03-08T15:49:40.498117+0000","last_became_active":"2023-03-08T15:49:39.512950+0000","last_became_peered":"2023-03-08T15:49:39.512950+0000","last_unstale":"2023-03-08T15:49:40.498117+0000","last_undegraded":"2023-03-08T15:49:40.498117+0000","last_fullsized":"2023-03-08T15:49:40.498117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516833+0000","last_change":"2023-03-08T15:49:39.068973+0000","last_active":"2023-03-08T15:49:40.516833+0000","last_peered":"2023-03-08T15:49:40.516833+0000","last_clean":"2023-03-08T15:49:40.516833+0000","last_became_active":"2023-03-08T15:49:39.068694+0000","last_became_peered":"2023-03-08T15:49:39.068694+0000","last_unstale":"2023-03-08T15:49:40.516833+0000","last_undegraded":"2023-03-08T15:49:40.516833+0000","last_fullsized":"2023-03-08T15:49:40.516833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:55:20.097052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515855+0000","last_change":"2023-03-08T15:49:39.510470+0000","last_active":"2023-03-08T15:49:40.515855+0000","last_peered":"2023-03-08T15:49:40.515855+0000","last_clean":"2023-03-08T15:49:40.515855+0000","last_became_active":"2023-03-08T15:49:39.510205+0000","last_became_peered":"2023-03-08T15:49:39.510205+0000","last_unstale":"2023-03-08T15:49:40.515855+0000","last_undegraded":"2023-03-08T15:49:40.515855+0000","last_fullsized":"2023-03-08T15:49:40.515855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:45.599141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515854+0000","last_change":"2023-03-08T15:49:39.067592+0000","last_active":"2023-03-08T15:49:40.515854+0000","last_peered":"2023-03-08T15:49:40.515854+0000","last_clean":"2023-03-08T15:49:40.515854+0000","last_became_active":"2023-03-08T15:49:39.067309+0000","last_became_peered":"2023-03-08T15:49:39.067309+0000","last_unstale":"2023-03-08T15:49:40.515854+0000","last_undegraded":"2023-03-08T15:49:40.515854+0000","last_fullsized":"2023-03-08T15:49:40.515854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:53.868715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.514896+0000","last_change":"2023-03-08T15:49:39.510190+0000","last_active":"2023-03-08T15:49:40.514896+0000","last_peered":"2023-03-08T15:49:40.514896+0000","last_clean":"2023-03-08T15:49:40.514896+0000","last_became_active":"2023-03-08T15:49:39.509892+0000","last_became_peered":"2023-03-08T15:49:39.509892+0000","last_unstale":"2023-03-08T15:49:40.514896+0000","last_undegraded":"2023-03-08T15:49:40.514896+0000","last_fullsized":"2023-03-08T15:49:40.514896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:09:32.633312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497690+0000","last_change":"2023-03-08T15:49:39.073755+0000","last_active":"2023-03-08T15:49:40.497690+0000","last_peered":"2023-03-08T15:49:40.497690+0000","last_clean":"2023-03-08T15:49:40.497690+0000","last_became_active":"2023-03-08T15:49:39.073472+0000","last_became_peered":"2023-03-08T15:49:39.073472+0000","last_unstale":"2023-03-08T15:49:40.497690+0000","last_undegraded":"2023-03-08T15:49:40.497690+0000","last_fullsized":"2023-03-08T15:49:40.497690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:53.868715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498326+0000","last_change":"2023-03-08T15:49:39.505358+0000","last_active":"2023-03-08T15:49:40.498326+0000","last_peered":"2023-03-08T15:49:40.498326+0000","last_clean":"2023-03-08T15:49:40.498326+0000","last_became_active":"2023-03-08T15:49:39.504755+0000","last_became_peered":"2023-03-08T15:49:39.504755+0000","last_unstale":"2023-03-08T15:49:40.498326+0000","last_undegraded":"2023-03-08T15:49:40.498326+0000","last_fullsized":"2023-03-08T15:49:40.498326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:03:30.032957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515748+0000","last_change":"2023-03-08T15:49:39.076072+0000","last_active":"2023-03-08T15:49:40.515748+0000","last_peered":"2023-03-08T15:49:40.515748+0000","last_clean":"2023-03-08T15:49:40.515748+0000","last_became_active":"2023-03-08T15:49:39.075810+0000","last_became_peered":"2023-03-08T15:49:39.075810+0000","last_unstale":"2023-03-08T15:49:40.515748+0000","last_undegraded":"2023-03-08T15:49:40.515748+0000","last_fullsized":"2023-03-08T15:49:40.515748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498686+0000","last_change":"2023-03-08T15:49:39.505109+0000","last_active":"2023-03-08T15:49:40.498686+0000","last_peered":"2023-03-08T15:49:40.498686+0000","last_clean":"2023-03-08T15:49:40.498686+0000","last_became_active":"2023-03-08T15:49:39.504889+0000","last_became_peered":"2023-03-08T15:49:39.504889+0000","last_unstale":"2023-03-08T15:49:40.498686+0000","last_undegraded":"2023-03-08T15:49:40.498686+0000","last_fullsized":"2023-03-08T15:49:40.498686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498254+0000","last_change":"2023-03-08T15:49:39.077380+0000","last_active":"2023-03-08T15:49:40.498254+0000","last_peered":"2023-03-08T15:49:40.498254+0000","last_clean":"2023-03-08T15:49:40.498254+0000","last_became_active":"2023-03-08T15:49:39.077041+0000","last_became_peered":"2023-03-08T15:49:39.077041+0000","last_unstale":"2023-03-08T15:49:40.498254+0000","last_undegraded":"2023-03-08T15:49:40.498254+0000","last_fullsized":"2023-03-08T15:49:40.498254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:02:08.526616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498825+0000","last_change":"2023-03-08T15:49:39.512506+0000","last_active":"2023-03-08T15:49:40.498825+0000","last_peered":"2023-03-08T15:49:40.498825+0000","last_clean":"2023-03-08T15:49:40.498825+0000","last_became_active":"2023-03-08T15:49:39.512103+0000","last_became_peered":"2023-03-08T15:49:39.512103+0000","last_unstale":"2023-03-08T15:49:40.498825+0000","last_undegraded":"2023-03-08T15:49:40.498825+0000","last_fullsized":"2023-03-08T15:49:40.498825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:09:32.633312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497106+0000","last_change":"2023-03-08T15:49:39.065317+0000","last_active":"2023-03-08T15:49:40.497106+0000","last_peered":"2023-03-08T15:49:40.497106+0000","last_clean":"2023-03-08T15:49:40.497106+0000","last_became_active":"2023-03-08T15:49:39.065033+0000","last_became_peered":"2023-03-08T15:49:39.065033+0000","last_unstale":"2023-03-08T15:49:40.497106+0000","last_undegraded":"2023-03-08T15:49:40.497106+0000","last_fullsized":"2023-03-08T15:49:40.497106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499131+0000","last_change":"2023-03-08T15:49:39.508113+0000","last_active":"2023-03-08T15:49:40.499131+0000","last_peered":"2023-03-08T15:49:40.499131+0000","last_clean":"2023-03-08T15:49:40.499131+0000","last_became_active":"2023-03-08T15:49:39.507782+0000","last_became_peered":"2023-03-08T15:49:39.507782+0000","last_unstale":"2023-03-08T15:49:40.499131+0000","last_undegraded":"2023-03-08T15:49:40.499131+0000","last_fullsized":"2023-03-08T15:49:40.499131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:17:16.405869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.497607+0000","last_change":"2023-03-08T15:49:34.914364+0000","last_active":"2023-03-08T15:49:39.497607+0000","last_peered":"2023-03-08T15:49:39.497607+0000","last_clean":"2023-03-08T15:49:39.497607+0000","last_became_active":"2023-03-08T15:49:34.914037+0000","last_became_peered":"2023-03-08T15:49:34.914037+0000","last_unstale":"2023-03-08T15:49:39.497607+0000","last_undegraded":"2023-03-08T15:49:39.497607+0000","last_fullsized":"2023-03-08T15:49:39.497607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:55:29.151326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516267+0000","last_change":"2023-03-08T15:49:39.071150+0000","last_active":"2023-03-08T15:49:40.516267+0000","last_peered":"2023-03-08T15:49:40.516267+0000","last_clean":"2023-03-08T15:49:40.516267+0000","last_became_active":"2023-03-08T15:49:39.070851+0000","last_became_peered":"2023-03-08T15:49:39.070851+0000","last_unstale":"2023-03-08T15:49:40.516267+0000","last_undegraded":"2023-03-08T15:49:40.516267+0000","last_fullsized":"2023-03-08T15:49:40.516267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498773+0000","last_change":"2023-03-08T15:49:39.513676+0000","last_active":"2023-03-08T15:49:40.498773+0000","last_peered":"2023-03-08T15:49:40.498773+0000","last_clean":"2023-03-08T15:49:40.498773+0000","last_became_active":"2023-03-08T15:49:39.513236+0000","last_became_peered":"2023-03-08T15:49:39.513236+0000","last_unstale":"2023-03-08T15:49:40.498773+0000","last_undegraded":"2023-03-08T15:49:40.498773+0000","last_fullsized":"2023-03-08T15:49:40.498773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:15:10.927104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.500443+0000","last_change":"2023-03-08T15:49:34.036801+0000","last_active":"2023-03-08T15:49:39.500443+0000","last_peered":"2023-03-08T15:49:39.500443+0000","last_clean":"2023-03-08T15:49:39.500443+0000","last_became_active":"2023-03-08T15:49:34.036484+0000","last_became_peered":"2023-03-08T15:49:34.036484+0000","last_unstale":"2023-03-08T15:49:39.500443+0000","last_undegraded":"2023-03-08T15:49:39.500443+0000","last_fullsized":"2023-03-08T15:49:39.500443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498573+0000","last_change":"2023-03-08T15:49:39.077024+0000","last_active":"2023-03-08T15:49:40.498573+0000","last_peered":"2023-03-08T15:49:40.498573+0000","last_clean":"2023-03-08T15:49:40.498573+0000","last_became_active":"2023-03-08T15:49:39.075919+0000","last_became_peered":"2023-03-08T15:49:39.075919+0000","last_unstale":"2023-03-08T15:49:40.498573+0000","last_undegraded":"2023-03-08T15:49:40.498573+0000","last_fullsized":"2023-03-08T15:49:40.498573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:53:57.255123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498923+0000","last_change":"2023-03-08T15:49:39.506861+0000","last_active":"2023-03-08T15:49:40.498923+0000","last_peered":"2023-03-08T15:49:40.498923+0000","last_clean":"2023-03-08T15:49:40.498923+0000","last_became_active":"2023-03-08T15:49:39.506532+0000","last_became_peered":"2023-03-08T15:49:39.506532+0000","last_unstale":"2023-03-08T15:49:40.498923+0000","last_undegraded":"2023-03-08T15:49:40.498923+0000","last_fullsized":"2023-03-08T15:49:40.498923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.494252+0000","last_change":"2023-03-08T15:49:34.968598+0000","last_active":"2023-03-08T15:49:39.494252+0000","last_peered":"2023-03-08T15:49:39.494252+0000","last_clean":"2023-03-08T15:49:39.494252+0000","last_became_active":"2023-03-08T15:49:34.968300+0000","last_became_peered":"2023-03-08T15:49:34.968300+0000","last_unstale":"2023-03-08T15:49:39.494252+0000","last_undegraded":"2023-03-08T15:49:39.494252+0000","last_fullsized":"2023-03-08T15:49:39.494252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:39:14.985725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498575+0000","last_change":"2023-03-08T15:49:39.069250+0000","last_active":"2023-03-08T15:49:40.498575+0000","last_peered":"2023-03-08T15:49:40.498575+0000","last_clean":"2023-03-08T15:49:40.498575+0000","last_became_active":"2023-03-08T15:49:39.068876+0000","last_became_peered":"2023-03-08T15:49:39.068876+0000","last_unstale":"2023-03-08T15:49:40.498575+0000","last_undegraded":"2023-03-08T15:49:40.498575+0000","last_fullsized":"2023-03-08T15:49:40.498575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:53:57.255123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499084+0000","last_change":"2023-03-08T15:49:39.510119+0000","last_active":"2023-03-08T15:49:40.499084+0000","last_peered":"2023-03-08T15:49:40.499084+0000","last_clean":"2023-03-08T15:49:40.499084+0000","last_became_active":"2023-03-08T15:49:39.509867+0000","last_became_peered":"2023-03-08T15:49:39.509867+0000","last_unstale":"2023-03-08T15:49:40.499084+0000","last_undegraded":"2023-03-08T15:49:40.499084+0000","last_fullsized":"2023-03-08T15:49:40.499084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:59:37.837477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.497279+0000","last_change":"2023-03-08T15:49:34.042076+0000","last_active":"2023-03-08T15:49:39.497279+0000","last_peered":"2023-03-08T15:49:39.497279+0000","last_clean":"2023-03-08T15:49:39.497279+0000","last_became_active":"2023-03-08T15:49:34.041670+0000","last_became_peered":"2023-03-08T15:49:34.041670+0000","last_unstale":"2023-03-08T15:49:39.497279+0000","last_undegraded":"2023-03-08T15:49:39.497279+0000","last_fullsized":"2023-03-08T15:49:39.497279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:46:37.870016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.509020+0000","last_change":"2023-03-08T15:49:27.814075+0000","last_active":"2023-03-08T15:49:39.509020+0000","last_peered":"2023-03-08T15:49:39.509020+0000","last_clean":"2023-03-08T15:49:39.509020+0000","last_became_active":"2023-03-08T15:49:27.813798+0000","last_became_peered":"2023-03-08T15:49:27.813798+0000","last_unstale":"2023-03-08T15:49:39.509020+0000","last_undegraded":"2023-03-08T15:49:39.509020+0000","last_fullsized":"2023-03-08T15:49:39.509020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_clean_scrub_stamp":"2023-03-08T15:49:26.430262+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:31:30.865216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497255+0000","last_change":"2023-03-08T15:49:39.067474+0000","last_active":"2023-03-08T15:49:40.497255+0000","last_peered":"2023-03-08T15:49:40.497255+0000","last_clean":"2023-03-08T15:49:40.497255+0000","last_became_active":"2023-03-08T15:49:39.067137+0000","last_became_peered":"2023-03-08T15:49:39.067137+0000","last_unstale":"2023-03-08T15:49:40.497255+0000","last_undegraded":"2023-03-08T15:49:40.497255+0000","last_fullsized":"2023-03-08T15:49:40.497255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:31:20.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516821+0000","last_change":"2023-03-08T15:49:39.514869+0000","last_active":"2023-03-08T15:49:40.516821+0000","last_peered":"2023-03-08T15:49:40.516821+0000","last_clean":"2023-03-08T15:49:40.516821+0000","last_became_active":"2023-03-08T15:49:39.514600+0000","last_became_peered":"2023-03-08T15:49:39.514600+0000","last_unstale":"2023-03-08T15:49:40.516821+0000","last_undegraded":"2023-03-08T15:49:40.516821+0000","last_fullsized":"2023-03-08T15:49:40.516821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:11:06.014260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.509646+0000","last_change":"2023-03-08T15:49:34.042085+0000","last_active":"2023-03-08T15:49:39.509646+0000","last_peered":"2023-03-08T15:49:39.509646+0000","last_clean":"2023-03-08T15:49:39.509646+0000","last_became_active":"2023-03-08T15:49:34.041754+0000","last_became_peered":"2023-03-08T15:49:34.041754+0000","last_unstale":"2023-03-08T15:49:39.509646+0000","last_undegraded":"2023-03-08T15:49:39.509646+0000","last_fullsized":"2023-03-08T15:49:39.509646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.514893+0000","last_change":"2023-03-08T15:49:39.072478+0000","last_active":"2023-03-08T15:49:40.514893+0000","last_peered":"2023-03-08T15:49:40.514893+0000","last_clean":"2023-03-08T15:49:40.514893+0000","last_became_active":"2023-03-08T15:49:39.072186+0000","last_became_peered":"2023-03-08T15:49:39.072186+0000","last_unstale":"2023-03-08T15:49:40.514893+0000","last_undegraded":"2023-03-08T15:49:40.514893+0000","last_fullsized":"2023-03-08T15:49:40.514893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:07:57.155564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515455+0000","last_change":"2023-03-08T15:49:39.511543+0000","last_active":"2023-03-08T15:49:40.515455+0000","last_peered":"2023-03-08T15:49:40.515455+0000","last_clean":"2023-03-08T15:49:40.515455+0000","last_became_active":"2023-03-08T15:49:39.511257+0000","last_became_peered":"2023-03-08T15:49:39.511257+0000","last_unstale":"2023-03-08T15:49:40.515455+0000","last_undegraded":"2023-03-08T15:49:40.515455+0000","last_fullsized":"2023-03-08T15:49:40.515455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:02:38.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.510687+0000","last_change":"2023-03-08T15:49:34.914757+0000","last_active":"2023-03-08T15:49:39.510687+0000","last_peered":"2023-03-08T15:49:39.510687+0000","last_clean":"2023-03-08T15:49:39.510687+0000","last_became_active":"2023-03-08T15:49:34.914391+0000","last_became_peered":"2023-03-08T15:49:34.914391+0000","last_unstale":"2023-03-08T15:49:39.510687+0000","last_undegraded":"2023-03-08T15:49:39.510687+0000","last_fullsized":"2023-03-08T15:49:39.510687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:09:02.620210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498918+0000","last_change":"2023-03-08T15:49:39.069904+0000","last_active":"2023-03-08T15:49:40.498918+0000","last_peered":"2023-03-08T15:49:40.498918+0000","last_clean":"2023-03-08T15:49:40.498918+0000","last_became_active":"2023-03-08T15:49:39.069513+0000","last_became_peered":"2023-03-08T15:49:39.069513+0000","last_unstale":"2023-03-08T15:49:40.498918+0000","last_undegraded":"2023-03-08T15:49:40.498918+0000","last_fullsized":"2023-03-08T15:49:40.498918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:29:04.866450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515223+0000","last_change":"2023-03-08T15:49:39.512846+0000","last_active":"2023-03-08T15:49:40.515223+0000","last_peered":"2023-03-08T15:49:40.515223+0000","last_clean":"2023-03-08T15:49:40.515223+0000","last_became_active":"2023-03-08T15:49:39.512561+0000","last_became_peered":"2023-03-08T15:49:39.512561+0000","last_unstale":"2023-03-08T15:49:40.515223+0000","last_undegraded":"2023-03-08T15:49:40.515223+0000","last_fullsized":"2023-03-08T15:49:40.515223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498020+0000","last_change":"2023-03-08T15:49:39.067777+0000","last_active":"2023-03-08T15:49:40.498020+0000","last_peered":"2023-03-08T15:49:40.498020+0000","last_clean":"2023-03-08T15:49:40.498020+0000","last_became_active":"2023-03-08T15:49:39.067461+0000","last_became_peered":"2023-03-08T15:49:39.067461+0000","last_unstale":"2023-03-08T15:49:40.498020+0000","last_undegraded":"2023-03-08T15:49:40.498020+0000","last_fullsized":"2023-03-08T15:49:40.498020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:21.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.498744+0000","last_change":"2023-03-08T15:49:34.039636+0000","last_active":"2023-03-08T15:49:39.498744+0000","last_peered":"2023-03-08T15:49:39.498744+0000","last_clean":"2023-03-08T15:49:39.498744+0000","last_became_active":"2023-03-08T15:49:34.039383+0000","last_became_peered":"2023-03-08T15:49:34.039383+0000","last_unstale":"2023-03-08T15:49:39.498744+0000","last_undegraded":"2023-03-08T15:49:39.498744+0000","last_fullsized":"2023-03-08T15:49:39.498744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:27:38.358539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497091+0000","last_change":"2023-03-08T15:49:39.518195+0000","last_active":"2023-03-08T15:49:40.497091+0000","last_peered":"2023-03-08T15:49:40.497091+0000","last_clean":"2023-03-08T15:49:40.497091+0000","last_became_active":"2023-03-08T15:49:39.517992+0000","last_became_peered":"2023-03-08T15:49:39.517992+0000","last_unstale":"2023-03-08T15:49:40.497091+0000","last_undegraded":"2023-03-08T15:49:40.497091+0000","last_fullsized":"2023-03-08T15:49:40.497091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.498866+0000","last_change":"2023-03-08T15:49:34.040711+0000","last_active":"2023-03-08T15:49:39.498866+0000","last_peered":"2023-03-08T15:49:39.498866+0000","last_clean":"2023-03-08T15:49:39.498866+0000","last_became_active":"2023-03-08T15:49:34.040328+0000","last_became_peered":"2023-03-08T15:49:34.040328+0000","last_unstale":"2023-03-08T15:49:39.498866+0000","last_undegraded":"2023-03-08T15:49:39.498866+0000","last_fullsized":"2023-03-08T15:49:39.498866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:34:43.169713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515410+0000","last_change":"2023-03-08T15:49:39.073837+0000","last_active":"2023-03-08T15:49:40.515410+0000","last_peered":"2023-03-08T15:49:40.515410+0000","last_clean":"2023-03-08T15:49:40.515410+0000","last_became_active":"2023-03-08T15:49:39.073103+0000","last_became_peered":"2023-03-08T15:49:39.073103+0000","last_unstale":"2023-03-08T15:49:40.515410+0000","last_undegraded":"2023-03-08T15:49:40.515410+0000","last_fullsized":"2023-03-08T15:49:40.515410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:53:57.255123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498138+0000","last_change":"2023-03-08T15:49:39.506282+0000","last_active":"2023-03-08T15:49:40.498138+0000","last_peered":"2023-03-08T15:49:40.498138+0000","last_clean":"2023-03-08T15:49:40.498138+0000","last_became_active":"2023-03-08T15:49:39.505963+0000","last_became_peered":"2023-03-08T15:49:39.505963+0000","last_unstale":"2023-03-08T15:49:40.498138+0000","last_undegraded":"2023-03-08T15:49:40.498138+0000","last_fullsized":"2023-03-08T15:49:40.498138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:18:53.422253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515312+0000","last_change":"2023-03-08T15:49:39.077529+0000","last_active":"2023-03-08T15:49:40.515312+0000","last_peered":"2023-03-08T15:49:40.515312+0000","last_clean":"2023-03-08T15:49:40.515312+0000","last_became_active":"2023-03-08T15:49:39.077214+0000","last_became_peered":"2023-03-08T15:49:39.077214+0000","last_unstale":"2023-03-08T15:49:40.515312+0000","last_undegraded":"2023-03-08T15:49:40.515312+0000","last_fullsized":"2023-03-08T15:49:40.515312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:31:20.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515304+0000","last_change":"2023-03-08T15:49:39.505582+0000","last_active":"2023-03-08T15:49:40.515304+0000","last_peered":"2023-03-08T15:49:40.515304+0000","last_clean":"2023-03-08T15:49:40.515304+0000","last_became_active":"2023-03-08T15:49:39.505317+0000","last_became_peered":"2023-03-08T15:49:39.505317+0000","last_unstale":"2023-03-08T15:49:40.515304+0000","last_undegraded":"2023-03-08T15:49:40.515304+0000","last_fullsized":"2023-03-08T15:49:40.515304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:31:21.040757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515757+0000","last_change":"2023-03-08T15:49:39.074108+0000","last_active":"2023-03-08T15:49:40.515757+0000","last_peered":"2023-03-08T15:49:40.515757+0000","last_clean":"2023-03-08T15:49:40.515757+0000","last_became_active":"2023-03-08T15:49:39.073843+0000","last_became_peered":"2023-03-08T15:49:39.073843+0000","last_unstale":"2023-03-08T15:49:40.515757+0000","last_undegraded":"2023-03-08T15:49:40.515757+0000","last_fullsized":"2023-03-08T15:49:40.515757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:13:15.662118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498719+0000","last_change":"2023-03-08T15:49:39.506927+0000","last_active":"2023-03-08T15:49:40.498719+0000","last_peered":"2023-03-08T15:49:40.498719+0000","last_clean":"2023-03-08T15:49:40.498719+0000","last_became_active":"2023-03-08T15:49:39.505636+0000","last_became_peered":"2023-03-08T15:49:39.505636+0000","last_unstale":"2023-03-08T15:49:40.498719+0000","last_undegraded":"2023-03-08T15:49:40.498719+0000","last_fullsized":"2023-03-08T15:49:40.498719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:21:33.395756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516368+0000","last_change":"2023-03-08T15:49:39.073044+0000","last_active":"2023-03-08T15:49:40.516368+0000","last_peered":"2023-03-08T15:49:40.516368+0000","last_clean":"2023-03-08T15:49:40.516368+0000","last_became_active":"2023-03-08T15:49:39.072756+0000","last_became_peered":"2023-03-08T15:49:39.072756+0000","last_unstale":"2023-03-08T15:49:40.516368+0000","last_undegraded":"2023-03-08T15:49:40.516368+0000","last_fullsized":"2023-03-08T15:49:40.516368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:03.536123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498753+0000","last_change":"2023-03-08T15:49:39.500630+0000","last_active":"2023-03-08T15:49:40.498753+0000","last_peered":"2023-03-08T15:49:40.498753+0000","last_clean":"2023-03-08T15:49:40.498753+0000","last_became_active":"2023-03-08T15:49:39.500345+0000","last_became_peered":"2023-03-08T15:49:39.500345+0000","last_unstale":"2023-03-08T15:49:40.498753+0000","last_undegraded":"2023-03-08T15:49:40.498753+0000","last_fullsized":"2023-03-08T15:49:40.498753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:41:05.974121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497768+0000","last_change":"2023-03-08T15:49:39.066336+0000","last_active":"2023-03-08T15:49:40.497768+0000","last_peered":"2023-03-08T15:49:40.497768+0000","last_clean":"2023-03-08T15:49:40.497768+0000","last_became_active":"2023-03-08T15:49:39.066086+0000","last_became_peered":"2023-03-08T15:49:39.066086+0000","last_unstale":"2023-03-08T15:49:40.497768+0000","last_undegraded":"2023-03-08T15:49:40.497768+0000","last_fullsized":"2023-03-08T15:49:40.497768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497183+0000","last_change":"2023-03-08T15:49:39.501364+0000","last_active":"2023-03-08T15:49:40.497183+0000","last_peered":"2023-03-08T15:49:40.497183+0000","last_clean":"2023-03-08T15:49:40.497183+0000","last_became_active":"2023-03-08T15:49:39.501117+0000","last_became_peered":"2023-03-08T15:49:39.501117+0000","last_unstale":"2023-03-08T15:49:40.497183+0000","last_undegraded":"2023-03-08T15:49:40.497183+0000","last_fullsized":"2023-03-08T15:49:40.497183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:09:32.633312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515603+0000","last_change":"2023-03-08T15:49:39.070288+0000","last_active":"2023-03-08T15:49:40.515603+0000","last_peered":"2023-03-08T15:49:40.515603+0000","last_clean":"2023-03-08T15:49:40.515603+0000","last_became_active":"2023-03-08T15:49:39.069630+0000","last_became_peered":"2023-03-08T15:49:39.069630+0000","last_unstale":"2023-03-08T15:49:40.515603+0000","last_undegraded":"2023-03-08T15:49:40.515603+0000","last_fullsized":"2023-03-08T15:49:40.515603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498057+0000","last_change":"2023-03-08T15:49:39.504481+0000","last_active":"2023-03-08T15:49:40.498057+0000","last_peered":"2023-03-08T15:49:40.498057+0000","last_clean":"2023-03-08T15:49:40.498057+0000","last_became_active":"2023-03-08T15:49:39.504153+0000","last_became_peered":"2023-03-08T15:49:39.504153+0000","last_unstale":"2023-03-08T15:49:40.498057+0000","last_undegraded":"2023-03-08T15:49:40.498057+0000","last_fullsized":"2023-03-08T15:49:40.498057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:35:39.586275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515765+0000","last_change":"2023-03-08T15:49:39.512615+0000","last_active":"2023-03-08T15:49:40.515765+0000","last_peered":"2023-03-08T15:49:40.515765+0000","last_clean":"2023-03-08T15:49:40.515765+0000","last_became_active":"2023-03-08T15:49:39.511936+0000","last_became_peered":"2023-03-08T15:49:39.511936+0000","last_unstale":"2023-03-08T15:49:40.515765+0000","last_undegraded":"2023-03-08T15:49:40.515765+0000","last_fullsized":"2023-03-08T15:49:40.515765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:13:16.666986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497118+0000","last_change":"2023-03-08T15:49:39.506060+0000","last_active":"2023-03-08T15:49:40.497118+0000","last_peered":"2023-03-08T15:49:40.497118+0000","last_clean":"2023-03-08T15:49:40.497118+0000","last_became_active":"2023-03-08T15:49:39.505789+0000","last_became_peered":"2023-03-08T15:49:39.505789+0000","last_unstale":"2023-03-08T15:49:40.497118+0000","last_undegraded":"2023-03-08T15:49:40.497118+0000","last_fullsized":"2023-03-08T15:49:40.497118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:09:02.915110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498616+0000","last_change":"2023-03-08T15:49:39.504399+0000","last_active":"2023-03-08T15:49:40.498616+0000","last_peered":"2023-03-08T15:49:40.498616+0000","last_clean":"2023-03-08T15:49:40.498616+0000","last_became_active":"2023-03-08T15:49:39.504110+0000","last_became_peered":"2023-03-08T15:49:39.504110+0000","last_unstale":"2023-03-08T15:49:40.498616+0000","last_undegraded":"2023-03-08T15:49:40.498616+0000","last_fullsized":"2023-03-08T15:49:40.498616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:31:20.377122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497746+0000","last_change":"2023-03-08T15:49:39.517458+0000","last_active":"2023-03-08T15:49:40.497746+0000","last_peered":"2023-03-08T15:49:40.497746+0000","last_clean":"2023-03-08T15:49:40.497746+0000","last_became_active":"2023-03-08T15:49:39.517225+0000","last_became_peered":"2023-03-08T15:49:39.517225+0000","last_unstale":"2023-03-08T15:49:40.497746+0000","last_undegraded":"2023-03-08T15:49:40.497746+0000","last_fullsized":"2023-03-08T15:49:40.497746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498811+0000","last_change":"2023-03-08T15:49:39.518670+0000","last_active":"2023-03-08T15:49:40.498811+0000","last_peered":"2023-03-08T15:49:40.498811+0000","last_clean":"2023-03-08T15:49:40.498811+0000","last_became_active":"2023-03-08T15:49:39.518430+0000","last_became_peered":"2023-03-08T15:49:39.518430+0000","last_unstale":"2023-03-08T15:49:40.498811+0000","last_undegraded":"2023-03-08T15:49:40.498811+0000","last_fullsized":"2023-03-08T15:49:40.498811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":681731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8052,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363788,"statfs":{"total":96636764160,"available":96628518912,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9084,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362756,"statfs":{"total":96636764160,"available":96627462144,"internally_reserved":0,"allocated":839680,"data_stored":680533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7924,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363916,"statfs":{"total":96636764160,"available":96628649984,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":91203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":90235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-08T15:49:43.582 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-08T15:49:43.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.732+0000 7f8c49fee700 1 Processor -- start 2023-03-08T15:49:43.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.732+0000 7f8c49fee700 1 -- start start 2023-03-08T15:49:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.733+0000 7f8c49fee700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8c4406f8d0 0x7f8c440b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.733+0000 7f8c49fee700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8c44140980 0x7f8c44140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.733+0000 7f8c49fee700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c44071280 con 0x7f8c4406b530 2023-03-08T15:49:43.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.733+0000 7f8c49fee700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c44071630 con 0x7f8c44140980 2023-03-08T15:49:43.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.733+0000 7f8c49fee700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4414a720 con 0x7f8c4406f8d0 2023-03-08T15:49:43.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.733+0000 7f8c43fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8c44140980 0x7f8c44140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.733+0000 7f8c43fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8c44140980 0x7f8c44140dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53644/0 (socket says 172.21.15.123:53644) 2023-03-08T15:49:43.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.733+0000 7f8c43fff700 1 -- 172.21.15.123:0/3407598316 learned_addr learned my addr 172.21.15.123:0/3407598316 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:43.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.733+0000 7f8c42ffd700 1 --2- 172.21.15.123:0/3407598316 >> v2:172.21.15.175:3300/0 conn(0x7f8c4406f8d0 0x7f8c440b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.733+0000 7f8c43fff700 1 -- 172.21.15.123:0/3407598316 >> v2:172.21.15.175:3300/0 conn(0x7f8c4406f8d0 msgr2=0x7f8c440b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:43.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.733+0000 7f8c43fff700 1 --2- 172.21.15.123:0/3407598316 >> v2:172.21.15.175:3300/0 conn(0x7f8c4406f8d0 0x7f8c440b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.733+0000 7f8c43fff700 1 -- 172.21.15.123:0/3407598316 >> v1:172.21.15.175:6789/0 conn(0x7f8c4406b530 legacy=0x7f8c4414a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:43.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.733+0000 7f8c43fff700 1 -- 172.21.15.123:0/3407598316 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c44072020 con 0x7f8c44140980 2023-03-08T15:49:43.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.733+0000 7f8c43fff700 1 --2- 172.21.15.123:0/3407598316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c44140980 0x7f8c44140dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8c44144670 tx=0x7f8c3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ae8b55b5c4c4f2 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:43.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.734+0000 7f8c427fc700 1 -- 172.21.15.123:0/3407598316 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c00e070 con 0x7f8c44140980 2023-03-08T15:49:43.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.734+0000 7f8c427fc700 1 -- 172.21.15.123:0/3407598316 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3c003a20 con 0x7f8c44140980 2023-03-08T15:49:43.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.734+0000 7f8c427fc700 1 -- 172.21.15.123:0/3407598316 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c003dd0 con 0x7f8c44140980 2023-03-08T15:49:43.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.734+0000 7f8c49fee700 1 -- 172.21.15.123:0/3407598316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c44140980 msgr2=0x7f8c44140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.734+0000 7f8c49fee700 1 --2- 172.21.15.123:0/3407598316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c44140980 0x7f8c44140dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8c44144670 tx=0x7f8c3c00b330 comp rx=0 tx=0).stop 2023-03-08T15:49:43.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.734+0000 7f8c49fee700 1 -- 172.21.15.123:0/3407598316 shutdown_connections 2023-03-08T15:49:43.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.734+0000 7f8c49fee700 1 --2- 172.21.15.123:0/3407598316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c44140980 0x7f8c44140dc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.734+0000 7f8c49fee700 1 --2- 172.21.15.123:0/3407598316 >> v2:172.21.15.175:3300/0 conn(0x7f8c4406f8d0 0x7f8c440b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.734+0000 7f8c49fee700 1 -- 172.21.15.123:0/3407598316 >> 172.21.15.123:0/3407598316 conn(0x7f8c440ba3c0 msgr2=0x7f8c440bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:43.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.734+0000 7f8c49fee700 1 -- 172.21.15.123:0/3407598316 shutdown_connections 2023-03-08T15:49:43.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.734+0000 7f8c49fee700 1 -- 172.21.15.123:0/3407598316 wait complete. 2023-03-08T15:49:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.735+0000 7f8c49fee700 1 Processor -- start 2023-03-08T15:49:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.735+0000 7f8c49fee700 1 -- start start 2023-03-08T15:49:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c49fee700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c4406b530 0x7f8c44138370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c49fee700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c4406f8d0 0x7f8c441413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c49fee700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c44140980 0x7f8c44135040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c49fee700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c440b73a0 con 0x7f8c44140980 2023-03-08T15:49:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c49fee700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c440b8f10 con 0x7f8c4406b530 2023-03-08T15:49:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c49fee700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c44149560 con 0x7f8c4406f8d0 2023-03-08T15:49:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c43fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c44140980 0x7f8c44135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c43fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c44140980 0x7f8c44135040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53654/0 (socket says 172.21.15.123:53654) 2023-03-08T15:49:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c43fff700 1 -- 172.21.15.123:0/4115393491 learned_addr learned my addr 172.21.15.123:0/4115393491 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c42ffd700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c4406f8d0 0x7f8c441413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c437fe700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c4406b530 0x7f8c44138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c43fff700 1 -- 172.21.15.123:0/4115393491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c4406f8d0 msgr2=0x7f8c441413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c43fff700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c4406f8d0 0x7f8c441413b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c43fff700 1 -- 172.21.15.123:0/4115393491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c4406b530 msgr2=0x7f8c44138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c43fff700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c4406b530 0x7f8c44138370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c43fff700 1 -- 172.21.15.123:0/4115393491 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c009b30 con 0x7f8c44140980 2023-03-08T15:49:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c42ffd700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c4406f8d0 0x7f8c441413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.736+0000 7f8c437fe700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c4406b530 0x7f8c44138370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.737+0000 7f8c43fff700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c44140980 0x7f8c44135040 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c015040 tx=0x7f8c3c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.737+0000 7f8c2bfff700 1 -- 172.21.15.123:0/4115393491 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c004440 con 0x7f8c44140980 2023-03-08T15:49:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.737+0000 7f8c2bfff700 1 -- 172.21.15.123:0/4115393491 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3c0045a0 con 0x7f8c44140980 2023-03-08T15:49:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.737+0000 7f8c49fee700 1 -- 172.21.15.123:0/4115393491 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c44071820 con 0x7f8c44140980 2023-03-08T15:49:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.737+0000 7f8c2bfff700 1 -- 172.21.15.123:0/4115393491 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c0092e0 con 0x7f8c44140980 2023-03-08T15:49:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.737+0000 7f8c49fee700 1 -- 172.21.15.123:0/4115393491 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4406fe60 con 0x7f8c44140980 2023-03-08T15:49:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.738+0000 7f8c49fee700 1 -- 172.21.15.123:0/4115393491 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c44071b00 con 0x7f8c44140980 2023-03-08T15:49:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.738+0000 7f8c2bfff700 1 -- 172.21.15.123:0/4115393491 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f8c3c022030 con 0x7f8c44140980 2023-03-08T15:49:43.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.738+0000 7f8c2bfff700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8c300698d0 0x7f8c3006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:43.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.738+0000 7f8c2bfff700 1 -- 172.21.15.123:0/4115393491 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c3c088b90 con 0x7f8c44140980 2023-03-08T15:49:43.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.739+0000 7f8c437fe700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8c300698d0 0x7f8c3006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:43.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.739+0000 7f8c437fe700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8c300698d0 0x7f8c3006bd80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c38003fc0 tx=0x7f8c38009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:43.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.743+0000 7f8c2bfff700 1 -- 172.21.15.123:0/4115393491 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f8c3c0547f0 con 0x7f8c44140980 2023-03-08T15:49:43.925 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.924+0000 7f8c49fee700 1 -- 172.21.15.123:0/4115393491 --> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c441496d0 con 0x7f8c300698d0 2023-03-08T15:49:43.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.932+0000 7f8c2bfff700 1 -- 172.21.15.123:0/4115393491 <== mgr.4098 v2:172.21.15.123:6832/142884 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286685 (secure 0 0 0) 0x7f8c441496d0 con 0x7f8c300698d0 2023-03-08T15:49:43.936 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:43.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.935+0000 7f8c49fee700 1 -- 172.21.15.123:0/4115393491 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8c300698d0 msgr2=0x7f8c3006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.937 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.935+0000 7f8c49fee700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8c300698d0 0x7f8c3006bd80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c38003fc0 tx=0x7f8c38009040 comp rx=0 tx=0).stop 2023-03-08T15:49:43.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.935+0000 7f8c49fee700 1 -- 172.21.15.123:0/4115393491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c44140980 msgr2=0x7f8c44135040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:43.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.935+0000 7f8c49fee700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c44140980 0x7f8c44135040 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c015040 tx=0x7f8c3c004ad0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.935+0000 7f8c49fee700 1 -- 172.21.15.123:0/4115393491 shutdown_connections 2023-03-08T15:49:43.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.935+0000 7f8c49fee700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c44140980 0x7f8c44135040 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.935+0000 7f8c49fee700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c4406b530 0x7f8c44138370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.935+0000 7f8c49fee700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8c300698d0 0x7f8c3006bd80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.938 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.935+0000 7f8c49fee700 1 --2- 172.21.15.123:0/4115393491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c4406f8d0 0x7f8c441413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:43.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.935+0000 7f8c49fee700 1 -- 172.21.15.123:0/4115393491 >> 172.21.15.123:0/4115393491 conn(0x7f8c440ba3c0 msgr2=0x7f8c4413c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:43.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.935+0000 7f8c49fee700 1 -- 172.21.15.123:0/4115393491 shutdown_connections 2023-03-08T15:49:43.939 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:43.935+0000 7f8c49fee700 1 -- 172.21.15.123:0/4115393491 wait complete. 2023-03-08T15:49:43.939 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-03-08T15:49:43.948 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-03-08T15:49:41.972679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66280,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908440,"statfs":{"total":773094113280,"available":773026242560,"internally_reserved":0,"allocated":3186688,"data_stored":1902188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000906"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515200+0000","last_change":"2023-03-08T15:49:39.500574+0000","last_active":"2023-03-08T15:49:40.515200+0000","last_peered":"2023-03-08T15:49:40.515200+0000","last_clean":"2023-03-08T15:49:40.515200+0000","last_became_active":"2023-03-08T15:49:39.500324+0000","last_became_peered":"2023-03-08T15:49:39.500324+0000","last_unstale":"2023-03-08T15:49:40.515200+0000","last_undegraded":"2023-03-08T15:49:40.515200+0000","last_fullsized":"2023-03-08T15:49:40.515200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:54.873584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516498+0000","last_change":"2023-03-08T15:49:39.510529+0000","last_active":"2023-03-08T15:49:40.516498+0000","last_peered":"2023-03-08T15:49:40.516498+0000","last_clean":"2023-03-08T15:49:40.516498+0000","last_became_active":"2023-03-08T15:49:39.510227+0000","last_became_peered":"2023-03-08T15:49:39.510227+0000","last_unstale":"2023-03-08T15:49:40.516498+0000","last_undegraded":"2023-03-08T15:49:40.516498+0000","last_fullsized":"2023-03-08T15:49:40.516498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498504+0000","last_change":"2023-03-08T15:49:39.507276+0000","last_active":"2023-03-08T15:49:40.498504+0000","last_peered":"2023-03-08T15:49:40.498504+0000","last_clean":"2023-03-08T15:49:40.498504+0000","last_became_active":"2023-03-08T15:49:39.506954+0000","last_became_peered":"2023-03-08T15:49:39.506954+0000","last_unstale":"2023-03-08T15:49:40.498504+0000","last_undegraded":"2023-03-08T15:49:40.498504+0000","last_fullsized":"2023-03-08T15:49:40.498504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516428+0000","last_change":"2023-03-08T15:49:39.511677+0000","last_active":"2023-03-08T15:49:40.516428+0000","last_peered":"2023-03-08T15:49:40.516428+0000","last_clean":"2023-03-08T15:49:40.516428+0000","last_became_active":"2023-03-08T15:49:39.508018+0000","last_became_peered":"2023-03-08T15:49:39.508018+0000","last_unstale":"2023-03-08T15:49:40.516428+0000","last_undegraded":"2023-03-08T15:49:40.516428+0000","last_fullsized":"2023-03-08T15:49:40.516428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:08:10.089458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515126+0000","last_change":"2023-03-08T15:49:39.509835+0000","last_active":"2023-03-08T15:49:40.515126+0000","last_peered":"2023-03-08T15:49:40.515126+0000","last_clean":"2023-03-08T15:49:40.515126+0000","last_became_active":"2023-03-08T15:49:39.507785+0000","last_became_peered":"2023-03-08T15:49:39.507785+0000","last_unstale":"2023-03-08T15:49:40.515126+0000","last_undegraded":"2023-03-08T15:49:40.515126+0000","last_fullsized":"2023-03-08T15:49:40.515126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:41:05.974121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498456+0000","last_change":"2023-03-08T15:49:39.514008+0000","last_active":"2023-03-08T15:49:40.498456+0000","last_peered":"2023-03-08T15:49:40.498456+0000","last_clean":"2023-03-08T15:49:40.498456+0000","last_became_active":"2023-03-08T15:49:39.508486+0000","last_became_peered":"2023-03-08T15:49:39.508486+0000","last_unstale":"2023-03-08T15:49:40.498456+0000","last_undegraded":"2023-03-08T15:49:40.498456+0000","last_fullsized":"2023-03-08T15:49:40.498456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:00:34.312638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515812+0000","last_change":"2023-03-08T15:49:39.517513+0000","last_active":"2023-03-08T15:49:40.515812+0000","last_peered":"2023-03-08T15:49:40.515812+0000","last_clean":"2023-03-08T15:49:40.515812+0000","last_became_active":"2023-03-08T15:49:39.517157+0000","last_became_peered":"2023-03-08T15:49:39.517157+0000","last_unstale":"2023-03-08T15:49:40.515812+0000","last_undegraded":"2023-03-08T15:49:40.515812+0000","last_fullsized":"2023-03-08T15:49:40.515812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515450+0000","last_change":"2023-03-08T15:49:39.515299+0000","last_active":"2023-03-08T15:49:40.515450+0000","last_peered":"2023-03-08T15:49:40.515450+0000","last_clean":"2023-03-08T15:49:40.515450+0000","last_became_active":"2023-03-08T15:49:39.515005+0000","last_became_peered":"2023-03-08T15:49:39.515005+0000","last_unstale":"2023-03-08T15:49:40.515450+0000","last_undegraded":"2023-03-08T15:49:40.515450+0000","last_fullsized":"2023-03-08T15:49:40.515450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:07:36.774920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515469+0000","last_change":"2023-03-08T15:49:39.511832+0000","last_active":"2023-03-08T15:49:40.515469+0000","last_peered":"2023-03-08T15:49:40.515469+0000","last_clean":"2023-03-08T15:49:40.515469+0000","last_became_active":"2023-03-08T15:49:39.511580+0000","last_became_peered":"2023-03-08T15:49:39.511580+0000","last_unstale":"2023-03-08T15:49:40.515469+0000","last_undegraded":"2023-03-08T15:49:40.515469+0000","last_fullsized":"2023-03-08T15:49:40.515469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516671+0000","last_change":"2023-03-08T15:49:39.509905+0000","last_active":"2023-03-08T15:49:40.516671+0000","last_peered":"2023-03-08T15:49:40.516671+0000","last_clean":"2023-03-08T15:49:40.516671+0000","last_became_active":"2023-03-08T15:49:39.509656+0000","last_became_peered":"2023-03-08T15:49:39.509656+0000","last_unstale":"2023-03-08T15:49:40.516671+0000","last_undegraded":"2023-03-08T15:49:40.516671+0000","last_fullsized":"2023-03-08T15:49:40.516671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:02:38.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498546+0000","last_change":"2023-03-08T15:49:39.512652+0000","last_active":"2023-03-08T15:49:40.498546+0000","last_peered":"2023-03-08T15:49:40.498546+0000","last_clean":"2023-03-08T15:49:40.498546+0000","last_became_active":"2023-03-08T15:49:39.512339+0000","last_became_peered":"2023-03-08T15:49:39.512339+0000","last_unstale":"2023-03-08T15:49:40.498546+0000","last_undegraded":"2023-03-08T15:49:40.498546+0000","last_fullsized":"2023-03-08T15:49:40.498546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515136+0000","last_change":"2023-03-08T15:49:39.501468+0000","last_active":"2023-03-08T15:49:40.515136+0000","last_peered":"2023-03-08T15:49:40.515136+0000","last_clean":"2023-03-08T15:49:40.515136+0000","last_became_active":"2023-03-08T15:49:39.501217+0000","last_became_peered":"2023-03-08T15:49:39.501217+0000","last_unstale":"2023-03-08T15:49:40.515136+0000","last_undegraded":"2023-03-08T15:49:40.515136+0000","last_fullsized":"2023-03-08T15:49:40.515136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:04.540991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515081+0000","last_change":"2023-03-08T15:49:39.500058+0000","last_active":"2023-03-08T15:49:40.515081+0000","last_peered":"2023-03-08T15:49:40.515081+0000","last_clean":"2023-03-08T15:49:40.515081+0000","last_became_active":"2023-03-08T15:49:39.499799+0000","last_became_peered":"2023-03-08T15:49:39.499799+0000","last_unstale":"2023-03-08T15:49:40.515081+0000","last_undegraded":"2023-03-08T15:49:40.515081+0000","last_fullsized":"2023-03-08T15:49:40.515081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:22.868366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516068+0000","last_change":"2023-03-08T15:49:39.509813+0000","last_active":"2023-03-08T15:49:40.516068+0000","last_peered":"2023-03-08T15:49:40.516068+0000","last_clean":"2023-03-08T15:49:40.516068+0000","last_became_active":"2023-03-08T15:49:39.509515+0000","last_became_peered":"2023-03-08T15:49:39.509515+0000","last_unstale":"2023-03-08T15:49:40.516068+0000","last_undegraded":"2023-03-08T15:49:40.516068+0000","last_fullsized":"2023-03-08T15:49:40.516068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516019+0000","last_change":"2023-03-08T15:49:39.517988+0000","last_active":"2023-03-08T15:49:40.516019+0000","last_peered":"2023-03-08T15:49:40.516019+0000","last_clean":"2023-03-08T15:49:40.516019+0000","last_became_active":"2023-03-08T15:49:39.517729+0000","last_became_peered":"2023-03-08T15:49:39.517729+0000","last_unstale":"2023-03-08T15:49:40.516019+0000","last_undegraded":"2023-03-08T15:49:40.516019+0000","last_fullsized":"2023-03-08T15:49:40.516019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498160+0000","last_change":"2023-03-08T15:49:39.507303+0000","last_active":"2023-03-08T15:49:40.498160+0000","last_peered":"2023-03-08T15:49:40.498160+0000","last_clean":"2023-03-08T15:49:40.498160+0000","last_became_active":"2023-03-08T15:49:39.506847+0000","last_became_peered":"2023-03-08T15:49:39.506847+0000","last_unstale":"2023-03-08T15:49:40.498160+0000","last_undegraded":"2023-03-08T15:49:40.498160+0000","last_fullsized":"2023-03-08T15:49:40.498160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:55:21.101920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515522+0000","last_change":"2023-03-08T15:49:39.511674+0000","last_active":"2023-03-08T15:49:40.515522+0000","last_peered":"2023-03-08T15:49:40.515522+0000","last_clean":"2023-03-08T15:49:40.515522+0000","last_became_active":"2023-03-08T15:49:39.511293+0000","last_became_peered":"2023-03-08T15:49:39.511293+0000","last_unstale":"2023-03-08T15:49:40.515522+0000","last_undegraded":"2023-03-08T15:49:40.515522+0000","last_fullsized":"2023-03-08T15:49:40.515522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:15:10.927104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498599+0000","last_change":"2023-03-08T15:49:39.507528+0000","last_active":"2023-03-08T15:49:40.498599+0000","last_peered":"2023-03-08T15:49:40.498599+0000","last_clean":"2023-03-08T15:49:40.498599+0000","last_became_active":"2023-03-08T15:49:39.507193+0000","last_became_peered":"2023-03-08T15:49:39.507193+0000","last_unstale":"2023-03-08T15:49:40.498599+0000","last_undegraded":"2023-03-08T15:49:40.498599+0000","last_fullsized":"2023-03-08T15:49:40.498599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:09:02.915110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515398+0000","last_change":"2023-03-08T15:49:39.503980+0000","last_active":"2023-03-08T15:49:40.515398+0000","last_peered":"2023-03-08T15:49:40.515398+0000","last_clean":"2023-03-08T15:49:40.515398+0000","last_became_active":"2023-03-08T15:49:39.503703+0000","last_became_peered":"2023-03-08T15:49:39.503703+0000","last_unstale":"2023-03-08T15:49:40.515398+0000","last_undegraded":"2023-03-08T15:49:40.515398+0000","last_fullsized":"2023-03-08T15:49:40.515398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:45.599141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498726+0000","last_change":"2023-03-08T15:49:39.505726+0000","last_active":"2023-03-08T15:49:40.498726+0000","last_peered":"2023-03-08T15:49:40.498726+0000","last_clean":"2023-03-08T15:49:40.498726+0000","last_became_active":"2023-03-08T15:49:39.505103+0000","last_became_peered":"2023-03-08T15:49:39.505103+0000","last_unstale":"2023-03-08T15:49:40.498726+0000","last_undegraded":"2023-03-08T15:49:40.498726+0000","last_fullsized":"2023-03-08T15:49:40.498726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:01:00.216256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516218+0000","last_change":"2023-03-08T15:49:39.520100+0000","last_active":"2023-03-08T15:49:40.516218+0000","last_peered":"2023-03-08T15:49:40.516218+0000","last_clean":"2023-03-08T15:49:40.516218+0000","last_became_active":"2023-03-08T15:49:39.519799+0000","last_became_peered":"2023-03-08T15:49:39.519799+0000","last_unstale":"2023-03-08T15:49:40.516218+0000","last_undegraded":"2023-03-08T15:49:40.516218+0000","last_fullsized":"2023-03-08T15:49:40.516218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515704+0000","last_change":"2023-03-08T15:49:39.513354+0000","last_active":"2023-03-08T15:49:40.515704+0000","last_peered":"2023-03-08T15:49:40.515704+0000","last_clean":"2023-03-08T15:49:40.515704+0000","last_became_active":"2023-03-08T15:49:39.513104+0000","last_became_peered":"2023-03-08T15:49:39.513104+0000","last_unstale":"2023-03-08T15:49:40.515704+0000","last_undegraded":"2023-03-08T15:49:40.515704+0000","last_fullsized":"2023-03-08T15:49:40.515704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497212+0000","last_change":"2023-03-08T15:49:39.505113+0000","last_active":"2023-03-08T15:49:40.497212+0000","last_peered":"2023-03-08T15:49:40.497212+0000","last_clean":"2023-03-08T15:49:40.497212+0000","last_became_active":"2023-03-08T15:49:39.504875+0000","last_became_peered":"2023-03-08T15:49:39.504875+0000","last_unstale":"2023-03-08T15:49:40.497212+0000","last_undegraded":"2023-03-08T15:49:40.497212+0000","last_fullsized":"2023-03-08T15:49:40.497212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:03:30.032957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516293+0000","last_change":"2023-03-08T15:49:39.520457+0000","last_active":"2023-03-08T15:49:40.516293+0000","last_peered":"2023-03-08T15:49:40.516293+0000","last_clean":"2023-03-08T15:49:40.516293+0000","last_became_active":"2023-03-08T15:49:39.520170+0000","last_became_peered":"2023-03-08T15:49:39.520170+0000","last_unstale":"2023-03-08T15:49:40.516293+0000","last_undegraded":"2023-03-08T15:49:40.516293+0000","last_fullsized":"2023-03-08T15:49:40.516293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499040+0000","last_change":"2023-03-08T15:49:39.505287+0000","last_active":"2023-03-08T15:49:40.499040+0000","last_peered":"2023-03-08T15:49:40.499040+0000","last_clean":"2023-03-08T15:49:40.499040+0000","last_became_active":"2023-03-08T15:49:39.505030+0000","last_became_peered":"2023-03-08T15:49:39.505030+0000","last_unstale":"2023-03-08T15:49:40.499040+0000","last_undegraded":"2023-03-08T15:49:40.499040+0000","last_fullsized":"2023-03-08T15:49:40.499040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:42:50.682185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499114+0000","last_change":"2023-03-08T15:49:39.509614+0000","last_active":"2023-03-08T15:49:40.499114+0000","last_peered":"2023-03-08T15:49:40.499114+0000","last_clean":"2023-03-08T15:49:40.499114+0000","last_became_active":"2023-03-08T15:49:39.509049+0000","last_became_peered":"2023-03-08T15:49:39.509049+0000","last_unstale":"2023-03-08T15:49:40.499114+0000","last_undegraded":"2023-03-08T15:49:40.499114+0000","last_fullsized":"2023-03-08T15:49:40.499114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516066+0000","last_change":"2023-03-08T15:49:39.518389+0000","last_active":"2023-03-08T15:49:40.516066+0000","last_peered":"2023-03-08T15:49:40.516066+0000","last_clean":"2023-03-08T15:49:40.516066+0000","last_became_active":"2023-03-08T15:49:39.518107+0000","last_became_peered":"2023-03-08T15:49:39.518107+0000","last_unstale":"2023-03-08T15:49:40.516066+0000","last_undegraded":"2023-03-08T15:49:40.516066+0000","last_fullsized":"2023-03-08T15:49:40.516066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498736+0000","last_change":"2023-03-08T15:49:39.076740+0000","last_active":"2023-03-08T15:49:40.498736+0000","last_peered":"2023-03-08T15:49:40.498736+0000","last_clean":"2023-03-08T15:49:40.498736+0000","last_became_active":"2023-03-08T15:49:39.075420+0000","last_became_peered":"2023-03-08T15:49:39.075420+0000","last_unstale":"2023-03-08T15:49:40.498736+0000","last_undegraded":"2023-03-08T15:49:40.498736+0000","last_fullsized":"2023-03-08T15:49:40.498736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:39:52.448950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497861+0000","last_change":"2023-03-08T15:49:39.506581+0000","last_active":"2023-03-08T15:49:40.497861+0000","last_peered":"2023-03-08T15:49:40.497861+0000","last_clean":"2023-03-08T15:49:40.497861+0000","last_became_active":"2023-03-08T15:49:39.505867+0000","last_became_peered":"2023-03-08T15:49:39.505867+0000","last_unstale":"2023-03-08T15:49:40.497861+0000","last_undegraded":"2023-03-08T15:49:40.497861+0000","last_fullsized":"2023-03-08T15:49:40.497861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:41:05.974121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498634+0000","last_change":"2023-03-08T15:49:39.064465+0000","last_active":"2023-03-08T15:49:40.498634+0000","last_peered":"2023-03-08T15:49:40.498634+0000","last_clean":"2023-03-08T15:49:40.498634+0000","last_became_active":"2023-03-08T15:49:39.064180+0000","last_became_peered":"2023-03-08T15:49:39.064180+0000","last_unstale":"2023-03-08T15:49:40.498634+0000","last_undegraded":"2023-03-08T15:49:40.498634+0000","last_fullsized":"2023-03-08T15:49:40.498634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515371+0000","last_change":"2023-03-08T15:49:39.517781+0000","last_active":"2023-03-08T15:49:40.515371+0000","last_peered":"2023-03-08T15:49:40.515371+0000","last_clean":"2023-03-08T15:49:40.515371+0000","last_became_active":"2023-03-08T15:49:39.517522+0000","last_became_peered":"2023-03-08T15:49:39.517522+0000","last_unstale":"2023-03-08T15:49:40.515371+0000","last_undegraded":"2023-03-08T15:49:40.515371+0000","last_fullsized":"2023-03-08T15:49:40.515371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:59:37.837477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497190+0000","last_change":"2023-03-08T15:49:39.073238+0000","last_active":"2023-03-08T15:49:40.497190+0000","last_peered":"2023-03-08T15:49:40.497190+0000","last_clean":"2023-03-08T15:49:40.497190+0000","last_became_active":"2023-03-08T15:49:39.072946+0000","last_became_peered":"2023-03-08T15:49:39.072946+0000","last_unstale":"2023-03-08T15:49:40.497190+0000","last_undegraded":"2023-03-08T15:49:40.497190+0000","last_fullsized":"2023-03-08T15:49:40.497190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:07:57.155564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516703+0000","last_change":"2023-03-08T15:49:39.511074+0000","last_active":"2023-03-08T15:49:40.516703+0000","last_peered":"2023-03-08T15:49:40.516703+0000","last_clean":"2023-03-08T15:49:40.516703+0000","last_became_active":"2023-03-08T15:49:39.510818+0000","last_became_peered":"2023-03-08T15:49:39.510818+0000","last_unstale":"2023-03-08T15:49:40.516703+0000","last_undegraded":"2023-03-08T15:49:40.516703+0000","last_fullsized":"2023-03-08T15:49:40.516703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:04.540991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515561+0000","last_change":"2023-03-08T15:49:39.070465+0000","last_active":"2023-03-08T15:49:40.515561+0000","last_peered":"2023-03-08T15:49:40.515561+0000","last_clean":"2023-03-08T15:49:40.515561+0000","last_became_active":"2023-03-08T15:49:39.069996+0000","last_became_peered":"2023-03-08T15:49:39.069996+0000","last_unstale":"2023-03-08T15:49:40.515561+0000","last_undegraded":"2023-03-08T15:49:40.515561+0000","last_fullsized":"2023-03-08T15:49:40.515561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:53.868715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497272+0000","last_change":"2023-03-08T15:49:39.506567+0000","last_active":"2023-03-08T15:49:40.497272+0000","last_peered":"2023-03-08T15:49:40.497272+0000","last_clean":"2023-03-08T15:49:40.497272+0000","last_became_active":"2023-03-08T15:49:39.506069+0000","last_became_peered":"2023-03-08T15:49:39.506069+0000","last_unstale":"2023-03-08T15:49:40.497272+0000","last_undegraded":"2023-03-08T15:49:40.497272+0000","last_fullsized":"2023-03-08T15:49:40.497272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:02:38.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516579+0000","last_change":"2023-03-08T15:49:39.071437+0000","last_active":"2023-03-08T15:49:40.516579+0000","last_peered":"2023-03-08T15:49:40.516579+0000","last_clean":"2023-03-08T15:49:40.516579+0000","last_became_active":"2023-03-08T15:49:39.071152+0000","last_became_peered":"2023-03-08T15:49:39.071152+0000","last_unstale":"2023-03-08T15:49:40.516579+0000","last_undegraded":"2023-03-08T15:49:40.516579+0000","last_fullsized":"2023-03-08T15:49:40.516579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:21.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497294+0000","last_change":"2023-03-08T15:49:39.517658+0000","last_active":"2023-03-08T15:49:40.497294+0000","last_peered":"2023-03-08T15:49:40.497294+0000","last_clean":"2023-03-08T15:49:40.497294+0000","last_became_active":"2023-03-08T15:49:39.517399+0000","last_became_peered":"2023-03-08T15:49:39.517399+0000","last_unstale":"2023-03-08T15:49:40.497294+0000","last_undegraded":"2023-03-08T15:49:40.497294+0000","last_fullsized":"2023-03-08T15:49:40.497294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:07:36.774920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516663+0000","last_change":"2023-03-08T15:49:39.067519+0000","last_active":"2023-03-08T15:49:40.516663+0000","last_peered":"2023-03-08T15:49:40.516663+0000","last_clean":"2023-03-08T15:49:40.516663+0000","last_became_active":"2023-03-08T15:49:39.067254+0000","last_became_peered":"2023-03-08T15:49:39.067254+0000","last_unstale":"2023-03-08T15:49:40.516663+0000","last_undegraded":"2023-03-08T15:49:40.516663+0000","last_fullsized":"2023-03-08T15:49:40.516663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498632+0000","last_change":"2023-03-08T15:49:39.504530+0000","last_active":"2023-03-08T15:49:40.498632+0000","last_peered":"2023-03-08T15:49:40.498632+0000","last_clean":"2023-03-08T15:49:40.498632+0000","last_became_active":"2023-03-08T15:49:39.504282+0000","last_became_peered":"2023-03-08T15:49:39.504282+0000","last_unstale":"2023-03-08T15:49:40.498632+0000","last_undegraded":"2023-03-08T15:49:40.498632+0000","last_fullsized":"2023-03-08T15:49:40.498632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:11:06.014260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498452+0000","last_change":"2023-03-08T15:49:39.077464+0000","last_active":"2023-03-08T15:49:40.498452+0000","last_peered":"2023-03-08T15:49:40.498452+0000","last_clean":"2023-03-08T15:49:40.498452+0000","last_became_active":"2023-03-08T15:49:39.077166+0000","last_became_peered":"2023-03-08T15:49:39.077166+0000","last_unstale":"2023-03-08T15:49:40.498452+0000","last_undegraded":"2023-03-08T15:49:40.498452+0000","last_fullsized":"2023-03-08T15:49:40.498452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498301+0000","last_change":"2023-03-08T15:49:39.503655+0000","last_active":"2023-03-08T15:49:40.498301+0000","last_peered":"2023-03-08T15:49:40.498301+0000","last_clean":"2023-03-08T15:49:40.498301+0000","last_became_active":"2023-03-08T15:49:39.503231+0000","last_became_peered":"2023-03-08T15:49:39.503231+0000","last_unstale":"2023-03-08T15:49:40.498301+0000","last_undegraded":"2023-03-08T15:49:40.498301+0000","last_fullsized":"2023-03-08T15:49:40.498301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:17:21.576214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516115+0000","last_change":"2023-03-08T15:49:39.079358+0000","last_active":"2023-03-08T15:49:40.516115+0000","last_peered":"2023-03-08T15:49:40.516115+0000","last_clean":"2023-03-08T15:49:40.516115+0000","last_became_active":"2023-03-08T15:49:39.079094+0000","last_became_peered":"2023-03-08T15:49:39.079094+0000","last_unstale":"2023-03-08T15:49:40.516115+0000","last_undegraded":"2023-03-08T15:49:40.516115+0000","last_fullsized":"2023-03-08T15:49:40.516115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:03.536123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497687+0000","last_change":"2023-03-08T15:49:39.506844+0000","last_active":"2023-03-08T15:49:40.497687+0000","last_peered":"2023-03-08T15:49:40.497687+0000","last_clean":"2023-03-08T15:49:40.497687+0000","last_became_active":"2023-03-08T15:49:39.506035+0000","last_became_peered":"2023-03-08T15:49:39.506035+0000","last_unstale":"2023-03-08T15:49:40.497687+0000","last_undegraded":"2023-03-08T15:49:40.497687+0000","last_fullsized":"2023-03-08T15:49:40.497687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515656+0000","last_change":"2023-03-08T15:49:39.072231+0000","last_active":"2023-03-08T15:49:40.515656+0000","last_peered":"2023-03-08T15:49:40.515656+0000","last_clean":"2023-03-08T15:49:40.515656+0000","last_became_active":"2023-03-08T15:49:39.071935+0000","last_became_peered":"2023-03-08T15:49:39.071935+0000","last_unstale":"2023-03-08T15:49:40.515656+0000","last_undegraded":"2023-03-08T15:49:40.515656+0000","last_fullsized":"2023-03-08T15:49:40.515656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:21.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516172+0000","last_change":"2023-03-08T15:49:39.518337+0000","last_active":"2023-03-08T15:49:40.516172+0000","last_peered":"2023-03-08T15:49:40.516172+0000","last_clean":"2023-03-08T15:49:40.516172+0000","last_became_active":"2023-03-08T15:49:39.517689+0000","last_became_peered":"2023-03-08T15:49:39.517689+0000","last_unstale":"2023-03-08T15:49:40.516172+0000","last_undegraded":"2023-03-08T15:49:40.516172+0000","last_fullsized":"2023-03-08T15:49:40.516172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515907+0000","last_change":"2023-03-08T15:49:39.076491+0000","last_active":"2023-03-08T15:49:40.515907+0000","last_peered":"2023-03-08T15:49:40.515907+0000","last_clean":"2023-03-08T15:49:40.515907+0000","last_became_active":"2023-03-08T15:49:39.076238+0000","last_became_peered":"2023-03-08T15:49:39.076238+0000","last_unstale":"2023-03-08T15:49:40.515907+0000","last_undegraded":"2023-03-08T15:49:40.515907+0000","last_fullsized":"2023-03-08T15:49:40.515907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:13:15.662118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515323+0000","last_change":"2023-03-08T15:49:39.508617+0000","last_active":"2023-03-08T15:49:40.515323+0000","last_peered":"2023-03-08T15:49:40.515323+0000","last_clean":"2023-03-08T15:49:40.515323+0000","last_became_active":"2023-03-08T15:49:39.508246+0000","last_became_peered":"2023-03-08T15:49:39.508246+0000","last_unstale":"2023-03-08T15:49:40.515323+0000","last_undegraded":"2023-03-08T15:49:40.515323+0000","last_fullsized":"2023-03-08T15:49:40.515323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:07:36.774920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515652+0000","last_change":"2023-03-08T15:49:39.072472+0000","last_active":"2023-03-08T15:49:40.515652+0000","last_peered":"2023-03-08T15:49:40.515652+0000","last_clean":"2023-03-08T15:49:40.515652+0000","last_became_active":"2023-03-08T15:49:39.072182+0000","last_became_peered":"2023-03-08T15:49:39.072182+0000","last_unstale":"2023-03-08T15:49:40.515652+0000","last_undegraded":"2023-03-08T15:49:40.515652+0000","last_fullsized":"2023-03-08T15:49:40.515652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:02:08.526616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498081+0000","last_change":"2023-03-08T15:49:39.517141+0000","last_active":"2023-03-08T15:49:40.498081+0000","last_peered":"2023-03-08T15:49:40.498081+0000","last_clean":"2023-03-08T15:49:40.498081+0000","last_became_active":"2023-03-08T15:49:39.516875+0000","last_became_peered":"2023-03-08T15:49:39.516875+0000","last_unstale":"2023-03-08T15:49:40.498081+0000","last_undegraded":"2023-03-08T15:49:40.498081+0000","last_fullsized":"2023-03-08T15:49:40.498081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515921+0000","last_change":"2023-03-08T15:49:39.072643+0000","last_active":"2023-03-08T15:49:40.515921+0000","last_peered":"2023-03-08T15:49:40.515921+0000","last_clean":"2023-03-08T15:49:40.515921+0000","last_became_active":"2023-03-08T15:49:39.072348+0000","last_became_peered":"2023-03-08T15:49:39.072348+0000","last_unstale":"2023-03-08T15:49:40.515921+0000","last_undegraded":"2023-03-08T15:49:40.515921+0000","last_fullsized":"2023-03-08T15:49:40.515921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:08:09.084589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515584+0000","last_change":"2023-03-08T15:49:39.518066+0000","last_active":"2023-03-08T15:49:40.515584+0000","last_peered":"2023-03-08T15:49:40.515584+0000","last_clean":"2023-03-08T15:49:40.515584+0000","last_became_active":"2023-03-08T15:49:39.517777+0000","last_became_peered":"2023-03-08T15:49:39.517777+0000","last_unstale":"2023-03-08T15:49:40.515584+0000","last_undegraded":"2023-03-08T15:49:40.515584+0000","last_fullsized":"2023-03-08T15:49:40.515584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516345+0000","last_change":"2023-03-08T15:49:39.078315+0000","last_active":"2023-03-08T15:49:40.516345+0000","last_peered":"2023-03-08T15:49:40.516345+0000","last_clean":"2023-03-08T15:49:40.516345+0000","last_became_active":"2023-03-08T15:49:39.078043+0000","last_became_peered":"2023-03-08T15:49:39.078043+0000","last_unstale":"2023-03-08T15:49:40.516345+0000","last_undegraded":"2023-03-08T15:49:40.516345+0000","last_fullsized":"2023-03-08T15:49:40.516345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:11:05.009391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498117+0000","last_change":"2023-03-08T15:49:39.513221+0000","last_active":"2023-03-08T15:49:40.498117+0000","last_peered":"2023-03-08T15:49:40.498117+0000","last_clean":"2023-03-08T15:49:40.498117+0000","last_became_active":"2023-03-08T15:49:39.512950+0000","last_became_peered":"2023-03-08T15:49:39.512950+0000","last_unstale":"2023-03-08T15:49:40.498117+0000","last_undegraded":"2023-03-08T15:49:40.498117+0000","last_fullsized":"2023-03-08T15:49:40.498117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516833+0000","last_change":"2023-03-08T15:49:39.068973+0000","last_active":"2023-03-08T15:49:40.516833+0000","last_peered":"2023-03-08T15:49:40.516833+0000","last_clean":"2023-03-08T15:49:40.516833+0000","last_became_active":"2023-03-08T15:49:39.068694+0000","last_became_peered":"2023-03-08T15:49:39.068694+0000","last_unstale":"2023-03-08T15:49:40.516833+0000","last_undegraded":"2023-03-08T15:49:40.516833+0000","last_fullsized":"2023-03-08T15:49:40.516833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:55:20.097052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515855+0000","last_change":"2023-03-08T15:49:39.510470+0000","last_active":"2023-03-08T15:49:40.515855+0000","last_peered":"2023-03-08T15:49:40.515855+0000","last_clean":"2023-03-08T15:49:40.515855+0000","last_became_active":"2023-03-08T15:49:39.510205+0000","last_became_peered":"2023-03-08T15:49:39.510205+0000","last_unstale":"2023-03-08T15:49:40.515855+0000","last_undegraded":"2023-03-08T15:49:40.515855+0000","last_fullsized":"2023-03-08T15:49:40.515855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:45.599141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515854+0000","last_change":"2023-03-08T15:49:39.067592+0000","last_active":"2023-03-08T15:49:40.515854+0000","last_peered":"2023-03-08T15:49:40.515854+0000","last_clean":"2023-03-08T15:49:40.515854+0000","last_became_active":"2023-03-08T15:49:39.067309+0000","last_became_peered":"2023-03-08T15:49:39.067309+0000","last_unstale":"2023-03-08T15:49:40.515854+0000","last_undegraded":"2023-03-08T15:49:40.515854+0000","last_fullsized":"2023-03-08T15:49:40.515854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:53.868715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.514896+0000","last_change":"2023-03-08T15:49:39.510190+0000","last_active":"2023-03-08T15:49:40.514896+0000","last_peered":"2023-03-08T15:49:40.514896+0000","last_clean":"2023-03-08T15:49:40.514896+0000","last_became_active":"2023-03-08T15:49:39.509892+0000","last_became_peered":"2023-03-08T15:49:39.509892+0000","last_unstale":"2023-03-08T15:49:40.514896+0000","last_undegraded":"2023-03-08T15:49:40.514896+0000","last_fullsized":"2023-03-08T15:49:40.514896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:09:32.633312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497690+0000","last_change":"2023-03-08T15:49:39.073755+0000","last_active":"2023-03-08T15:49:40.497690+0000","last_peered":"2023-03-08T15:49:40.497690+0000","last_clean":"2023-03-08T15:49:40.497690+0000","last_became_active":"2023-03-08T15:49:39.073472+0000","last_became_peered":"2023-03-08T15:49:39.073472+0000","last_unstale":"2023-03-08T15:49:40.497690+0000","last_undegraded":"2023-03-08T15:49:40.497690+0000","last_fullsized":"2023-03-08T15:49:40.497690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:53.868715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498326+0000","last_change":"2023-03-08T15:49:39.505358+0000","last_active":"2023-03-08T15:49:40.498326+0000","last_peered":"2023-03-08T15:49:40.498326+0000","last_clean":"2023-03-08T15:49:40.498326+0000","last_became_active":"2023-03-08T15:49:39.504755+0000","last_became_peered":"2023-03-08T15:49:39.504755+0000","last_unstale":"2023-03-08T15:49:40.498326+0000","last_undegraded":"2023-03-08T15:49:40.498326+0000","last_fullsized":"2023-03-08T15:49:40.498326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:03:30.032957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515748+0000","last_change":"2023-03-08T15:49:39.076072+0000","last_active":"2023-03-08T15:49:40.515748+0000","last_peered":"2023-03-08T15:49:40.515748+0000","last_clean":"2023-03-08T15:49:40.515748+0000","last_became_active":"2023-03-08T15:49:39.075810+0000","last_became_peered":"2023-03-08T15:49:39.075810+0000","last_unstale":"2023-03-08T15:49:40.515748+0000","last_undegraded":"2023-03-08T15:49:40.515748+0000","last_fullsized":"2023-03-08T15:49:40.515748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498686+0000","last_change":"2023-03-08T15:49:39.505109+0000","last_active":"2023-03-08T15:49:40.498686+0000","last_peered":"2023-03-08T15:49:40.498686+0000","last_clean":"2023-03-08T15:49:40.498686+0000","last_became_active":"2023-03-08T15:49:39.504889+0000","last_became_peered":"2023-03-08T15:49:39.504889+0000","last_unstale":"2023-03-08T15:49:40.498686+0000","last_undegraded":"2023-03-08T15:49:40.498686+0000","last_fullsized":"2023-03-08T15:49:40.498686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498254+0000","last_change":"2023-03-08T15:49:39.077380+0000","last_active":"2023-03-08T15:49:40.498254+0000","last_peered":"2023-03-08T15:49:40.498254+0000","last_clean":"2023-03-08T15:49:40.498254+0000","last_became_active":"2023-03-08T15:49:39.077041+0000","last_became_peered":"2023-03-08T15:49:39.077041+0000","last_unstale":"2023-03-08T15:49:40.498254+0000","last_undegraded":"2023-03-08T15:49:40.498254+0000","last_fullsized":"2023-03-08T15:49:40.498254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:02:08.526616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498825+0000","last_change":"2023-03-08T15:49:39.512506+0000","last_active":"2023-03-08T15:49:40.498825+0000","last_peered":"2023-03-08T15:49:40.498825+0000","last_clean":"2023-03-08T15:49:40.498825+0000","last_became_active":"2023-03-08T15:49:39.512103+0000","last_became_peered":"2023-03-08T15:49:39.512103+0000","last_unstale":"2023-03-08T15:49:40.498825+0000","last_undegraded":"2023-03-08T15:49:40.498825+0000","last_fullsized":"2023-03-08T15:49:40.498825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:09:32.633312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497106+0000","last_change":"2023-03-08T15:49:39.065317+0000","last_active":"2023-03-08T15:49:40.497106+0000","last_peered":"2023-03-08T15:49:40.497106+0000","last_clean":"2023-03-08T15:49:40.497106+0000","last_became_active":"2023-03-08T15:49:39.065033+0000","last_became_peered":"2023-03-08T15:49:39.065033+0000","last_unstale":"2023-03-08T15:49:40.497106+0000","last_undegraded":"2023-03-08T15:49:40.497106+0000","last_fullsized":"2023-03-08T15:49:40.497106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499131+0000","last_change":"2023-03-08T15:49:39.508113+0000","last_active":"2023-03-08T15:49:40.499131+0000","last_peered":"2023-03-08T15:49:40.499131+0000","last_clean":"2023-03-08T15:49:40.499131+0000","last_became_active":"2023-03-08T15:49:39.507782+0000","last_became_peered":"2023-03-08T15:49:39.507782+0000","last_unstale":"2023-03-08T15:49:40.499131+0000","last_undegraded":"2023-03-08T15:49:40.499131+0000","last_fullsized":"2023-03-08T15:49:40.499131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:17:16.405869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.497607+0000","last_change":"2023-03-08T15:49:34.914364+0000","last_active":"2023-03-08T15:49:39.497607+0000","last_peered":"2023-03-08T15:49:39.497607+0000","last_clean":"2023-03-08T15:49:39.497607+0000","last_became_active":"2023-03-08T15:49:34.914037+0000","last_became_peered":"2023-03-08T15:49:34.914037+0000","last_unstale":"2023-03-08T15:49:39.497607+0000","last_undegraded":"2023-03-08T15:49:39.497607+0000","last_fullsized":"2023-03-08T15:49:39.497607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:55:29.151326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516267+0000","last_change":"2023-03-08T15:49:39.071150+0000","last_active":"2023-03-08T15:49:40.516267+0000","last_peered":"2023-03-08T15:49:40.516267+0000","last_clean":"2023-03-08T15:49:40.516267+0000","last_became_active":"2023-03-08T15:49:39.070851+0000","last_became_peered":"2023-03-08T15:49:39.070851+0000","last_unstale":"2023-03-08T15:49:40.516267+0000","last_undegraded":"2023-03-08T15:49:40.516267+0000","last_fullsized":"2023-03-08T15:49:40.516267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498773+0000","last_change":"2023-03-08T15:49:39.513676+0000","last_active":"2023-03-08T15:49:40.498773+0000","last_peered":"2023-03-08T15:49:40.498773+0000","last_clean":"2023-03-08T15:49:40.498773+0000","last_became_active":"2023-03-08T15:49:39.513236+0000","last_became_peered":"2023-03-08T15:49:39.513236+0000","last_unstale":"2023-03-08T15:49:40.498773+0000","last_undegraded":"2023-03-08T15:49:40.498773+0000","last_fullsized":"2023-03-08T15:49:40.498773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:15:10.927104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.500443+0000","last_change":"2023-03-08T15:49:34.036801+0000","last_active":"2023-03-08T15:49:39.500443+0000","last_peered":"2023-03-08T15:49:39.500443+0000","last_clean":"2023-03-08T15:49:39.500443+0000","last_became_active":"2023-03-08T15:49:34.036484+0000","last_became_peered":"2023-03-08T15:49:34.036484+0000","last_unstale":"2023-03-08T15:49:39.500443+0000","last_undegraded":"2023-03-08T15:49:39.500443+0000","last_fullsized":"2023-03-08T15:49:39.500443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498573+0000","last_change":"2023-03-08T15:49:39.077024+0000","last_active":"2023-03-08T15:49:40.498573+0000","last_peered":"2023-03-08T15:49:40.498573+0000","last_clean":"2023-03-08T15:49:40.498573+0000","last_became_active":"2023-03-08T15:49:39.075919+0000","last_became_peered":"2023-03-08T15:49:39.075919+0000","last_unstale":"2023-03-08T15:49:40.498573+0000","last_undegraded":"2023-03-08T15:49:40.498573+0000","last_fullsized":"2023-03-08T15:49:40.498573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:53:57.255123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498923+0000","last_change":"2023-03-08T15:49:39.506861+0000","last_active":"2023-03-08T15:49:40.498923+0000","last_peered":"2023-03-08T15:49:40.498923+0000","last_clean":"2023-03-08T15:49:40.498923+0000","last_became_active":"2023-03-08T15:49:39.506532+0000","last_became_peered":"2023-03-08T15:49:39.506532+0000","last_unstale":"2023-03-08T15:49:40.498923+0000","last_undegraded":"2023-03-08T15:49:40.498923+0000","last_fullsized":"2023-03-08T15:49:40.498923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.494252+0000","last_change":"2023-03-08T15:49:34.968598+0000","last_active":"2023-03-08T15:49:39.494252+0000","last_peered":"2023-03-08T15:49:39.494252+0000","last_clean":"2023-03-08T15:49:39.494252+0000","last_became_active":"2023-03-08T15:49:34.968300+0000","last_became_peered":"2023-03-08T15:49:34.968300+0000","last_unstale":"2023-03-08T15:49:39.494252+0000","last_undegraded":"2023-03-08T15:49:39.494252+0000","last_fullsized":"2023-03-08T15:49:39.494252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:39:14.985725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498575+0000","last_change":"2023-03-08T15:49:39.069250+0000","last_active":"2023-03-08T15:49:40.498575+0000","last_peered":"2023-03-08T15:49:40.498575+0000","last_clean":"2023-03-08T15:49:40.498575+0000","last_became_active":"2023-03-08T15:49:39.068876+0000","last_became_peered":"2023-03-08T15:49:39.068876+0000","last_unstale":"2023-03-08T15:49:40.498575+0000","last_undegraded":"2023-03-08T15:49:40.498575+0000","last_fullsized":"2023-03-08T15:49:40.498575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:53:57.255123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499084+0000","last_change":"2023-03-08T15:49:39.510119+0000","last_active":"2023-03-08T15:49:40.499084+0000","last_peered":"2023-03-08T15:49:40.499084+0000","last_clean":"2023-03-08T15:49:40.499084+0000","last_became_active":"2023-03-08T15:49:39.509867+0000","last_became_peered":"2023-03-08T15:49:39.509867+0000","last_unstale":"2023-03-08T15:49:40.499084+0000","last_undegraded":"2023-03-08T15:49:40.499084+0000","last_fullsized":"2023-03-08T15:49:40.499084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:59:37.837477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.497279+0000","last_change":"2023-03-08T15:49:34.042076+0000","last_active":"2023-03-08T15:49:39.497279+0000","last_peered":"2023-03-08T15:49:39.497279+0000","last_clean":"2023-03-08T15:49:39.497279+0000","last_became_active":"2023-03-08T15:49:34.041670+0000","last_became_peered":"2023-03-08T15:49:34.041670+0000","last_unstale":"2023-03-08T15:49:39.497279+0000","last_undegraded":"2023-03-08T15:49:39.497279+0000","last_fullsized":"2023-03-08T15:49:39.497279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:46:37.870016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.509020+0000","last_change":"2023-03-08T15:49:27.814075+0000","last_active":"2023-03-08T15:49:39.509020+0000","last_peered":"2023-03-08T15:49:39.509020+0000","last_clean":"2023-03-08T15:49:39.509020+0000","last_became_active":"2023-03-08T15:49:27.813798+0000","last_became_peered":"2023-03-08T15:49:27.813798+0000","last_unstale":"2023-03-08T15:49:39.509020+0000","last_undegraded":"2023-03-08T15:49:39.509020+0000","last_fullsized":"2023-03-08T15:49:39.509020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_clean_scrub_stamp":"2023-03-08T15:49:26.430262+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:31:30.865216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497255+0000","last_change":"2023-03-08T15:49:39.067474+0000","last_active":"2023-03-08T15:49:40.497255+0000","last_peered":"2023-03-08T15:49:40.497255+0000","last_clean":"2023-03-08T15:49:40.497255+0000","last_became_active":"2023-03-08T15:49:39.067137+0000","last_became_peered":"2023-03-08T15:49:39.067137+0000","last_unstale":"2023-03-08T15:49:40.497255+0000","last_undegraded":"2023-03-08T15:49:40.497255+0000","last_fullsized":"2023-03-08T15:49:40.497255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:31:20.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516821+0000","last_change":"2023-03-08T15:49:39.514869+0000","last_active":"2023-03-08T15:49:40.516821+0000","last_peered":"2023-03-08T15:49:40.516821+0000","last_clean":"2023-03-08T15:49:40.516821+0000","last_became_active":"2023-03-08T15:49:39.514600+0000","last_became_peered":"2023-03-08T15:49:39.514600+0000","last_unstale":"2023-03-08T15:49:40.516821+0000","last_undegraded":"2023-03-08T15:49:40.516821+0000","last_fullsized":"2023-03-08T15:49:40.516821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:11:06.014260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.509646+0000","last_change":"2023-03-08T15:49:34.042085+0000","last_active":"2023-03-08T15:49:39.509646+0000","last_peered":"2023-03-08T15:49:39.509646+0000","last_clean":"2023-03-08T15:49:39.509646+0000","last_became_active":"2023-03-08T15:49:34.041754+0000","last_became_peered":"2023-03-08T15:49:34.041754+0000","last_unstale":"2023-03-08T15:49:39.509646+0000","last_undegraded":"2023-03-08T15:49:39.509646+0000","last_fullsized":"2023-03-08T15:49:39.509646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.514893+0000","last_change":"2023-03-08T15:49:39.072478+0000","last_active":"2023-03-08T15:49:40.514893+0000","last_peered":"2023-03-08T15:49:40.514893+0000","last_clean":"2023-03-08T15:49:40.514893+0000","last_became_active":"2023-03-08T15:49:39.072186+0000","last_became_peered":"2023-03-08T15:49:39.072186+0000","last_unstale":"2023-03-08T15:49:40.514893+0000","last_undegraded":"2023-03-08T15:49:40.514893+0000","last_fullsized":"2023-03-08T15:49:40.514893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:07:57.155564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515455+0000","last_change":"2023-03-08T15:49:39.511543+0000","last_active":"2023-03-08T15:49:40.515455+0000","last_peered":"2023-03-08T15:49:40.515455+0000","last_clean":"2023-03-08T15:49:40.515455+0000","last_became_active":"2023-03-08T15:49:39.511257+0000","last_became_peered":"2023-03-08T15:49:39.511257+0000","last_unstale":"2023-03-08T15:49:40.515455+0000","last_undegraded":"2023-03-08T15:49:40.515455+0000","last_fullsized":"2023-03-08T15:49:40.515455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:02:38.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.510687+0000","last_change":"2023-03-08T15:49:34.914757+0000","last_active":"2023-03-08T15:49:39.510687+0000","last_peered":"2023-03-08T15:49:39.510687+0000","last_clean":"2023-03-08T15:49:39.510687+0000","last_became_active":"2023-03-08T15:49:34.914391+0000","last_became_peered":"2023-03-08T15:49:34.914391+0000","last_unstale":"2023-03-08T15:49:39.510687+0000","last_undegraded":"2023-03-08T15:49:39.510687+0000","last_fullsized":"2023-03-08T15:49:39.510687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:09:02.620210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498918+0000","last_change":"2023-03-08T15:49:39.069904+0000","last_active":"2023-03-08T15:49:40.498918+0000","last_peered":"2023-03-08T15:49:40.498918+0000","last_clean":"2023-03-08T15:49:40.498918+0000","last_became_active":"2023-03-08T15:49:39.069513+0000","last_became_peered":"2023-03-08T15:49:39.069513+0000","last_unstale":"2023-03-08T15:49:40.498918+0000","last_undegraded":"2023-03-08T15:49:40.498918+0000","last_fullsized":"2023-03-08T15:49:40.498918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:29:04.866450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515223+0000","last_change":"2023-03-08T15:49:39.512846+0000","last_active":"2023-03-08T15:49:40.515223+0000","last_peered":"2023-03-08T15:49:40.515223+0000","last_clean":"2023-03-08T15:49:40.515223+0000","last_became_active":"2023-03-08T15:49:39.512561+0000","last_became_peered":"2023-03-08T15:49:39.512561+0000","last_unstale":"2023-03-08T15:49:40.515223+0000","last_undegraded":"2023-03-08T15:49:40.515223+0000","last_fullsized":"2023-03-08T15:49:40.515223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498020+0000","last_change":"2023-03-08T15:49:39.067777+0000","last_active":"2023-03-08T15:49:40.498020+0000","last_peered":"2023-03-08T15:49:40.498020+0000","last_clean":"2023-03-08T15:49:40.498020+0000","last_became_active":"2023-03-08T15:49:39.067461+0000","last_became_peered":"2023-03-08T15:49:39.067461+0000","last_unstale":"2023-03-08T15:49:40.498020+0000","last_undegraded":"2023-03-08T15:49:40.498020+0000","last_fullsized":"2023-03-08T15:49:40.498020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:21.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.498744+0000","last_change":"2023-03-08T15:49:34.039636+0000","last_active":"2023-03-08T15:49:39.498744+0000","last_peered":"2023-03-08T15:49:39.498744+0000","last_clean":"2023-03-08T15:49:39.498744+0000","last_became_active":"2023-03-08T15:49:34.039383+0000","last_became_peered":"2023-03-08T15:49:34.039383+0000","last_unstale":"2023-03-08T15:49:39.498744+0000","last_undegraded":"2023-03-08T15:49:39.498744+0000","last_fullsized":"2023-03-08T15:49:39.498744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:27:38.358539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497091+0000","last_change":"2023-03-08T15:49:39.518195+0000","last_active":"2023-03-08T15:49:40.497091+0000","last_peered":"2023-03-08T15:49:40.497091+0000","last_clean":"2023-03-08T15:49:40.497091+0000","last_became_active":"2023-03-08T15:49:39.517992+0000","last_became_peered":"2023-03-08T15:49:39.517992+0000","last_unstale":"2023-03-08T15:49:40.497091+0000","last_undegraded":"2023-03-08T15:49:40.497091+0000","last_fullsized":"2023-03-08T15:49:40.497091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.498866+0000","last_change":"2023-03-08T15:49:34.040711+0000","last_active":"2023-03-08T15:49:39.498866+0000","last_peered":"2023-03-08T15:49:39.498866+0000","last_clean":"2023-03-08T15:49:39.498866+0000","last_became_active":"2023-03-08T15:49:34.040328+0000","last_became_peered":"2023-03-08T15:49:34.040328+0000","last_unstale":"2023-03-08T15:49:39.498866+0000","last_undegraded":"2023-03-08T15:49:39.498866+0000","last_fullsized":"2023-03-08T15:49:39.498866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:34:43.169713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515410+0000","last_change":"2023-03-08T15:49:39.073837+0000","last_active":"2023-03-08T15:49:40.515410+0000","last_peered":"2023-03-08T15:49:40.515410+0000","last_clean":"2023-03-08T15:49:40.515410+0000","last_became_active":"2023-03-08T15:49:39.073103+0000","last_became_peered":"2023-03-08T15:49:39.073103+0000","last_unstale":"2023-03-08T15:49:40.515410+0000","last_undegraded":"2023-03-08T15:49:40.515410+0000","last_fullsized":"2023-03-08T15:49:40.515410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:53:57.255123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498138+0000","last_change":"2023-03-08T15:49:39.506282+0000","last_active":"2023-03-08T15:49:40.498138+0000","last_peered":"2023-03-08T15:49:40.498138+0000","last_clean":"2023-03-08T15:49:40.498138+0000","last_became_active":"2023-03-08T15:49:39.505963+0000","last_became_peered":"2023-03-08T15:49:39.505963+0000","last_unstale":"2023-03-08T15:49:40.498138+0000","last_undegraded":"2023-03-08T15:49:40.498138+0000","last_fullsized":"2023-03-08T15:49:40.498138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:18:53.422253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515312+0000","last_change":"2023-03-08T15:49:39.077529+0000","last_active":"2023-03-08T15:49:40.515312+0000","last_peered":"2023-03-08T15:49:40.515312+0000","last_clean":"2023-03-08T15:49:40.515312+0000","last_became_active":"2023-03-08T15:49:39.077214+0000","last_became_peered":"2023-03-08T15:49:39.077214+0000","last_unstale":"2023-03-08T15:49:40.515312+0000","last_undegraded":"2023-03-08T15:49:40.515312+0000","last_fullsized":"2023-03-08T15:49:40.515312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:31:20.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515304+0000","last_change":"2023-03-08T15:49:39.505582+0000","last_active":"2023-03-08T15:49:40.515304+0000","last_peered":"2023-03-08T15:49:40.515304+0000","last_clean":"2023-03-08T15:49:40.515304+0000","last_became_active":"2023-03-08T15:49:39.505317+0000","last_became_peered":"2023-03-08T15:49:39.505317+0000","last_unstale":"2023-03-08T15:49:40.515304+0000","last_undegraded":"2023-03-08T15:49:40.515304+0000","last_fullsized":"2023-03-08T15:49:40.515304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:31:21.040757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515757+0000","last_change":"2023-03-08T15:49:39.074108+0000","last_active":"2023-03-08T15:49:40.515757+0000","last_peered":"2023-03-08T15:49:40.515757+0000","last_clean":"2023-03-08T15:49:40.515757+0000","last_became_active":"2023-03-08T15:49:39.073843+0000","last_became_peered":"2023-03-08T15:49:39.073843+0000","last_unstale":"2023-03-08T15:49:40.515757+0000","last_undegraded":"2023-03-08T15:49:40.515757+0000","last_fullsized":"2023-03-08T15:49:40.515757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:13:15.662118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498719+0000","last_change":"2023-03-08T15:49:39.506927+0000","last_active":"2023-03-08T15:49:40.498719+0000","last_peered":"2023-03-08T15:49:40.498719+0000","last_clean":"2023-03-08T15:49:40.498719+0000","last_became_active":"2023-03-08T15:49:39.505636+0000","last_became_peered":"2023-03-08T15:49:39.505636+0000","last_unstale":"2023-03-08T15:49:40.498719+0000","last_undegraded":"2023-03-08T15:49:40.498719+0000","last_fullsized":"2023-03-08T15:49:40.498719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:21:33.395756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516368+0000","last_change":"2023-03-08T15:49:39.073044+0000","last_active":"2023-03-08T15:49:40.516368+0000","last_peered":"2023-03-08T15:49:40.516368+0000","last_clean":"2023-03-08T15:49:40.516368+0000","last_became_active":"2023-03-08T15:49:39.072756+0000","last_became_peered":"2023-03-08T15:49:39.072756+0000","last_unstale":"2023-03-08T15:49:40.516368+0000","last_undegraded":"2023-03-08T15:49:40.516368+0000","last_fullsized":"2023-03-08T15:49:40.516368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:03.536123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498753+0000","last_change":"2023-03-08T15:49:39.500630+0000","last_active":"2023-03-08T15:49:40.498753+0000","last_peered":"2023-03-08T15:49:40.498753+0000","last_clean":"2023-03-08T15:49:40.498753+0000","last_became_active":"2023-03-08T15:49:39.500345+0000","last_became_peered":"2023-03-08T15:49:39.500345+0000","last_unstale":"2023-03-08T15:49:40.498753+0000","last_undegraded":"2023-03-08T15:49:40.498753+0000","last_fullsized":"2023-03-08T15:49:40.498753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:41:05.974121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497768+0000","last_change":"2023-03-08T15:49:39.066336+0000","last_active":"2023-03-08T15:49:40.497768+0000","last_peered":"2023-03-08T15:49:40.497768+0000","last_clean":"2023-03-08T15:49:40.497768+0000","last_became_active":"2023-03-08T15:49:39.066086+0000","last_became_peered":"2023-03-08T15:49:39.066086+0000","last_unstale":"2023-03-08T15:49:40.497768+0000","last_undegraded":"2023-03-08T15:49:40.497768+0000","last_fullsized":"2023-03-08T15:49:40.497768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497183+0000","last_change":"2023-03-08T15:49:39.501364+0000","last_active":"2023-03-08T15:49:40.497183+0000","last_peered":"2023-03-08T15:49:40.497183+0000","last_clean":"2023-03-08T15:49:40.497183+0000","last_became_active":"2023-03-08T15:49:39.501117+0000","last_became_peered":"2023-03-08T15:49:39.501117+0000","last_unstale":"2023-03-08T15:49:40.497183+0000","last_undegraded":"2023-03-08T15:49:40.497183+0000","last_fullsized":"2023-03-08T15:49:40.497183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:09:32.633312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515603+0000","last_change":"2023-03-08T15:49:39.070288+0000","last_active":"2023-03-08T15:49:40.515603+0000","last_peered":"2023-03-08T15:49:40.515603+0000","last_clean":"2023-03-08T15:49:40.515603+0000","last_became_active":"2023-03-08T15:49:39.069630+0000","last_became_peered":"2023-03-08T15:49:39.069630+0000","last_unstale":"2023-03-08T15:49:40.515603+0000","last_undegraded":"2023-03-08T15:49:40.515603+0000","last_fullsized":"2023-03-08T15:49:40.515603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498057+0000","last_change":"2023-03-08T15:49:39.504481+0000","last_active":"2023-03-08T15:49:40.498057+0000","last_peered":"2023-03-08T15:49:40.498057+0000","last_clean":"2023-03-08T15:49:40.498057+0000","last_became_active":"2023-03-08T15:49:39.504153+0000","last_became_peered":"2023-03-08T15:49:39.504153+0000","last_unstale":"2023-03-08T15:49:40.498057+0000","last_undegraded":"2023-03-08T15:49:40.498057+0000","last_fullsized":"2023-03-08T15:49:40.498057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:35:39.586275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515765+0000","last_change":"2023-03-08T15:49:39.512615+0000","last_active":"2023-03-08T15:49:40.515765+0000","last_peered":"2023-03-08T15:49:40.515765+0000","last_clean":"2023-03-08T15:49:40.515765+0000","last_became_active":"2023-03-08T15:49:39.511936+0000","last_became_peered":"2023-03-08T15:49:39.511936+0000","last_unstale":"2023-03-08T15:49:40.515765+0000","last_undegraded":"2023-03-08T15:49:40.515765+0000","last_fullsized":"2023-03-08T15:49:40.515765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:13:16.666986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497118+0000","last_change":"2023-03-08T15:49:39.506060+0000","last_active":"2023-03-08T15:49:40.497118+0000","last_peered":"2023-03-08T15:49:40.497118+0000","last_clean":"2023-03-08T15:49:40.497118+0000","last_became_active":"2023-03-08T15:49:39.505789+0000","last_became_peered":"2023-03-08T15:49:39.505789+0000","last_unstale":"2023-03-08T15:49:40.497118+0000","last_undegraded":"2023-03-08T15:49:40.497118+0000","last_fullsized":"2023-03-08T15:49:40.497118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:09:02.915110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498616+0000","last_change":"2023-03-08T15:49:39.504399+0000","last_active":"2023-03-08T15:49:40.498616+0000","last_peered":"2023-03-08T15:49:40.498616+0000","last_clean":"2023-03-08T15:49:40.498616+0000","last_became_active":"2023-03-08T15:49:39.504110+0000","last_became_peered":"2023-03-08T15:49:39.504110+0000","last_unstale":"2023-03-08T15:49:40.498616+0000","last_undegraded":"2023-03-08T15:49:40.498616+0000","last_fullsized":"2023-03-08T15:49:40.498616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:31:20.377122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497746+0000","last_change":"2023-03-08T15:49:39.517458+0000","last_active":"2023-03-08T15:49:40.497746+0000","last_peered":"2023-03-08T15:49:40.497746+0000","last_clean":"2023-03-08T15:49:40.497746+0000","last_became_active":"2023-03-08T15:49:39.517225+0000","last_became_peered":"2023-03-08T15:49:39.517225+0000","last_unstale":"2023-03-08T15:49:40.497746+0000","last_undegraded":"2023-03-08T15:49:40.497746+0000","last_fullsized":"2023-03-08T15:49:40.497746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498811+0000","last_change":"2023-03-08T15:49:39.518670+0000","last_active":"2023-03-08T15:49:40.498811+0000","last_peered":"2023-03-08T15:49:40.498811+0000","last_clean":"2023-03-08T15:49:40.498811+0000","last_became_active":"2023-03-08T15:49:39.518430+0000","last_became_peered":"2023-03-08T15:49:39.518430+0000","last_unstale":"2023-03-08T15:49:40.498811+0000","last_undegraded":"2023-03-08T15:49:40.498811+0000","last_fullsized":"2023-03-08T15:49:40.498811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":681731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8052,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363788,"statfs":{"total":96636764160,"available":96628518912,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9084,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362756,"statfs":{"total":96636764160,"available":96627462144,"internally_reserved":0,"allocated":839680,"data_stored":680533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7924,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363916,"statfs":{"total":96636764160,"available":96628649984,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":91203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":90235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-08T15:49:43.954 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-08T15:49:43.955 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-03-08T15:49:43.955 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-03-08T15:49:43.955 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-03-08T15:49:43.956 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-03-08T15:49:44.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.107+0000 7fc6b9566700 1 Processor -- start 2023-03-08T15:49:44.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.107+0000 7fc6b9566700 1 -- start start 2023-03-08T15:49:44.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.107+0000 7fc6b9566700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc6b4071c40 0x7fc6b4072010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.107+0000 7fc6b9566700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc6b414dc90 0x7fc6b4144740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.107+0000 7fc6b9566700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b40ba8f0 con 0x7fc6b4144c80 2023-03-08T15:49:44.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.107+0000 7fc6b9566700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b406bc00 con 0x7fc6b414dc90 2023-03-08T15:49:44.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.107+0000 7fc6b9566700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b414e4b0 con 0x7fc6b4071c40 2023-03-08T15:49:44.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.107+0000 7fc6b27fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc6b414dc90 0x7fc6b4144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.107+0000 7fc6b27fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc6b414dc90 0x7fc6b4144740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53662/0 (socket says 172.21.15.123:53662) 2023-03-08T15:49:44.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.107+0000 7fc6b27fc700 1 -- 172.21.15.123:0/2129189945 learned_addr learned my addr 172.21.15.123:0/2129189945 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:44.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.108+0000 7fc6b2ffd700 1 --2- 172.21.15.123:0/2129189945 >> v2:172.21.15.175:3300/0 conn(0x7fc6b4071c40 0x7fc6b4072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.108+0000 7fc6b27fc700 1 -- 172.21.15.123:0/2129189945 >> v2:172.21.15.175:3300/0 conn(0x7fc6b4071c40 msgr2=0x7fc6b4072010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:44.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.108+0000 7fc6b27fc700 1 --2- 172.21.15.123:0/2129189945 >> v2:172.21.15.175:3300/0 conn(0x7fc6b4071c40 0x7fc6b4072010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.108+0000 7fc6b27fc700 1 -- 172.21.15.123:0/2129189945 >> v1:172.21.15.175:6789/0 conn(0x7fc6b4144c80 legacy=0x7fc6b40bad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:44.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.108+0000 7fc6b27fc700 1 -- 172.21.15.123:0/2129189945 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b414e790 con 0x7fc6b414dc90 2023-03-08T15:49:44.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.108+0000 7fc6b27fc700 1 --2- 172.21.15.123:0/2129189945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6b414dc90 0x7fc6b4144740 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc6b406ae50 tx=0x7fc6a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8276ca127ff7965 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:44.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.108+0000 7fc6b1ffb700 1 -- 172.21.15.123:0/2129189945 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8004230 con 0x7fc6b414dc90 2023-03-08T15:49:44.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.108+0000 7fc6b1ffb700 1 -- 172.21.15.123:0/2129189945 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a8004390 con 0x7fc6b414dc90 2023-03-08T15:49:44.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.108+0000 7fc6b1ffb700 1 -- 172.21.15.123:0/2129189945 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a80036a0 con 0x7fc6b414dc90 2023-03-08T15:49:44.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.109+0000 7fc6b9566700 1 -- 172.21.15.123:0/2129189945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6b414dc90 msgr2=0x7fc6b4144740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.109+0000 7fc6b9566700 1 --2- 172.21.15.123:0/2129189945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6b414dc90 0x7fc6b4144740 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc6b406ae50 tx=0x7fc6a8009bd0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.109+0000 7fc6b9566700 1 -- 172.21.15.123:0/2129189945 shutdown_connections 2023-03-08T15:49:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.109+0000 7fc6b9566700 1 --2- 172.21.15.123:0/2129189945 >> v2:172.21.15.175:3300/0 conn(0x7fc6b4071c40 0x7fc6b4072010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.109+0000 7fc6b9566700 1 --2- 172.21.15.123:0/2129189945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6b414dc90 0x7fc6b4144740 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.109+0000 7fc6b9566700 1 -- 172.21.15.123:0/2129189945 >> 172.21.15.123:0/2129189945 conn(0x7fc6b406a250 msgr2=0x7fc6b406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.109+0000 7fc6b9566700 1 -- 172.21.15.123:0/2129189945 shutdown_connections 2023-03-08T15:49:44.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.109+0000 7fc6b9566700 1 -- 172.21.15.123:0/2129189945 wait complete. 2023-03-08T15:49:44.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.110+0000 7fc6b9566700 1 Processor -- start 2023-03-08T15:49:44.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.110+0000 7fc6b9566700 1 -- start start 2023-03-08T15:49:44.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.110+0000 7fc6b9566700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6b4071c40 0x7fc6b4138730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.110+0000 7fc6b9566700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6b4144c80 0x7fc6b41e0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.110+0000 7fc6b9566700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6b414dc90 0x7fc6b4147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b9566700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4138c70 con 0x7fc6b4071c40 2023-03-08T15:49:44.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b9566700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4139190 con 0x7fc6b4144c80 2023-03-08T15:49:44.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b9566700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b413a4d0 con 0x7fc6b414dc90 2023-03-08T15:49:44.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6b4071c40 0x7fc6b4138730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6b4071c40 0x7fc6b4138730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53672/0 (socket says 172.21.15.123:53672) 2023-03-08T15:49:44.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b2ffd700 1 -- 172.21.15.123:0/1825569103 learned_addr learned my addr 172.21.15.123:0/1825569103 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:44.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b37fe700 1 --2- 172.21.15.123:0/1825569103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6b414dc90 0x7fc6b4147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b27fc700 1 --2- 172.21.15.123:0/1825569103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6b4144c80 0x7fc6b41e0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b2ffd700 1 -- 172.21.15.123:0/1825569103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6b414dc90 msgr2=0x7fc6b4147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:44.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b2ffd700 1 --2- 172.21.15.123:0/1825569103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6b414dc90 0x7fc6b4147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b2ffd700 1 -- 172.21.15.123:0/1825569103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6b4144c80 msgr2=0x7fc6b41e0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:44.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b2ffd700 1 --2- 172.21.15.123:0/1825569103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6b4144c80 0x7fc6b41e0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b2ffd700 1 -- 172.21.15.123:0/1825569103 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8009550 con 0x7fc6b4071c40 2023-03-08T15:49:44.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b37fe700 1 --2- 172.21.15.123:0/1825569103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6b414dc90 0x7fc6b4147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:44.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b2ffd700 1 --2- 172.21.15.123:0/1825569103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6b4071c40 0x7fc6b4138730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400c820 tx=0x7fc6a400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:44.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc69b7fe700 1 -- 172.21.15.123:0/1825569103 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4011800 con 0x7fc6b4071c40 2023-03-08T15:49:44.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc69b7fe700 1 -- 172.21.15.123:0/1825569103 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a4011960 con 0x7fc6b4071c40 2023-03-08T15:49:44.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b9566700 1 -- 172.21.15.123:0/1825569103 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b414e110 con 0x7fc6b4071c40 2023-03-08T15:49:44.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc69b7fe700 1 -- 172.21.15.123:0/1825569103 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4011d10 con 0x7fc6b4071c40 2023-03-08T15:49:44.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.111+0000 7fc6b9566700 1 -- 172.21.15.123:0/1825569103 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b414ea70 con 0x7fc6b4071c40 2023-03-08T15:49:44.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.112+0000 7fc6b9566700 1 -- 172.21.15.123:0/1825569103 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b40bb490 con 0x7fc6b4071c40 2023-03-08T15:49:44.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.112+0000 7fc69b7fe700 1 -- 172.21.15.123:0/1825569103 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fc6a4021070 con 0x7fc6b4071c40 2023-03-08T15:49:44.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.113+0000 7fc69b7fe700 1 --2- 172.21.15.123:0/1825569103 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc6a0069900 0x7fc6a006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.113+0000 7fc6b27fc700 1 --2- 172.21.15.123:0/1825569103 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc6a0069900 0x7fc6a006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.113+0000 7fc69b7fe700 1 -- 172.21.15.123:0/1825569103 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6a4087470 con 0x7fc6b4071c40 2023-03-08T15:49:44.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.113+0000 7fc6b27fc700 1 --2- 172.21.15.123:0/1825569103 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc6a0069900 0x7fc6a006bdb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009130 tx=0x7fc6a8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:44.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.117+0000 7fc69b7fe700 1 -- 172.21.15.123:0/1825569103 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fc6a4053240 con 0x7fc6b4071c40 2023-03-08T15:49:44.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.357+0000 7fc6b9566700 1 -- 172.21.15.123:0/1825569103 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc6b406c730 con 0x7fc6b4071c40 2023-03-08T15:49:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.360+0000 7fc69b7fe700 1 -- 172.21.15.123:0/1825569103 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+168240 (secure 0 0 0) 0x7fc6a405ae60 con 0x7fc6b4071c40 2023-03-08T15:49:44.363 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:44.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.362+0000 7fc6b9566700 1 -- 172.21.15.123:0/1825569103 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc6a0069900 msgr2=0x7fc6a006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:44.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.362+0000 7fc6b9566700 1 --2- 172.21.15.123:0/1825569103 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc6a0069900 0x7fc6a006bdb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009130 tx=0x7fc6a8008030 comp rx=0 tx=0).stop 2023-03-08T15:49:44.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.362+0000 7fc6b9566700 1 -- 172.21.15.123:0/1825569103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6b4071c40 msgr2=0x7fc6b4138730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:44.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.362+0000 7fc6b9566700 1 --2- 172.21.15.123:0/1825569103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6b4071c40 0x7fc6b4138730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400c820 tx=0x7fc6a400cbe0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.362+0000 7fc6b9566700 1 -- 172.21.15.123:0/1825569103 shutdown_connections 2023-03-08T15:49:44.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.362+0000 7fc6b9566700 1 --2- 172.21.15.123:0/1825569103 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc6a0069900 0x7fc6a006bdb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.362+0000 7fc6b9566700 1 --2- 172.21.15.123:0/1825569103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6b414dc90 0x7fc6b4147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.362+0000 7fc6b9566700 1 --2- 172.21.15.123:0/1825569103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6b4071c40 0x7fc6b4138730 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.362+0000 7fc6b9566700 1 --2- 172.21.15.123:0/1825569103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6b4144c80 0x7fc6b41e0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.363+0000 7fc6b9566700 1 -- 172.21.15.123:0/1825569103 >> 172.21.15.123:0/1825569103 conn(0x7fc6b406a250 msgr2=0x7fc6b406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:44.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.363+0000 7fc6b9566700 1 -- 172.21.15.123:0/1825569103 shutdown_connections 2023-03-08T15:49:44.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.363+0000 7fc6b9566700 1 -- 172.21.15.123:0/1825569103 wait complete. 2023-03-08T15:49:44.376 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":5,"active_gid":4098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":142884},{"type":"v1","addr":"172.21.15.123:6833","nonce":142884}]},"active_addr":"172.21.15.123:6833/142884","active_change":"2023-03-08T15:49:19.963744+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":4004298166}]},{"addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":2979111407}]},{"addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":1004722869}]},{"addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":3899907413}]}]} 2023-03-08T15:49:44.380 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-03-08T15:49:44.380 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-03-08T15:49:44.381 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:49:44.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.498+0000 7ff5be5a0700 1 Processor -- start 2023-03-08T15:49:44.500 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.498+0000 7ff5be5a0700 1 -- start start 2023-03-08T15:49:44.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.499+0000 7ff5be5a0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b8144650 0x7ff5b8144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.499+0000 7ff5be5a0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b8071c80 con 0x7ff5b814fe40 2023-03-08T15:49:44.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.499+0000 7ff5be5a0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b8072310 con 0x7ff5b8070860 2023-03-08T15:49:44.502 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.499+0000 7ff5be5a0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b80be3a0 con 0x7ff5b8144650 2023-03-08T15:49:44.502 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.499+0000 7ff5bdd9f700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff5b814fe40 0x7ff5b8152220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49616/0 (socket says 172.21.15.123:49616) 2023-03-08T15:49:44.502 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.499+0000 7ff5bdd9f700 1 -- 172.21.15.123:0/2078112271 learned_addr learned my addr 172.21.15.123:0/2078112271 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:44.502 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.499+0000 7ff5bcd9d700 1 --2- 172.21.15.123:0/2078112271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b8144650 0x7ff5b8144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.502 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.499+0000 7ff5abfff700 1 -- 172.21.15.123:0/2078112271 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851297916 0 0) 0x7ff5b8071c80 con 0x7ff5b814fe40 2023-03-08T15:49:44.502 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.499+0000 7ff5abfff700 1 -- 172.21.15.123:0/2078112271 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5a40035b0 con 0x7ff5b814fe40 2023-03-08T15:49:44.502 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.500+0000 7ff5abfff700 1 -- 172.21.15.123:0/2078112271 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896028010 0 0) 0x7ff5b8072310 con 0x7ff5b8070860 2023-03-08T15:49:44.503 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.500+0000 7ff5abfff700 1 -- 172.21.15.123:0/2078112271 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5b8071c80 con 0x7ff5b8070860 2023-03-08T15:49:44.503 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.500+0000 7ff5bcd9d700 1 -- 172.21.15.123:0/2078112271 >> v1:172.21.15.175:6789/0 conn(0x7ff5b8070860 legacy=0x7ff5b81475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:44.503 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.500+0000 7ff5bcd9d700 1 -- 172.21.15.123:0/2078112271 >> v1:172.21.15.123:6789/0 conn(0x7ff5b814fe40 legacy=0x7ff5b8152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:44.503 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.500+0000 7ff5bcd9d700 1 -- 172.21.15.123:0/2078112271 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b8070370 con 0x7ff5b8144650 2023-03-08T15:49:44.503 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.500+0000 7ff5bcd9d700 1 --2- 172.21.15.123:0/2078112271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b8144650 0x7ff5b8144ac0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009870 tx=0x7ff5b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2036937d3d7280a server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:44.503 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.500+0000 7ff5abfff700 1 -- 172.21.15.123:0/2078112271 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4011830 con 0x7ff5b8144650 2023-03-08T15:49:44.503 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.500+0000 7ff5abfff700 1 -- 172.21.15.123:0/2078112271 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b4011990 con 0x7ff5b8144650 2023-03-08T15:49:44.503 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.500+0000 7ff5abfff700 1 -- 172.21.15.123:0/2078112271 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4011d20 con 0x7ff5b8144650 2023-03-08T15:49:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.500+0000 7ff5be5a0700 1 -- 172.21.15.123:0/2078112271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b8144650 msgr2=0x7ff5b8144ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.500+0000 7ff5be5a0700 1 --2- 172.21.15.123:0/2078112271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b8144650 0x7ff5b8144ac0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009870 tx=0x7ff5b4009b80 comp rx=0 tx=0).stop 2023-03-08T15:49:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.501+0000 7ff5be5a0700 1 -- 172.21.15.123:0/2078112271 shutdown_connections 2023-03-08T15:49:44.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.501+0000 7ff5be5a0700 1 --2- 172.21.15.123:0/2078112271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b8144650 0x7ff5b8144ac0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.501+0000 7ff5be5a0700 1 -- 172.21.15.123:0/2078112271 >> 172.21.15.123:0/2078112271 conn(0x7ff5b80bd3d0 msgr2=0x7ff5b80bd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:44.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.501+0000 7ff5be5a0700 1 -- 172.21.15.123:0/2078112271 shutdown_connections 2023-03-08T15:49:44.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.501+0000 7ff5be5a0700 1 -- 172.21.15.123:0/2078112271 wait complete. 2023-03-08T15:49:44.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.502+0000 7ff5be5a0700 1 Processor -- start 2023-03-08T15:49:44.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.502+0000 7ff5be5a0700 1 -- start start 2023-03-08T15:49:44.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.502+0000 7ff5be5a0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b8070860 0x7ff5b813fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.502+0000 7ff5be5a0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b8144650 0x7ff5b80b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.502+0000 7ff5be5a0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5b814fe40 0x7ff5b80b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.502+0000 7ff5be5a0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b81403a0 con 0x7ff5b814fe40 2023-03-08T15:49:44.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.502+0000 7ff5be5a0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b80b4a70 con 0x7ff5b8070860 2023-03-08T15:49:44.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.502+0000 7ff5be5a0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b814a910 con 0x7ff5b8144650 2023-03-08T15:49:44.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.502+0000 7ff5bdd9f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5b814fe40 0x7ff5b80b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.502+0000 7ff5bdd9f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5b814fe40 0x7ff5b80b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53684/0 (socket says 172.21.15.123:53684) 2023-03-08T15:49:44.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.502+0000 7ff5bdd9f700 1 -- 172.21.15.123:0/1760058788 learned_addr learned my addr 172.21.15.123:0/1760058788 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:44.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.502+0000 7ff5bcd9d700 1 --2- 172.21.15.123:0/1760058788 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b8144650 0x7ff5b80b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.502+0000 7ff5bd59e700 1 --2- 172.21.15.123:0/1760058788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b8070860 0x7ff5b813fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.503+0000 7ff5bdd9f700 1 -- 172.21.15.123:0/1760058788 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b8144650 msgr2=0x7ff5b80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.503+0000 7ff5bdd9f700 1 --2- 172.21.15.123:0/1760058788 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b8144650 0x7ff5b80b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.503+0000 7ff5bdd9f700 1 -- 172.21.15.123:0/1760058788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b8070860 msgr2=0x7ff5b813fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.503+0000 7ff5bdd9f700 1 --2- 172.21.15.123:0/1760058788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b8070860 0x7ff5b813fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.503+0000 7ff5bdd9f700 1 -- 172.21.15.123:0/1760058788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b40094a0 con 0x7ff5b814fe40 2023-03-08T15:49:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.503+0000 7ff5bd59e700 1 --2- 172.21.15.123:0/1760058788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b8070860 0x7ff5b813fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.503+0000 7ff5bdd9f700 1 --2- 172.21.15.123:0/1760058788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5b814fe40 0x7ff5b80b5600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff5b000caf0 tx=0x7ff5b000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:44.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.503+0000 7ff5a9ffb700 1 -- 172.21.15.123:0/1760058788 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b000aa60 con 0x7ff5b814fe40 2023-03-08T15:49:44.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.503+0000 7ff5a9ffb700 1 -- 172.21.15.123:0/1760058788 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b000abc0 con 0x7ff5b814fe40 2023-03-08T15:49:44.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.503+0000 7ff5be5a0700 1 -- 172.21.15.123:0/1760058788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b80be0c0 con 0x7ff5b814fe40 2023-03-08T15:49:44.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.503+0000 7ff5a9ffb700 1 -- 172.21.15.123:0/1760058788 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0012400 con 0x7ff5b814fe40 2023-03-08T15:49:44.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.503+0000 7ff5be5a0700 1 -- 172.21.15.123:0/1760058788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b8145000 con 0x7ff5b814fe40 2023-03-08T15:49:44.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.504+0000 7ff5be5a0700 1 -- 172.21.15.123:0/1760058788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b8072590 con 0x7ff5b814fe40 2023-03-08T15:49:44.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.504+0000 7ff5a9ffb700 1 -- 172.21.15.123:0/1760058788 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7ff5b0019030 con 0x7ff5b814fe40 2023-03-08T15:49:44.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.504+0000 7ff5a9ffb700 1 --2- 172.21.15.123:0/1760058788 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff59c069900 0x7ff59c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.505+0000 7ff5a9ffb700 1 -- 172.21.15.123:0/1760058788 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff5b0087220 con 0x7ff5b814fe40 2023-03-08T15:49:44.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.505+0000 7ff5bd59e700 1 --2- 172.21.15.123:0/1760058788 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff59c069900 0x7ff59c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.505+0000 7ff5bd59e700 1 --2- 172.21.15.123:0/1760058788 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff59c069900 0x7ff59c06bdb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0011e0 tx=0x7ff5ac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:44.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.509+0000 7ff5a9ffb700 1 -- 172.21.15.123:0/1760058788 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7ff5b0052f70 con 0x7ff5b814fe40 2023-03-08T15:49:44.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.695+0000 7ff5be5a0700 1 -- 172.21.15.123:0/1760058788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5b804f4e0 con 0x7ff5b814fe40 2023-03-08T15:49:44.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.696+0000 7ff5a9ffb700 1 -- 172.21.15.123:0/1760058788 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17955 (secure 0 0 0) 0x7ff5b0056590 con 0x7ff5b814fe40 2023-03-08T15:49:44.697 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:44.698 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:40.490671+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:49:37.104720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-08T15:49:38.431537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:49:44.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.698+0000 7ff5be5a0700 1 -- 172.21.15.123:0/1760058788 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff59c069900 msgr2=0x7ff59c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:44.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.698+0000 7ff5be5a0700 1 --2- 172.21.15.123:0/1760058788 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff59c069900 0x7ff59c06bdb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0011e0 tx=0x7ff5ac009040 comp rx=0 tx=0).stop 2023-03-08T15:49:44.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.698+0000 7ff5be5a0700 1 -- 172.21.15.123:0/1760058788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5b814fe40 msgr2=0x7ff5b80b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:44.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.698+0000 7ff5be5a0700 1 --2- 172.21.15.123:0/1760058788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5b814fe40 0x7ff5b80b5600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff5b000caf0 tx=0x7ff5b000ce00 comp rx=0 tx=0).stop 2023-03-08T15:49:44.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.698+0000 7ff5be5a0700 1 -- 172.21.15.123:0/1760058788 shutdown_connections 2023-03-08T15:49:44.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.698+0000 7ff5be5a0700 1 --2- 172.21.15.123:0/1760058788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5b814fe40 0x7ff5b80b5600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.698+0000 7ff5be5a0700 1 --2- 172.21.15.123:0/1760058788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b8070860 0x7ff5b813fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.698+0000 7ff5be5a0700 1 --2- 172.21.15.123:0/1760058788 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff59c069900 0x7ff59c06bdb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.698+0000 7ff5be5a0700 1 --2- 172.21.15.123:0/1760058788 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b8144650 0x7ff5b80b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.698+0000 7ff5be5a0700 1 -- 172.21.15.123:0/1760058788 >> 172.21.15.123:0/1760058788 conn(0x7ff5b80bd3d0 msgr2=0x7ff5b8147730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:44.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.698+0000 7ff5be5a0700 1 -- 172.21.15.123:0/1760058788 shutdown_connections 2023-03-08T15:49:44.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.698+0000 7ff5be5a0700 1 -- 172.21.15.123:0/1760058788 wait complete. 2023-03-08T15:49:44.711 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-03-08T15:49:44.712 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:49:44.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.830+0000 7f04ff3df700 1 Processor -- start 2023-03-08T15:49:44.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.830+0000 7f04ff3df700 1 -- start start 2023-03-08T15:49:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04ff3df700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f04f81427e0 0x7f04f80b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04ff3df700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04f80a0f70 0x7f04f806d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04ff3df700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f8148a30 con 0x7f04f8070b00 2023-03-08T15:49:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04ff3df700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f81484d0 con 0x7f04f80a0f70 2023-03-08T15:49:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04ff3df700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f8072970 con 0x7f04f81427e0 2023-03-08T15:49:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04fd97c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04f80a0f70 0x7f04f806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04fd97c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04f80a0f70 0x7f04f806d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53690/0 (socket says 172.21.15.123:53690) 2023-03-08T15:49:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04fd97c700 1 -- 172.21.15.123:0/1921027535 learned_addr learned my addr 172.21.15.123:0/1921027535 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04fd17b700 1 --2- 172.21.15.123:0/1921027535 >> v2:172.21.15.175:3300/0 conn(0x7f04f81427e0 0x7f04f80b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04fd97c700 1 -- 172.21.15.123:0/1921027535 >> v2:172.21.15.175:3300/0 conn(0x7f04f81427e0 msgr2=0x7f04f80b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:44.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04fd97c700 1 --2- 172.21.15.123:0/1921027535 >> v2:172.21.15.175:3300/0 conn(0x7f04f81427e0 0x7f04f80b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04fd97c700 1 -- 172.21.15.123:0/1921027535 >> v1:172.21.15.175:6789/0 conn(0x7f04f8070b00 legacy=0x7f04f8148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:44.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04fd97c700 1 -- 172.21.15.123:0/1921027535 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f80715d0 con 0x7f04f80a0f70 2023-03-08T15:49:44.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04fd17b700 1 --2- 172.21.15.123:0/1921027535 >> v2:172.21.15.175:3300/0 conn(0x7f04f81427e0 0x7f04f80b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:49:44.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04fd97c700 1 --2- 172.21.15.123:0/1921027535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04f80a0f70 0x7f04f806d570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f04f80bf290 tx=0x7f04f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a081040c6a60014b server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:44.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04effff700 1 -- 172.21.15.123:0/1921027535 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f000e070 con 0x7f04f80a0f70 2023-03-08T15:49:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04effff700 1 -- 172.21.15.123:0/1921027535 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f0003a20 con 0x7f04f80a0f70 2023-03-08T15:49:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.831+0000 7f04effff700 1 -- 172.21.15.123:0/1921027535 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0003dd0 con 0x7f04f80a0f70 2023-03-08T15:49:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.832+0000 7f04ff3df700 1 -- 172.21.15.123:0/1921027535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04f80a0f70 msgr2=0x7f04f806d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.832+0000 7f04ff3df700 1 --2- 172.21.15.123:0/1921027535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04f80a0f70 0x7f04f806d570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f04f80bf290 tx=0x7f04f000b330 comp rx=0 tx=0).stop 2023-03-08T15:49:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.832+0000 7f04ff3df700 1 -- 172.21.15.123:0/1921027535 shutdown_connections 2023-03-08T15:49:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.832+0000 7f04ff3df700 1 --2- 172.21.15.123:0/1921027535 >> v2:172.21.15.175:3300/0 conn(0x7f04f81427e0 0x7f04f80b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.832+0000 7f04ff3df700 1 --2- 172.21.15.123:0/1921027535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04f80a0f70 0x7f04f806d570 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.832+0000 7f04ff3df700 1 -- 172.21.15.123:0/1921027535 >> 172.21.15.123:0/1921027535 conn(0x7f04f80be6f0 msgr2=0x7f04f80beac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:44.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.832+0000 7f04ff3df700 1 -- 172.21.15.123:0/1921027535 shutdown_connections 2023-03-08T15:49:44.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.832+0000 7f04ff3df700 1 -- 172.21.15.123:0/1921027535 wait complete. 2023-03-08T15:49:44.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.833+0000 7f04ff3df700 1 Processor -- start 2023-03-08T15:49:44.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.833+0000 7f04ff3df700 1 -- start start 2023-03-08T15:49:44.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04ff3df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04f8070b00 0x7f04f806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04ff3df700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f80a0f70 0x7f04f813f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04ff3df700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f81427e0 0x7f04f80b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04ff3df700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f813d640 con 0x7f04f8070b00 2023-03-08T15:49:44.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04ff3df700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f813d080 con 0x7f04f80a0f70 2023-03-08T15:49:44.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04ff3df700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f813d360 con 0x7f04f81427e0 2023-03-08T15:49:44.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04fd17b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04f8070b00 0x7f04f806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04fd17b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04f8070b00 0x7f04f806c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53700/0 (socket says 172.21.15.123:53700) 2023-03-08T15:49:44.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04fd17b700 1 -- 172.21.15.123:0/4237312196 learned_addr learned my addr 172.21.15.123:0/4237312196 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:44.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04fc97a700 1 --2- 172.21.15.123:0/4237312196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f80a0f70 0x7f04f813f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04fd97c700 1 --2- 172.21.15.123:0/4237312196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f81427e0 0x7f04f80b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04fd17b700 1 -- 172.21.15.123:0/4237312196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f81427e0 msgr2=0x7f04f80b82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:44.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04fd17b700 1 --2- 172.21.15.123:0/4237312196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f81427e0 0x7f04f80b82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04fd17b700 1 -- 172.21.15.123:0/4237312196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f80a0f70 msgr2=0x7f04f813f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:44.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04fd17b700 1 --2- 172.21.15.123:0/4237312196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f80a0f70 0x7f04f813f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:44.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04fd17b700 1 -- 172.21.15.123:0/4237312196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f0009b30 con 0x7f04f8070b00 2023-03-08T15:49:44.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04fd17b700 1 --2- 172.21.15.123:0/4237312196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04f8070b00 0x7f04f806c9d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f04e800c7f0 tx=0x7f04e800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:44.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04edffb700 1 -- 172.21.15.123:0/4237312196 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8011800 con 0x7f04f8070b00 2023-03-08T15:49:44.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04edffb700 1 -- 172.21.15.123:0/4237312196 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e8011960 con 0x7f04f8070b00 2023-03-08T15:49:44.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04ff3df700 1 -- 172.21.15.123:0/4237312196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f81486c0 con 0x7f04f8070b00 2023-03-08T15:49:44.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.834+0000 7f04edffb700 1 -- 172.21.15.123:0/4237312196 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8011cf0 con 0x7f04f8070b00 2023-03-08T15:49:44.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.835+0000 7f04ff3df700 1 -- 172.21.15.123:0/4237312196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f80718a0 con 0x7f04f8070b00 2023-03-08T15:49:44.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.835+0000 7f04ff3df700 1 -- 172.21.15.123:0/4237312196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f8142bb0 con 0x7f04f8070b00 2023-03-08T15:49:44.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.836+0000 7f04edffb700 1 -- 172.21.15.123:0/4237312196 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f04e8021070 con 0x7f04f8070b00 2023-03-08T15:49:44.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.836+0000 7f04edffb700 1 --2- 172.21.15.123:0/4237312196 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f04dc069900 0x7f04dc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:44.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.836+0000 7f04edffb700 1 -- 172.21.15.123:0/4237312196 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f04e8087340 con 0x7f04f8070b00 2023-03-08T15:49:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.836+0000 7f04fc97a700 1 --2- 172.21.15.123:0/4237312196 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f04dc069900 0x7f04dc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.837+0000 7f04fc97a700 1 --2- 172.21.15.123:0/4237312196 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f04dc069900 0x7f04dc06bdb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f04f80be690 tx=0x7f04f4007ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:44.840+0000 7f04edffb700 1 -- 172.21.15.123:0/4237312196 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f04e8053110 con 0x7f04f8070b00 2023-03-08T15:49:45.031 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.030+0000 7f04ff3df700 1 -- 172.21.15.123:0/4237312196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04f80744c0 con 0x7f04f8070b00 2023-03-08T15:49:45.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.031+0000 7f04edffb700 1 -- 172.21.15.123:0/4237312196 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f04e8056730 con 0x7f04f8070b00 2023-03-08T15:49:45.032 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:45.033 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:40.490671+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:49:37.104720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-08T15:49:38.431537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:49:45.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.033+0000 7f04ff3df700 1 -- 172.21.15.123:0/4237312196 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f04dc069900 msgr2=0x7f04dc06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.033+0000 7f04ff3df700 1 --2- 172.21.15.123:0/4237312196 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f04dc069900 0x7f04dc06bdb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f04f80be690 tx=0x7f04f4007ec0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.033+0000 7f04ff3df700 1 -- 172.21.15.123:0/4237312196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04f8070b00 msgr2=0x7f04f806c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.033+0000 7f04ff3df700 1 --2- 172.21.15.123:0/4237312196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04f8070b00 0x7f04f806c9d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f04e800c7f0 tx=0x7f04e800cb00 comp rx=0 tx=0).stop 2023-03-08T15:49:45.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.033+0000 7f04ff3df700 1 -- 172.21.15.123:0/4237312196 shutdown_connections 2023-03-08T15:49:45.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.033+0000 7f04ff3df700 1 --2- 172.21.15.123:0/4237312196 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f04dc069900 0x7f04dc06bdb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.033+0000 7f04ff3df700 1 --2- 172.21.15.123:0/4237312196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f81427e0 0x7f04f80b82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.033+0000 7f04ff3df700 1 --2- 172.21.15.123:0/4237312196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04f8070b00 0x7f04f806c9d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.033+0000 7f04ff3df700 1 --2- 172.21.15.123:0/4237312196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f80a0f70 0x7f04f813f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.033+0000 7f04ff3df700 1 -- 172.21.15.123:0/4237312196 >> 172.21.15.123:0/4237312196 conn(0x7f04f80be6f0 msgr2=0x7f04f80b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.033+0000 7f04ff3df700 1 -- 172.21.15.123:0/4237312196 shutdown_connections 2023-03-08T15:49:45.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.033+0000 7f04ff3df700 1 -- 172.21.15.123:0/4237312196 wait complete. 2023-03-08T15:49:45.047 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-03-08T15:49:45.047 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-03-08T15:49:45.048 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-03-08T15:49:45.048 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-03-08T15:49:45.049 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-03-08T15:49:45.049 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-03-08T15:49:45.050 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-03-08T15:49:45.051 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-03-08T15:49:45.151 INFO:tasks.ceph.mds.b.smithi175.stderr:2023-03-08T15:49:45.150+0000 7fc1da7c2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-08T15:49:45.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.246+0000 7f784cf43700 1 Processor -- start 2023-03-08T15:49:45.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.246+0000 7f784cf43700 1 -- start start 2023-03-08T15:49:45.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.248+0000 7f784cf43700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78480b47e0 0x7f784814f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.248+0000 7f784cf43700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f78480b6500 0x7f784814f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.248+0000 7f784cf43700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78480b4010 con 0x7f784806aee0 2023-03-08T15:49:45.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.248+0000 7f784cf43700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78480b3e00 con 0x7f78480b6500 2023-03-08T15:49:45.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.248+0000 7f784cf43700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784814ec70 con 0x7f78480b47e0 2023-03-08T15:49:45.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.248+0000 7f7845d9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f784806aee0 0x7f7848152150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49630/0 (socket says 172.21.15.123:49630) 2023-03-08T15:49:45.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.248+0000 7f7845d9b700 1 -- 172.21.15.123:0/2922149477 learned_addr learned my addr 172.21.15.123:0/2922149477 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:45.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.248+0000 7f7846d9d700 1 --2- 172.21.15.123:0/2922149477 >> v2:172.21.15.123:3300/0 conn(0x7f78480b6500 0x7f784814f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.248+0000 7f784659c700 1 --2- 172.21.15.123:0/2922149477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78480b47e0 0x7f784814f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.248+0000 7f7846d9d700 1 -- 172.21.15.123:0/2922149477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78480b47e0 msgr2=0x7f784814f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.248+0000 7f7846d9d700 1 --2- 172.21.15.123:0/2922149477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78480b47e0 0x7f784814f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.248+0000 7f7846d9d700 1 -- 172.21.15.123:0/2922149477 >> v1:172.21.15.123:6789/0 conn(0x7f784806aee0 legacy=0x7f7848152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.248+0000 7f7846d9d700 1 -- 172.21.15.123:0/2922149477 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7848149250 con 0x7f78480b6500 2023-03-08T15:49:45.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.248+0000 7f784659c700 1 --2- 172.21.15.123:0/2922149477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78480b47e0 0x7f784814f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:45.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.249+0000 7f7846d9d700 1 --2- 172.21.15.123:0/2922149477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78480b6500 0x7f784814f6d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7840009d90 tx=0x7f784000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797165de21ea12a2 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.249+0000 7f784559a700 1 -- 172.21.15.123:0/2922149477 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784000e070 con 0x7f78480b6500 2023-03-08T15:49:45.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.249+0000 7f784559a700 1 -- 172.21.15.123:0/2922149477 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7840003a20 con 0x7f78480b6500 2023-03-08T15:49:45.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.249+0000 7f784559a700 1 -- 172.21.15.123:0/2922149477 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840003dd0 con 0x7f78480b6500 2023-03-08T15:49:45.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.250+0000 7f784cf43700 1 -- 172.21.15.123:0/2922149477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78480b6500 msgr2=0x7f784814f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.250+0000 7f784cf43700 1 --2- 172.21.15.123:0/2922149477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78480b6500 0x7f784814f6d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7840009d90 tx=0x7f784000b330 comp rx=0 tx=0).stop 2023-03-08T15:49:45.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.252+0000 7f4fe0e70700 1 Processor -- start 2023-03-08T15:49:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.252+0000 7f4fe0e70700 1 -- start start 2023-03-08T15:49:45.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.253+0000 7f4fe0e70700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4fdc0b3c50 0x7f4fdc148970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.253+0000 7f4fe0e70700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4fdc148eb0 0x7f4fdc152d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.253+0000 7f4fe0e70700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fdc0bd420 con 0x7f4fdc0b6a00 2023-03-08T15:49:45.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.253+0000 7f4fe0e70700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fdc142cc0 con 0x7f4fdc0b3c50 2023-03-08T15:49:45.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.254+0000 7f4fe0e70700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fdc148520 con 0x7f4fdc148eb0 2023-03-08T15:49:45.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.255+0000 7f784cf43700 1 -- 172.21.15.123:0/2922149477 shutdown_connections 2023-03-08T15:49:45.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.255+0000 7f784cf43700 1 --2- 172.21.15.123:0/2922149477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78480b6500 0x7f784814f6d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.255+0000 7f784cf43700 1 --2- 172.21.15.123:0/2922149477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78480b47e0 0x7f784814f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.255+0000 7f784cf43700 1 -- 172.21.15.123:0/2922149477 >> 172.21.15.123:0/2922149477 conn(0x7f78480bc480 msgr2=0x7f78480bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.256 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.255+0000 7f784cf43700 1 -- 172.21.15.123:0/2922149477 shutdown_connections 2023-03-08T15:49:45.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.255+0000 7f784cf43700 1 -- 172.21.15.123:0/2922149477 wait complete. 2023-03-08T15:49:45.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.255+0000 7f4fdad9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4fdc148eb0 0x7f4fdc152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.255+0000 7f4fdad9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4fdc148eb0 0x7f4fdc152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:34562/0 (socket says 172.21.15.123:34562) 2023-03-08T15:49:45.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.255+0000 7f4fdad9d700 1 -- 172.21.15.123:0/623412313 learned_addr learned my addr 172.21.15.123:0/623412313 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.256+0000 7f4fdad9d700 1 -- 172.21.15.123:0/623412313 >> v2:172.21.15.123:3300/0 conn(0x7f4fdc0b3c50 msgr2=0x7f4fdc148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.256+0000 7f4fdad9d700 1 --2- 172.21.15.123:0/623412313 >> v2:172.21.15.123:3300/0 conn(0x7f4fdc0b3c50 0x7f4fdc148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.256+0000 7f4fdad9d700 1 -- 172.21.15.123:0/623412313 >> v1:172.21.15.123:6789/0 conn(0x7f4fdc0b6a00 legacy=0x7f4fdc06b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.258 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.256+0000 7f4fdad9d700 1 -- 172.21.15.123:0/623412313 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc071cd0 con 0x7f4fdc148eb0 2023-03-08T15:49:45.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.256+0000 7f784cf43700 1 Processor -- start 2023-03-08T15:49:45.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.255+0000 7f61dfb01700 1 Processor -- start 2023-03-08T15:49:45.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.255+0000 7f61dfb01700 1 -- start start 2023-03-08T15:49:45.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.256+0000 7f61dfb01700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f61d8150430 0x7f61d8152810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.256+0000 7f61dfb01700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d8071220 con 0x7f61d8140df0 2023-03-08T15:49:45.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.256+0000 7f61dfb01700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d80b8d50 con 0x7f61d80b8300 2023-03-08T15:49:45.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.256+0000 7f61dfb01700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d8072080 con 0x7f61d8150430 2023-03-08T15:49:45.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.257+0000 7f61de09e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f61d8150430 0x7f61d8152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.260 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.257+0000 7f4fdad9d700 1 --2- 172.21.15.123:0/623412313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc148eb0 0x7f4fdc152d50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc071940 tx=0x7f4fd400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=454f33439022f20 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.257+0000 7f4fd959a700 1 -- 172.21.15.123:0/623412313 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd400e070 con 0x7f4fdc148eb0 2023-03-08T15:49:45.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.257+0000 7f4fd959a700 1 -- 172.21.15.123:0/623412313 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd4003a20 con 0x7f4fdc148eb0 2023-03-08T15:49:45.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.257+0000 7f4fd959a700 1 -- 172.21.15.123:0/623412313 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4003dd0 con 0x7f4fdc148eb0 2023-03-08T15:49:45.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.257+0000 7f784cf43700 1 -- start start 2023-03-08T15:49:45.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f784cf43700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f784806aee0 0x7f78481255e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f784cf43700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78480b47e0 0x7f78481f10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f784cf43700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78480b6500 0x7f78481240c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f784cf43700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7848125b20 con 0x7f784806aee0 2023-03-08T15:49:45.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f784cf43700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78481f0c60 con 0x7f78480b47e0 2023-03-08T15:49:45.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f784cf43700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7848127100 con 0x7f78480b6500 2023-03-08T15:49:45.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f61de09e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f61d8150430 0x7f61d8152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:34576/0 (socket says 172.21.15.123:34576) 2023-03-08T15:49:45.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f61de09e700 1 -- 172.21.15.123:0/481983769 learned_addr learned my addr 172.21.15.123:0/481983769 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f7845d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78480b47e0 0x7f78481f10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f7845d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78480b47e0 0x7f78481f10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:34582/0 (socket says 172.21.15.123:34582) 2023-03-08T15:49:45.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f7845d9b700 1 -- 172.21.15.123:0/2805183836 learned_addr learned my addr 172.21.15.123:0/2805183836 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f7846d9d700 1 --2- 172.21.15.123:0/2805183836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78480b6500 0x7f78481240c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f61de09e700 1 -- 172.21.15.123:0/481983769 >> v1:172.21.15.175:6789/0 conn(0x7f61d80b8300 legacy=0x7f61d806f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f61de09e700 1 -- 172.21.15.123:0/481983769 >> v1:172.21.15.123:6789/0 conn(0x7f61d8140df0 legacy=0x7f61d8071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f61de09e700 1 -- 172.21.15.123:0/481983769 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d806fa90 con 0x7f61d8150430 2023-03-08T15:49:45.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f7846d9d700 1 -- 172.21.15.123:0/2805183836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78480b47e0 msgr2=0x7f78481f10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f7846d9d700 1 --2- 172.21.15.123:0/2805183836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78480b47e0 0x7f78481f10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f7846d9d700 1 -- 172.21.15.123:0/2805183836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f784806aee0 msgr2=0x7f78481255e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f7846d9d700 1 --2- 172.21.15.123:0/2805183836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f784806aee0 0x7f78481255e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f7846d9d700 1 -- 172.21.15.123:0/2805183836 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380094a0 con 0x7f78480b6500 2023-03-08T15:49:45.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f4fe0e70700 1 -- 172.21.15.123:0/623412313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc148eb0 msgr2=0x7f4fdc152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.258+0000 7f4fe0e70700 1 --2- 172.21.15.123:0/623412313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc148eb0 0x7f4fdc152d50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc071940 tx=0x7f4fd400b330 comp rx=0 tx=0).stop 2023-03-08T15:49:45.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.259+0000 7f61de09e700 1 --2- 172.21.15.123:0/481983769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d8150430 0x7f61d8152810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009d40 tx=0x7f61d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=874b576fa987ab0d server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.259+0000 7f7846d9d700 1 --2- 172.21.15.123:0/2805183836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78480b6500 0x7f78481240c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f784806e5f0 tx=0x7f7840004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.259+0000 7f4fe0e70700 1 -- 172.21.15.123:0/623412313 shutdown_connections 2023-03-08T15:49:45.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.259+0000 7f4fe0e70700 1 --2- 172.21.15.123:0/623412313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc148eb0 0x7f4fdc152d50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.259+0000 7f4fe0e70700 1 --2- 172.21.15.123:0/623412313 >> v2:172.21.15.123:3300/0 conn(0x7f4fdc0b3c50 0x7f4fdc148970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.259+0000 7f4fe0e70700 1 -- 172.21.15.123:0/623412313 >> 172.21.15.123:0/623412313 conn(0x7f4fdc0ba3c0 msgr2=0x7f4fdc0bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.259+0000 7f61dc89b700 1 -- 172.21.15.123:0/481983769 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0003c20 con 0x7f61d8150430 2023-03-08T15:49:45.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.259+0000 7f61dc89b700 1 -- 172.21.15.123:0/481983769 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d0009e90 con 0x7f61d8150430 2023-03-08T15:49:45.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.259+0000 7f61dc89b700 1 -- 172.21.15.123:0/481983769 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d000b980 con 0x7f61d8150430 2023-03-08T15:49:45.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.259+0000 7f7836ffd700 1 -- 172.21.15.123:0/2805183836 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840009410 con 0x7f78480b6500 2023-03-08T15:49:45.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.259+0000 7f7836ffd700 1 -- 172.21.15.123:0/2805183836 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7840004690 con 0x7f78480b6500 2023-03-08T15:49:45.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.259+0000 7f784cf43700 1 -- 172.21.15.123:0/2805183836 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7840009a70 con 0x7f78480b6500 2023-03-08T15:49:45.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.259+0000 7f784cf43700 1 -- 172.21.15.123:0/2805183836 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78480b3880 con 0x7f78480b6500 2023-03-08T15:49:45.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.260+0000 7f61dfb01700 1 -- 172.21.15.123:0/481983769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d8150430 msgr2=0x7f61d8152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.260+0000 7f61dfb01700 1 --2- 172.21.15.123:0/481983769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d8150430 0x7f61d8152810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009d40 tx=0x7f61d000b330 comp rx=0 tx=0).stop 2023-03-08T15:49:45.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.260+0000 7f7836ffd700 1 -- 172.21.15.123:0/2805183836 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840012430 con 0x7f78480b6500 2023-03-08T15:49:45.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.260+0000 7f61dfb01700 1 -- 172.21.15.123:0/481983769 shutdown_connections 2023-03-08T15:49:45.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.260+0000 7f61dfb01700 1 --2- 172.21.15.123:0/481983769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d8150430 0x7f61d8152810 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.260+0000 7f61dfb01700 1 -- 172.21.15.123:0/481983769 >> 172.21.15.123:0/481983769 conn(0x7f61d80b9800 msgr2=0x7f61d80b9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.260+0000 7f784cf43700 1 -- 172.21.15.123:0/2805183836 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f782c000fb0 con 0x7f78480b6500 2023-03-08T15:49:45.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.260+0000 7f4fe0e70700 1 -- 172.21.15.123:0/623412313 shutdown_connections 2023-03-08T15:49:45.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.260+0000 7f4fe0e70700 1 -- 172.21.15.123:0/623412313 wait complete. 2023-03-08T15:49:45.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.260+0000 7f61dfb01700 1 -- 172.21.15.123:0/481983769 shutdown_connections 2023-03-08T15:49:45.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.260+0000 7f61dfb01700 1 -- 172.21.15.123:0/481983769 wait complete. 2023-03-08T15:49:45.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.261+0000 7f7b22f76700 1 Processor -- start 2023-03-08T15:49:45.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.261+0000 7f47df7ae700 1 Processor -- start 2023-03-08T15:49:45.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.261+0000 7f462fefc700 1 Processor -- start 2023-03-08T15:49:45.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.261+0000 7f7836ffd700 1 -- 172.21.15.123:0/2805183836 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f7840012610 con 0x7f78480b6500 2023-03-08T15:49:45.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.261+0000 7f61dfb01700 1 Processor -- start 2023-03-08T15:49:45.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f7836ffd700 1 --2- 172.21.15.123:0/2805183836 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7828069920 0x7f782806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f7836ffd700 1 -- 172.21.15.123:0/2805183836 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78400897f0 con 0x7f78480b6500 2023-03-08T15:49:45.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f7836ffd700 1 --2- 172.21.15.123:0/2805183836 >> [v2:172.21.15.175:6808/114830,v1:172.21.15.175:6809/114830] conn(0x7f78280721d0 0x7f78280745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f7836ffd700 1 -- 172.21.15.123:0/2805183836 --> [v2:172.21.15.175:6808/114830,v1:172.21.15.175:6809/114830] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7828074c90 con 0x7f78280721d0 2023-03-08T15:49:45.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f4fe0e70700 1 Processor -- start 2023-03-08T15:49:45.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f7836ffd700 1 -- 172.21.15.123:0/2805183836 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f784008be10 con 0x7f78480b6500 2023-03-08T15:49:45.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f4fe0e70700 1 -- start start 2023-03-08T15:49:45.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.261+0000 7f47df7ae700 1 -- start start 2023-03-08T15:49:45.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f47df7ae700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f47d80b4780 0x7f47d8146f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f47df7ae700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f47d8147470 0x7f47d8140730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f47df7ae700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d8146aa0 con 0x7f47d8140c70 2023-03-08T15:49:45.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f47df7ae700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d80b72b0 con 0x7f47d8147470 2023-03-08T15:49:45.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f47df7ae700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d8146820 con 0x7f47d80b4780 2023-03-08T15:49:45.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.261+0000 7f61dfb01700 1 -- start start 2023-03-08T15:49:45.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f61dfb01700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61d80b8300 0x7f61d81ed180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f61dfb01700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d8140df0 0x7f61d813cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f61dfb01700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d8150430 0x7f61d80b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f61dfb01700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d813d040 con 0x7f61d80b8300 2023-03-08T15:49:45.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f61dfb01700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d8146a50 con 0x7f61d8140df0 2023-03-08T15:49:45.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f61dfb01700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d8145b30 con 0x7f61d8150430 2023-03-08T15:49:45.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f61de09e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d8150430 0x7f61d80b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f784659c700 1 --2- 172.21.15.123:0/2805183836 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7828069920 0x7f782806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.262+0000 7f7b22f76700 1 -- start start 2023-03-08T15:49:45.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f784659c700 1 --2- 172.21.15.123:0/2805183836 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7828069920 0x7f782806bdd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7838006f10 tx=0x7f7838006e60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f7845d9b700 1 --2- 172.21.15.123:0/2805183836 >> [v2:172.21.15.175:6808/114830,v1:172.21.15.175:6809/114830] conn(0x7f78280721d0 0x7f78280745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f61dd09c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d8140df0 0x7f61d813cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f47dd54a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f47d80b4780 0x7f47d8146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f4fe0e70700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc0b3c50 0x7f4fdc0bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f4fe0e70700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fdc0b6a00 0x7f4fdc156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f4fe0e70700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fdc148eb0 0x7f4fdc1e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f61dd09c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d8140df0 0x7f61d813cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:34594/0 (socket says 172.21.15.123:34594) 2023-03-08T15:49:45.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f61dd09c700 1 -- 172.21.15.123:0/574609865 learned_addr learned my addr 172.21.15.123:0/574609865 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f4fe0e70700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc0bca10 con 0x7f4fdc0b6a00 2023-03-08T15:49:45.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f4fe0e70700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc156a70 con 0x7f4fdc0b3c50 2023-03-08T15:49:45.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f4fe0e70700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc145ad0 con 0x7f4fdc148eb0 2023-03-08T15:49:45.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f47dd54a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f47d80b4780 0x7f47d8146f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:34596/0 (socket says 172.21.15.123:34596) 2023-03-08T15:49:45.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f47dd54a700 1 -- 172.21.15.123:0/485759277 learned_addr learned my addr 172.21.15.123:0/485759277 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f4fda59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc0b3c50 0x7f4fdc0bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f7b22f76700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7b1c0b37f0 0x7f7b1c0b4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f7b22f76700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b1c0b3d30 0x7f7b1c0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f7b22f76700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1c149300 con 0x7f7b1c14ebb0 2023-03-08T15:49:45.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f7b22f76700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c14fad0 con 0x7f7b1c0b37f0 2023-03-08T15:49:45.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f7b22f76700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0b8f60 con 0x7f7b1c0b3d30 2023-03-08T15:49:45.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f61dd09c700 1 -- 172.21.15.123:0/574609865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d8150430 msgr2=0x7f61d80b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f61dd09c700 1 --2- 172.21.15.123:0/574609865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d8150430 0x7f61d80b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f61dd09c700 1 -- 172.21.15.123:0/574609865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61d80b8300 msgr2=0x7f61d81ed180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f61dd09c700 1 --2- 172.21.15.123:0/574609865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61d80b8300 0x7f61d81ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f61dd09c700 1 -- 172.21.15.123:0/574609865 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d000d040 con 0x7f61d8140df0 2023-03-08T15:49:45.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.263+0000 7f462fefc700 1 -- start start 2023-03-08T15:49:45.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f4fda59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc0b3c50 0x7f4fdc0bc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:34600/0 (socket says 172.21.15.123:34600) 2023-03-08T15:49:45.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f4fda59c700 1 -- 172.21.15.123:0/3965735064 learned_addr learned my addr 172.21.15.123:0/3965735064 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f4fdad9d700 1 --2- 172.21.15.123:0/3965735064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fdc148eb0 0x7f4fdc1e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f7b21513700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b1c0b3d30 0x7f7b1c0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f7b21513700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b1c0b3d30 0x7f7b1c0b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:57920/0 (socket says 172.21.15.123:57920) 2023-03-08T15:49:45.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f7b21513700 1 -- 172.21.15.123:0/295411752 learned_addr learned my addr 172.21.15.123:0/295411752 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f47dd54a700 1 -- 172.21.15.123:0/485759277 >> v2:172.21.15.123:3300/0 conn(0x7f47d8147470 msgr2=0x7f47d8140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f47dd54a700 1 --2- 172.21.15.123:0/485759277 >> v2:172.21.15.123:3300/0 conn(0x7f47d8147470 0x7f47d8140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f47dd54a700 1 -- 172.21.15.123:0/485759277 >> v1:172.21.15.123:6789/0 conn(0x7f47d8140c70 legacy=0x7f47d8149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f47dd54a700 1 -- 172.21.15.123:0/485759277 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d80b4f20 con 0x7f47d80b4780 2023-03-08T15:49:45.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f462fefc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46281471e0 0x7f4628140520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f462fefc700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46280b47d0 con 0x7f46280b86b0 2023-03-08T15:49:45.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f462fefc700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46280b4a70 con 0x7f462806ad60 2023-03-08T15:49:45.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f462fefc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46280b4d50 con 0x7f46281471e0 2023-03-08T15:49:45.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f4fda59c700 1 -- 172.21.15.123:0/3965735064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fdc148eb0 msgr2=0x7f4fdc1e7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f4fda59c700 1 --2- 172.21.15.123:0/3965735064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fdc148eb0 0x7f4fdc1e7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f4fda59c700 1 -- 172.21.15.123:0/3965735064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fdc0b6a00 msgr2=0x7f4fdc156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f4fda59c700 1 --2- 172.21.15.123:0/3965735064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fdc0b6a00 0x7f4fdc156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f4fda59c700 1 -- 172.21.15.123:0/3965735064 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd4009b30 con 0x7f4fdc0b3c50 2023-03-08T15:49:45.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f7b1bfff700 1 --2- 172.21.15.123:0/295411752 >> v2:172.21.15.123:3300/0 conn(0x7f7b1c0b37f0 0x7f7b1c0b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f47dd54a700 1 --2- 172.21.15.123:0/485759277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47d80b4780 0x7f47d8146f30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f47d8066eb0 tx=0x7f47cc00d4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=982f6948c09731c0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f7b21513700 1 -- 172.21.15.123:0/295411752 >> v2:172.21.15.123:3300/0 conn(0x7f7b1c0b37f0 msgr2=0x7f7b1c0b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f7b21513700 1 --2- 172.21.15.123:0/295411752 >> v2:172.21.15.123:3300/0 conn(0x7f7b1c0b37f0 0x7f7b1c0b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f7b21513700 1 -- 172.21.15.123:0/295411752 >> v1:172.21.15.123:6789/0 conn(0x7f7b1c14ebb0 legacy=0x7f7b1c14ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f61dd09c700 1 --2- 172.21.15.123:0/574609865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d8140df0 0x7f61d813cb00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f61c800c500 tx=0x7f61c800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.264+0000 7f7b21513700 1 -- 172.21.15.123:0/295411752 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c14f760 con 0x7f7b1c0b3d30 2023-03-08T15:49:45.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462dc98700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f462806ad60 0x7f46280b90e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.123:38808/0 (socket says 172.21.15.123:38808) 2023-03-08T15:49:45.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462dc98700 1 -- 172.21.15.123:0/1790217093 learned_addr learned my addr 172.21.15.123:0/1790217093 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:45.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f61ce7fc700 1 -- 172.21.15.123:0/574609865 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8011790 con 0x7f61d8140df0 2023-03-08T15:49:45.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f61dfb01700 1 -- 172.21.15.123:0/574609865 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d8071450 con 0x7f61d8140df0 2023-03-08T15:49:45.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f47d7fff700 1 -- 172.21.15.123:0/485759277 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc010070 con 0x7f47d80b4780 2023-03-08T15:49:45.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f47d7fff700 1 -- 172.21.15.123:0/485759277 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47cc00dc30 con 0x7f47d80b4780 2023-03-08T15:49:45.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f47d7fff700 1 -- 172.21.15.123:0/485759277 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc007b60 con 0x7f47d80b4780 2023-03-08T15:49:45.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f61dfb01700 1 -- 172.21.15.123:0/574609865 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d80b8a70 con 0x7f61d8140df0 2023-03-08T15:49:45.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942786339 0 0) 0x7f46280b4a70 con 0x7f462806ad60 2023-03-08T15:49:45.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46140035b0 con 0x7f462806ad60 2023-03-08T15:49:45.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f7b21513700 1 --2- 172.21.15.123:0/295411752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b1c0b3d30 0x7f7b1c0b4980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009e50 tx=0x7f7b1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c6bac02b0265535 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f61ce7fc700 1 -- 172.21.15.123:0/574609865 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c80118f0 con 0x7f61d8140df0 2023-03-08T15:49:45.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f61ce7fc700 1 -- 172.21.15.123:0/574609865 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8011ca0 con 0x7f61d8140df0 2023-03-08T15:49:45.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935114313 0 0) 0x7f46280b47d0 con 0x7f46280b86b0 2023-03-08T15:49:45.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46280b4a70 con 0x7f46280b86b0 2023-03-08T15:49:45.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f7845d9b700 1 --2- 172.21.15.123:0/2805183836 >> [v2:172.21.15.175:6808/114830,v1:172.21.15.175:6809/114830] conn(0x7f78280721d0 0x7f78280745e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.266+0000 7f61dfb01700 1 -- 172.21.15.123:0/574609865 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f61c0000fb0 con 0x7f61d8140df0 2023-03-08T15:49:45.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462e499700 1 --2- 172.21.15.123:0/1790217093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46281471e0 0x7f4628140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2174213215 0 0) 0x7f46140035b0 con 0x7f462806ad60 2023-03-08T15:49:45.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46281471e0 msgr2=0x7f4628140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 --2- 172.21.15.123:0/1790217093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46281471e0 0x7f4628140520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 >> v1:172.21.15.123:6789/0 conn(0x7f46280b86b0 legacy=0x7f4628146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46280b5030 con 0x7f462806ad60 2023-03-08T15:49:45.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f46200019f0 con 0x7f462806ad60 2023-03-08T15:49:45.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 >> v1:172.21.15.175:6789/0 conn(0x7f462806ad60 legacy=0x7f46280b90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 --2- 172.21.15.123:0/1790217093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4614003b90 0x7f4614003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 --2- 172.21.15.123:0/1790217093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46281471e0 0x7f4614004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 --2- 172.21.15.123:0/1790217093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4614004d90 0x7f4614005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46280b4d50 con 0x7f4614004d90 2023-03-08T15:49:45.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4614014330 con 0x7f4614003b90 2023-03-08T15:49:45.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46140144f0 con 0x7f46281471e0 2023-03-08T15:49:45.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.266+0000 7f462dc98700 1 --2- 172.21.15.123:0/1790217093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4614003b90 0x7f4614003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.266+0000 7f462e499700 1 --2- 172.21.15.123:0/1790217093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4614004d90 0x7f4614005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f4fda59c700 1 --2- 172.21.15.123:0/3965735064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc0b3c50 0x7f4fdc0bc4d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00c4a0 tx=0x7f4fcc00c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.266+0000 7f462e499700 1 -- 172.21.15.123:0/1790217093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46281471e0 msgr2=0x7f4614004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.266+0000 7f462e499700 1 --2- 172.21.15.123:0/1790217093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46281471e0 0x7f4614004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.266+0000 7f462e499700 1 -- 172.21.15.123:0/1790217093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4614003b90 msgr2=0x7f4614003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.266+0000 7f462e499700 1 --2- 172.21.15.123:0/1790217093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4614003b90 0x7f4614003f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.266+0000 7f462e499700 1 -- 172.21.15.123:0/1790217093 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46140035b0 con 0x7f4614004d90 2023-03-08T15:49:45.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.266+0000 7f462e499700 1 --2- 172.21.15.123:0/1790217093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4614004d90 0x7f4614005200 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4624009890 tx=0x7f4614005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3be70b448bb652e server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.266+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462400c070 con 0x7f4614004d90 2023-03-08T15:49:45.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.266+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4624013610 con 0x7f4614004d90 2023-03-08T15:49:45.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f462cc96700 1 -- 172.21.15.123:0/1790217093 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46240139c0 con 0x7f4614004d90 2023-03-08T15:49:45.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f4fcaffd700 1 -- 172.21.15.123:0/3965735064 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc0054e0 con 0x7f4fdc0b3c50 2023-03-08T15:49:45.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f47df7ae700 1 -- 172.21.15.123:0/485759277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47d80b4780 msgr2=0x7f47d8146f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f47df7ae700 1 --2- 172.21.15.123:0/485759277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47d80b4780 0x7f47d8146f30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f47d8066eb0 tx=0x7f47cc00d4c0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f4fcaffd700 1 -- 172.21.15.123:0/3965735064 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc003680 con 0x7f4fdc0b3c50 2023-03-08T15:49:45.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f4fcaffd700 1 -- 172.21.15.123:0/3965735064 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc003a30 con 0x7f4fdc0b3c50 2023-03-08T15:49:45.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f7b1b7fe700 1 -- 172.21.15.123:0/295411752 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400e070 con 0x7f7b1c0b3d30 2023-03-08T15:49:45.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f7b1b7fe700 1 -- 172.21.15.123:0/295411752 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1400b9c0 con 0x7f7b1c0b3d30 2023-03-08T15:49:45.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.265+0000 7f7b1b7fe700 1 -- 172.21.15.123:0/295411752 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400bd70 con 0x7f7b1c0b3d30 2023-03-08T15:49:45.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f7b22f76700 1 -- 172.21.15.123:0/295411752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b1c0b3d30 msgr2=0x7f7b1c0b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f7b22f76700 1 --2- 172.21.15.123:0/295411752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b1c0b3d30 0x7f7b1c0b4980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009e50 tx=0x7f7b1400b330 comp rx=0 tx=0).stop 2023-03-08T15:49:45.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f7b22f76700 1 -- 172.21.15.123:0/295411752 shutdown_connections 2023-03-08T15:49:45.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f7b22f76700 1 --2- 172.21.15.123:0/295411752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b1c0b3d30 0x7f7b1c0b4980 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f7b22f76700 1 --2- 172.21.15.123:0/295411752 >> v2:172.21.15.123:3300/0 conn(0x7f7b1c0b37f0 0x7f7b1c0b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f7b22f76700 1 -- 172.21.15.123:0/295411752 >> 172.21.15.123:0/295411752 conn(0x7f7b1c0bc930 msgr2=0x7f7b1c0bcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f7b22f76700 1 -- 172.21.15.123:0/295411752 shutdown_connections 2023-03-08T15:49:45.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f47df7ae700 1 -- 172.21.15.123:0/485759277 shutdown_connections 2023-03-08T15:49:45.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f47df7ae700 1 --2- 172.21.15.123:0/485759277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47d80b4780 0x7f47d8146f30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f47df7ae700 1 --2- 172.21.15.123:0/485759277 >> v2:172.21.15.123:3300/0 conn(0x7f47d8147470 0x7f47d8140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f47df7ae700 1 -- 172.21.15.123:0/485759277 >> 172.21.15.123:0/485759277 conn(0x7f47d80bc930 msgr2=0x7f47d80bcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f7b22f76700 1 -- 172.21.15.123:0/295411752 wait complete. 2023-03-08T15:49:45.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f61ce7fc700 1 -- 172.21.15.123:0/574609865 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f61c8010050 con 0x7f61d8140df0 2023-03-08T15:49:45.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f462fefc700 1 -- 172.21.15.123:0/1790217093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4614004d90 msgr2=0x7f4614005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f462fefc700 1 --2- 172.21.15.123:0/1790217093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4614004d90 0x7f4614005200 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4624009890 tx=0x7f4614005880 comp rx=0 tx=0).stop 2023-03-08T15:49:45.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f47df7ae700 1 -- 172.21.15.123:0/485759277 shutdown_connections 2023-03-08T15:49:45.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f462e499700 1 -- 172.21.15.123:0/1790217093 reap_dead start 2023-03-08T15:49:45.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.268+0000 7f61ce7fc700 1 --2- 172.21.15.123:0/574609865 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f61bc0698d0 0x7f61bc06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.268+0000 7f462fefc700 1 -- 172.21.15.123:0/1790217093 shutdown_connections 2023-03-08T15:49:45.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.268+0000 7f462fefc700 1 -- 172.21.15.123:0/1790217093 >> 172.21.15.123:0/1790217093 conn(0x7f462806a250 msgr2=0x7f462806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.268+0000 7f61ce7fc700 1 -- 172.21.15.123:0/574609865 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f61c8087d60 con 0x7f61d8140df0 2023-03-08T15:49:45.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.268+0000 7f462fefc700 1 -- 172.21.15.123:0/1790217093 shutdown_connections 2023-03-08T15:49:45.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.268+0000 7f462fefc700 1 -- 172.21.15.123:0/1790217093 wait complete. 2023-03-08T15:49:45.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.268+0000 7f61ce7fc700 1 --2- 172.21.15.123:0/574609865 >> [v2:172.21.15.123:6808/143186,v1:172.21.15.123:6809/143186] conn(0x7f61bc072080 0x7f61bc074490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.268+0000 7f61ce7fc700 1 -- 172.21.15.123:0/574609865 --> [v2:172.21.15.123:6808/143186,v1:172.21.15.123:6809/143186] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61bc074b40 con 0x7f61bc072080 2023-03-08T15:49:45.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.268+0000 7f61ce7fc700 1 -- 172.21.15.123:0/574609865 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61c80881c0 con 0x7f61d8140df0 2023-03-08T15:49:45.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.268+0000 7f61de09e700 1 --2- 172.21.15.123:0/574609865 >> [v2:172.21.15.123:6808/143186,v1:172.21.15.123:6809/143186] conn(0x7f61bc072080 0x7f61bc074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.268+0000 7f61de09e700 1 --2- 172.21.15.123:0/574609865 >> [v2:172.21.15.123:6808/143186,v1:172.21.15.123:6809/143186] conn(0x7f61bc072080 0x7f61bc074490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.269+0000 7f7b22f76700 1 Processor -- start 2023-03-08T15:49:45.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.269+0000 7f7b22f76700 1 -- start start 2023-03-08T15:49:45.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.269+0000 7f61dd89d700 1 --2- 172.21.15.123:0/574609865 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f61bc0698d0 0x7f61bc06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.267+0000 7f47df7ae700 1 -- 172.21.15.123:0/485759277 wait complete. 2023-03-08T15:49:45.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.269+0000 7f47df7ae700 1 Processor -- start 2023-03-08T15:49:45.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.269+0000 7f462fefc700 1 Processor -- start 2023-03-08T15:49:45.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.269+0000 7f462fefc700 1 -- start start 2023-03-08T15:49:45.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.269+0000 7f61ce7fc700 1 -- 172.21.15.123:0/574609865 <== osd.2 v2:172.21.15.123:6808/143186 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f61bc074b40 con 0x7f61bc072080 2023-03-08T15:49:45.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f7b22f76700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b1c0b37f0 0x7f7b1c146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f7b22f76700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b1c0b3d30 0x7f7b1c1db320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f7b22f76700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b1c14ebb0 0x7f7b1c1435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f7b22f76700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c1453b0 con 0x7f7b1c0b3d30 2023-03-08T15:49:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f7b22f76700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c1db860 con 0x7f7b1c14ebb0 2023-03-08T15:49:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f7b22f76700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c1514a0 con 0x7f7b1c0b37f0 2023-03-08T15:49:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f462fefc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4614004d90 0x7f462806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f462fefc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f462813dd20 0x7f4628149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f462fefc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46281f00c0 0x7f46281f0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f462fefc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4628070f10 con 0x7f4614004d90 2023-03-08T15:49:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f462fefc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4628070940 con 0x7f462813dd20 2023-03-08T15:49:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f462fefc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4628070b70 con 0x7f46281f00c0 2023-03-08T15:49:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f462dc98700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4614004d90 0x7f462806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f462dc98700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4614004d90 0x7f462806eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53766/0 (socket says 172.21.15.123:53766) 2023-03-08T15:49:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f462dc98700 1 -- 172.21.15.123:0/2018892233 learned_addr learned my addr 172.21.15.123:0/2018892233 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f462e499700 1 --2- 172.21.15.123:0/2018892233 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46281f00c0 0x7f46281f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f47df7ae700 1 -- start start 2023-03-08T15:49:45.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f47df7ae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47d80b4780 0x7f47d8071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f47df7ae700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47d8140c70 0x7f47d80708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f47df7ae700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47d8147470 0x7f47d80b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f47df7ae700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8071f70 con 0x7f47d80b4780 2023-03-08T15:49:45.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f47df7ae700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80702a0 con 0x7f47d8147470 2023-03-08T15:49:45.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f47df7ae700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d806fa40 con 0x7f47d8140c70 2023-03-08T15:49:45.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f47ddd4b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47d8147470 0x7f47d80b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f47ddd4b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47d8147470 0x7f47d80b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:34652/0 (socket says 172.21.15.123:34652) 2023-03-08T15:49:45.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f47ddd4b700 1 -- 172.21.15.123:0/276270738 learned_addr learned my addr 172.21.15.123:0/276270738 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f7b21513700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b1c14ebb0 0x7f7b1c1435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.270+0000 7f7b1bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b1c0b3d30 0x7f7b1c1db320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f7b21513700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b1c14ebb0 0x7f7b1c1435d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:34640/0 (socket says 172.21.15.123:34640) 2023-03-08T15:49:45.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f7b1bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b1c0b3d30 0x7f7b1c1db320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53780/0 (socket says 172.21.15.123:53780) 2023-03-08T15:49:45.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f7b21513700 1 -- 172.21.15.123:0/1029421241 learned_addr learned my addr 172.21.15.123:0/1029421241 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f61dd89d700 1 --2- 172.21.15.123:0/574609865 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f61bc0698d0 0x7f61bc06bd80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61d4000f60 tx=0x7f61d4007a60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f462e499700 1 -- 172.21.15.123:0/2018892233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f462813dd20 msgr2=0x7f4628149530 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-08T15:49:45.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f462e499700 1 --2- 172.21.15.123:0/2018892233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f462813dd20 0x7f4628149530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f462e499700 1 -- 172.21.15.123:0/2018892233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4614004d90 msgr2=0x7f462806eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f462e499700 1 --2- 172.21.15.123:0/2018892233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4614004d90 0x7f462806eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f462e499700 1 -- 172.21.15.123:0/2018892233 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46280b38f0 con 0x7f46281f00c0 2023-03-08T15:49:45.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f7836ffd700 1 -- 172.21.15.123:0/2805183836 <== osd.6 v2:172.21.15.175:6808/114830 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7828074c90 con 0x7f78280721d0 2023-03-08T15:49:45.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f462e499700 1 --2- 172.21.15.123:0/2018892233 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46281f00c0 0x7f46281f0530 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4624009860 tx=0x7f46240047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f47ddd4b700 1 -- 172.21.15.123:0/276270738 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47d8140c70 msgr2=0x7f47d80708e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-08T15:49:45.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f47ddd4b700 1 --2- 172.21.15.123:0/276270738 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47d8140c70 0x7f47d80708e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f47ddd4b700 1 -- 172.21.15.123:0/276270738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47d80b4780 msgr2=0x7f47d8071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f47ddd4b700 1 --2- 172.21.15.123:0/276270738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47d80b4780 0x7f47d8071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f47ddd4b700 1 -- 172.21.15.123:0/276270738 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc0079d0 con 0x7f47d8147470 2023-03-08T15:49:45.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f461e7fc700 1 -- 172.21.15.123:0/2018892233 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462401d640 con 0x7f46281f00c0 2023-03-08T15:49:45.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f461e7fc700 1 -- 172.21.15.123:0/2018892233 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462401d7c0 con 0x7f46281f00c0 2023-03-08T15:49:45.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f461e7fc700 1 -- 172.21.15.123:0/2018892233 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462401db70 con 0x7f46281f00c0 2023-03-08T15:49:45.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f47ddd4b700 1 --2- 172.21.15.123:0/276270738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47d8147470 0x7f47d80b2d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f47d000c490 tx=0x7f47d0001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.272+0000 7f7b21513700 1 -- 172.21.15.123:0/1029421241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b1c0b37f0 msgr2=0x7f7b1c146c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-08T15:49:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.272+0000 7f7b21513700 1 --2- 172.21.15.123:0/1029421241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b1c0b37f0 0x7f7b1c146c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.272+0000 7f7b21513700 1 -- 172.21.15.123:0/1029421241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b1c0b3d30 msgr2=0x7f7b1c1db320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.272+0000 7f7b21513700 1 --2- 172.21.15.123:0/1029421241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b1c0b3d30 0x7f7b1c1db320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.272+0000 7f7b21513700 1 -- 172.21.15.123:0/1029421241 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14009b30 con 0x7f7b1c14ebb0 2023-03-08T15:49:45.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.272+0000 7f47d5ffb700 1 -- 172.21.15.123:0/276270738 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d00054e0 con 0x7f47d8147470 2023-03-08T15:49:45.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.272+0000 7f47d5ffb700 1 -- 172.21.15.123:0/276270738 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d0003680 con 0x7f47d8147470 2023-03-08T15:49:45.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.272+0000 7f47df7ae700 1 -- 172.21.15.123:0/276270738 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d80b54e0 con 0x7f47d8147470 2023-03-08T15:49:45.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.272+0000 7f47d5ffb700 1 -- 172.21.15.123:0/276270738 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0003a30 con 0x7f47d8147470 2023-03-08T15:49:45.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.272+0000 7f462fefc700 1 -- 172.21.15.123:0/2018892233 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46280b5310 con 0x7f46281f00c0 2023-03-08T15:49:45.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.272+0000 7f462fefc700 1 -- 172.21.15.123:0/2018892233 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46280b8b10 con 0x7f46281f00c0 2023-03-08T15:49:45.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.272+0000 7f47df7ae700 1 -- 172.21.15.123:0/276270738 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d80b5200 con 0x7f47d8147470 2023-03-08T15:49:45.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.273+0000 7f462fefc700 1 -- 172.21.15.123:0/2018892233 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46280744c0 con 0x7f46281f00c0 2023-03-08T15:49:45.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.273+0000 7f47df7ae700 1 -- 172.21.15.123:0/276270738 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f47d80b57c0 con 0x7f47d8147470 2023-03-08T15:49:45.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f4fe0e70700 1 -- 172.21.15.123:0/3965735064 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fdc0bd670 con 0x7f4fdc0b3c50 2023-03-08T15:49:45.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.271+0000 7f4fe0e70700 1 -- 172.21.15.123:0/3965735064 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fdc06b970 con 0x7f4fdc0b3c50 2023-03-08T15:49:45.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.274+0000 7f4fe0e70700 1 -- 172.21.15.123:0/3965735064 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4fdc071f20 con 0x7f4fdc0b3c50 2023-03-08T15:49:45.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.274+0000 7f7b21513700 1 --2- 172.21.15.123:0/1029421241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b1c14ebb0 0x7f7b1c1435d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b14012000 tx=0x7f7b14004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.274+0000 7f47d5ffb700 1 -- 172.21.15.123:0/276270738 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f47d0019030 con 0x7f47d8147470 2023-03-08T15:49:45.329 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.274+0000 7f461e7fc700 1 -- 172.21.15.123:0/2018892233 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f462401dcd0 con 0x7f46281f00c0 2023-03-08T15:49:45.329 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f47d5ffb700 1 --2- 172.21.15.123:0/276270738 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f47bc069920 0x7f47bc06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.329 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f7b197fa700 1 -- 172.21.15.123:0/1029421241 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b140048b0 con 0x7f7b1c14ebb0 2023-03-08T15:49:45.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f7b197fa700 1 -- 172.21.15.123:0/1029421241 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b140099b0 con 0x7f7b1c14ebb0 2023-03-08T15:49:45.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f7b197fa700 1 -- 172.21.15.123:0/1029421241 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1401c680 con 0x7f7b1c14ebb0 2023-03-08T15:49:45.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f7b22f76700 1 -- 172.21.15.123:0/1029421241 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1c072800 con 0x7f7b1c14ebb0 2023-03-08T15:49:45.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f7b22f76700 1 -- 172.21.15.123:0/1029421241 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c0bd730 con 0x7f7b1c14ebb0 2023-03-08T15:49:45.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f47d5ffb700 1 -- 172.21.15.123:0/276270738 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f47d0086970 con 0x7f47d8147470 2023-03-08T15:49:45.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f47d5ffb700 1 --2- 172.21.15.123:0/276270738 >> [v2:172.21.15.123:6800/143185,v1:172.21.15.123:6801/143185] conn(0x7f47bc0721d0 0x7f47bc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f47d5ffb700 1 -- 172.21.15.123:0/276270738 --> [v2:172.21.15.123:6800/143185,v1:172.21.15.123:6801/143185] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47bc074c90 con 0x7f47bc0721d0 2023-03-08T15:49:45.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f47d5ffb700 1 -- 172.21.15.123:0/276270738 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47d008b2a0 con 0x7f47d8147470 2023-03-08T15:49:45.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f47dd54a700 1 --2- 172.21.15.123:0/276270738 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f47bc069920 0x7f47bc06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.276+0000 7f47dd54a700 1 --2- 172.21.15.123:0/276270738 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f47bc069920 0x7f47bc06bdd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f47cc000f80 tx=0x7f47cc014000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f461e7fc700 1 --2- 172.21.15.123:0/2018892233 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f460c0698d0 0x7f460c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f461e7fc700 1 -- 172.21.15.123:0/2018892233 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46240889b0 con 0x7f46281f00c0 2023-03-08T15:49:45.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f461e7fc700 1 --2- 172.21.15.123:0/2018892233 >> [v2:172.21.15.175:6800/114829,v1:172.21.15.175:6801/114829] conn(0x7f460c072180 0x7f460c074590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f461e7fc700 1 -- 172.21.15.123:0/2018892233 --> [v2:172.21.15.175:6800/114829,v1:172.21.15.175:6801/114829] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f460c074c40 con 0x7f460c072180 2023-03-08T15:49:45.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f461e7fc700 1 -- 172.21.15.123:0/2018892233 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4624088d60 con 0x7f46281f00c0 2023-03-08T15:49:45.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f462dc98700 1 --2- 172.21.15.123:0/2018892233 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f460c0698d0 0x7f460c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f4fcaffd700 1 -- 172.21.15.123:0/3965735064 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f4fcc019030 con 0x7f4fdc0b3c50 2023-03-08T15:49:45.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f4fcaffd700 1 --2- 172.21.15.123:0/3965735064 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f4fbc0699a0 0x7f4fbc06be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f4fcaffd700 1 -- 172.21.15.123:0/3965735064 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4fcc086a80 con 0x7f4fdc0b3c50 2023-03-08T15:49:45.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f4fd9d9b700 1 --2- 172.21.15.123:0/3965735064 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f4fbc0699a0 0x7f4fbc06be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f4fcaffd700 1 --2- 172.21.15.123:0/3965735064 >> [v2:172.21.15.175:6816/114842,v1:172.21.15.175:6817/114842] conn(0x7f4fbc072250 0x7f4fbc074660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f4fcaffd700 1 -- 172.21.15.123:0/3965735064 --> [v2:172.21.15.175:6816/114842,v1:172.21.15.175:6817/114842] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4fbc074d10 con 0x7f4fbc072250 2023-03-08T15:49:45.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.275+0000 7f4fcaffd700 1 -- 172.21.15.123:0/3965735064 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fcc08b2a0 con 0x7f4fdc0b3c50 2023-03-08T15:49:45.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.276+0000 7f4fdad9d700 1 --2- 172.21.15.123:0/3965735064 >> [v2:172.21.15.175:6816/114842,v1:172.21.15.175:6817/114842] conn(0x7f4fbc072250 0x7f4fbc074660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.276+0000 7f4fdad9d700 1 --2- 172.21.15.123:0/3965735064 >> [v2:172.21.15.175:6816/114842,v1:172.21.15.175:6817/114842] conn(0x7f4fbc072250 0x7f4fbc074660 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.277+0000 7f4fcaffd700 1 -- 172.21.15.123:0/3965735064 <== osd.5 v2:172.21.15.175:6816/114842 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4fbc074d10 con 0x7f4fbc072250 2023-03-08T15:49:45.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.278+0000 7f7b197fa700 1 -- 172.21.15.123:0/1029421241 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f7b1402c070 con 0x7f7b1c14ebb0 2023-03-08T15:49:45.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.279+0000 7f462dc98700 1 --2- 172.21.15.123:0/2018892233 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f460c0698d0 0x7f460c06bd80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4620001350 tx=0x7f4620009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.279+0000 7f7b197fa700 1 --2- 172.21.15.123:0/1029421241 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7afc069950 0x7f7afc06be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.279+0000 7f7b197fa700 1 -- 172.21.15.123:0/1029421241 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b14089150 con 0x7f7b1c14ebb0 2023-03-08T15:49:45.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.280+0000 7f47dcd49700 1 --2- 172.21.15.123:0/276270738 >> [v2:172.21.15.123:6800/143185,v1:172.21.15.123:6801/143185] conn(0x7f47bc0721d0 0x7f47bc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.280+0000 7f4fd9d9b700 1 --2- 172.21.15.123:0/3965735064 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f4fbc0699a0 0x7f4fbc06be50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc146410 tx=0x7f4fd0006d20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.280+0000 7f47dcd49700 1 --2- 172.21.15.123:0/276270738 >> [v2:172.21.15.123:6800/143185,v1:172.21.15.123:6801/143185] conn(0x7f47bc0721d0 0x7f47bc0745e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.280+0000 7f7b20d12700 1 --2- 172.21.15.123:0/1029421241 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7afc069950 0x7f7afc06be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.280+0000 7f7b20d12700 1 --2- 172.21.15.123:0/1029421241 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7afc069950 0x7f7afc06be00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7b04000f60 tx=0x7f7b04007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.281+0000 7f47d5ffb700 1 -- 172.21.15.123:0/276270738 <== osd.0 v2:172.21.15.123:6800/143185 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f47bc074c90 con 0x7f47bc0721d0 2023-03-08T15:49:45.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.283+0000 7f7b22f76700 1 --2- 172.21.15.123:0/1029421241 >> [v2:172.21.15.123:6824/143187,v1:172.21.15.123:6825/143187] conn(0x7f7b000015d0 0x7f7b00003a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.283+0000 7f7b22f76700 1 -- 172.21.15.123:0/1029421241 --> [v2:172.21.15.123:6824/143187,v1:172.21.15.123:6825/143187] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b00006bb0 con 0x7f7b000015d0 2023-03-08T15:49:45.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.288+0000 7f7b1bfff700 1 --2- 172.21.15.123:0/1029421241 >> [v2:172.21.15.123:6824/143187,v1:172.21.15.123:6825/143187] conn(0x7f7b000015d0 0x7f7b00003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.288+0000 7f7b1bfff700 1 --2- 172.21.15.123:0/1029421241 >> [v2:172.21.15.123:6824/143187,v1:172.21.15.123:6825/143187] conn(0x7f7b000015d0 0x7f7b00003a80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.285+0000 7f8c1bef9700 1 Processor -- start 2023-03-08T15:49:45.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.285+0000 7f8c1bef9700 1 -- start start 2023-03-08T15:49:45.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.286+0000 7f8c1bef9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8c14072760 0x7f8c1406fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.286+0000 7f8c1bef9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c14071df0 0x7f8c1414aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.286+0000 7f8c1bef9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c14070670 con 0x7f8c140ba280 2023-03-08T15:49:45.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.286+0000 7f8c1bef9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c14070a40 con 0x7f8c14072760 2023-03-08T15:49:45.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.286+0000 7f8c1bef9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c14070c50 con 0x7f8c14071df0 2023-03-08T15:49:45.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.287+0000 7f8c1a496700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c14071df0 0x7f8c1414aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.287+0000 7f8c1a496700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c14071df0 0x7f8c1414aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:57940/0 (socket says 172.21.15.123:57940) 2023-03-08T15:49:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.287+0000 7f8c1a496700 1 -- 172.21.15.123:0/3133399048 learned_addr learned my addr 172.21.15.123:0/3133399048 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.287+0000 7f8c1a496700 1 -- 172.21.15.123:0/3133399048 >> v2:172.21.15.123:3300/0 conn(0x7f8c14072760 msgr2=0x7f8c1406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.287+0000 7f8c1a496700 1 --2- 172.21.15.123:0/3133399048 >> v2:172.21.15.123:3300/0 conn(0x7f8c14072760 0x7f8c1406fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.287+0000 7f8c1a496700 1 -- 172.21.15.123:0/3133399048 >> v1:172.21.15.123:6789/0 conn(0x7f8c140ba280 legacy=0x7f8c14141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.287+0000 7f8c1a496700 1 -- 172.21.15.123:0/3133399048 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c140ba650 con 0x7f8c14071df0 2023-03-08T15:49:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.287+0000 7f8c1a496700 1 --2- 172.21.15.123:0/3133399048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c14071df0 0x7f8c1414aab0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c00d150 tx=0x7f8c0c00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=929ab9628d995fe5 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.287+0000 7f8c18c93700 1 -- 172.21.15.123:0/3133399048 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c010070 con 0x7f8c14071df0 2023-03-08T15:49:45.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.287+0000 7f8c18c93700 1 -- 172.21.15.123:0/3133399048 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c00dd80 con 0x7f8c14071df0 2023-03-08T15:49:45.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.287+0000 7f8c18c93700 1 -- 172.21.15.123:0/3133399048 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c00b310 con 0x7f8c14071df0 2023-03-08T15:49:45.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.288+0000 7f8c1bef9700 1 -- 172.21.15.123:0/3133399048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c14071df0 msgr2=0x7f8c1414aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.288+0000 7f8c1bef9700 1 --2- 172.21.15.123:0/3133399048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c14071df0 0x7f8c1414aab0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c00d150 tx=0x7f8c0c00d460 comp rx=0 tx=0).stop 2023-03-08T15:49:45.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.288+0000 7f8c1bef9700 1 -- 172.21.15.123:0/3133399048 shutdown_connections 2023-03-08T15:49:45.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.288+0000 7f8c1bef9700 1 --2- 172.21.15.123:0/3133399048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c14071df0 0x7f8c1414aab0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.288+0000 7f8c1bef9700 1 --2- 172.21.15.123:0/3133399048 >> v2:172.21.15.123:3300/0 conn(0x7f8c14072760 0x7f8c1406fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.288+0000 7f8c1bef9700 1 -- 172.21.15.123:0/3133399048 >> 172.21.15.123:0/3133399048 conn(0x7f8c1406b360 msgr2=0x7f8c1406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.289+0000 7f8c1bef9700 1 -- 172.21.15.123:0/3133399048 shutdown_connections 2023-03-08T15:49:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.290+0000 7f8c1bef9700 1 -- 172.21.15.123:0/3133399048 wait complete. 2023-03-08T15:49:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.291+0000 7f8c1bef9700 1 Processor -- start 2023-03-08T15:49:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.291+0000 7f8c1bef9700 1 -- start start 2023-03-08T15:49:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7f8c1bef9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c14071df0 0x7f8c14137c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7f8c1bef9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c140ba280 0x7f8c141e7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7f8c1bef9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c1414a8a0 0x7f8c141446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7f8c1bef9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c14138160 con 0x7f8c140ba280 2023-03-08T15:49:45.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7f8c1bef9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c141e8e40 con 0x7f8c1414a8a0 2023-03-08T15:49:45.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7f8c1bef9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c14149e00 con 0x7f8c14071df0 2023-03-08T15:49:45.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7f8c1a496700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c1414a8a0 0x7f8c141446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7f8c1a496700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c1414a8a0 0x7f8c141446c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:34672/0 (socket says 172.21.15.123:34672) 2023-03-08T15:49:45.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7f8c1a496700 1 -- 172.21.15.123:0/397732539 learned_addr learned my addr 172.21.15.123:0/397732539 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7f8c19c95700 1 --2- 172.21.15.123:0/397732539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c14071df0 0x7f8c14137c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7f8c1a496700 1 -- 172.21.15.123:0/397732539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c14071df0 msgr2=0x7f8c14137c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7f8c1a496700 1 --2- 172.21.15.123:0/397732539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c14071df0 0x7f8c14137c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7f8c1a496700 1 -- 172.21.15.123:0/397732539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c140ba280 msgr2=0x7f8c141e7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7f8c1a496700 1 --2- 172.21.15.123:0/397732539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c140ba280 0x7f8c141e7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7f8c1a496700 1 -- 172.21.15.123:0/397732539 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c00bd40 con 0x7f8c1414a8a0 2023-03-08T15:49:45.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.293+0000 7f8c1a496700 1 --2- 172.21.15.123:0/397732539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c1414a8a0 0x7f8c141446c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c017040 tx=0x7f8c0c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.283+0000 7f462d497700 1 --2- 172.21.15.123:0/2018892233 >> [v2:172.21.15.175:6800/114829,v1:172.21.15.175:6801/114829] conn(0x7f460c072180 0x7f460c074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.283+0000 7f462d497700 1 --2- 172.21.15.123:0/2018892233 >> [v2:172.21.15.175:6800/114829,v1:172.21.15.175:6801/114829] conn(0x7f460c072180 0x7f460c074590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.284+0000 7f461e7fc700 1 -- 172.21.15.123:0/2018892233 <== osd.4 v2:172.21.15.175:6800/114829 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f460c074c40 con 0x7f460c072180 2023-03-08T15:49:45.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.283+0000 7fc651a76700 1 Processor -- start 2023-03-08T15:49:45.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.283+0000 7fc651a76700 1 -- start start 2023-03-08T15:49:45.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.284+0000 7fc651a76700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc64c06f8d0 0x7fc64c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.284+0000 7fc651a76700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc64c140980 0x7fc64c140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.284+0000 7fc651a76700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64c071280 con 0x7fc64c06b530 2023-03-08T15:49:45.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.284+0000 7fc651a76700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c071630 con 0x7fc64c06f8d0 2023-03-08T15:49:45.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.284+0000 7fc651a76700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c14a720 con 0x7fc64c140980 2023-03-08T15:49:45.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.284+0000 7fc64bfff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc64c140980 0x7fc64c140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.284+0000 7fc64bfff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc64c140980 0x7fc64c140dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:34660/0 (socket says 172.21.15.123:34660) 2023-03-08T15:49:45.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.284+0000 7fc64bfff700 1 -- 172.21.15.123:0/3830859906 learned_addr learned my addr 172.21.15.123:0/3830859906 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.284+0000 7fc64bfff700 1 -- 172.21.15.123:0/3830859906 >> v2:172.21.15.123:3300/0 conn(0x7fc64c06f8d0 msgr2=0x7fc64c0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.284+0000 7fc64bfff700 1 --2- 172.21.15.123:0/3830859906 >> v2:172.21.15.123:3300/0 conn(0x7fc64c06f8d0 0x7fc64c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.284+0000 7fc64bfff700 1 -- 172.21.15.123:0/3830859906 >> v1:172.21.15.123:6789/0 conn(0x7fc64c06b530 legacy=0x7fc64c14a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.284+0000 7fc64bfff700 1 -- 172.21.15.123:0/3830859906 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c072020 con 0x7fc64c140980 2023-03-08T15:49:45.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.285+0000 7fc64bfff700 1 --2- 172.21.15.123:0/3830859906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc64c140980 0x7fc64c140dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0739f0 tx=0x7fc640009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ce5e0997c62dec2 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.285+0000 7fc64a7fc700 1 -- 172.21.15.123:0/3830859906 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640004230 con 0x7fc64c140980 2023-03-08T15:49:45.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.285+0000 7fc64a7fc700 1 -- 172.21.15.123:0/3830859906 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc640004390 con 0x7fc64c140980 2023-03-08T15:49:45.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.285+0000 7fc64a7fc700 1 -- 172.21.15.123:0/3830859906 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64000c740 con 0x7fc64c140980 2023-03-08T15:49:45.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.286+0000 7fc651a76700 1 -- 172.21.15.123:0/3830859906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc64c140980 msgr2=0x7fc64c140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.286+0000 7fc651a76700 1 --2- 172.21.15.123:0/3830859906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc64c140980 0x7fc64c140dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0739f0 tx=0x7fc640009bd0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.286+0000 7fc651a76700 1 -- 172.21.15.123:0/3830859906 shutdown_connections 2023-03-08T15:49:45.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.286+0000 7fc651a76700 1 --2- 172.21.15.123:0/3830859906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc64c140980 0x7fc64c140dc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.286+0000 7fc651a76700 1 --2- 172.21.15.123:0/3830859906 >> v2:172.21.15.123:3300/0 conn(0x7fc64c06f8d0 0x7fc64c0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.286+0000 7fc651a76700 1 -- 172.21.15.123:0/3830859906 >> 172.21.15.123:0/3830859906 conn(0x7fc64c0ba3c0 msgr2=0x7fc64c0bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.288+0000 7fc651a76700 1 -- 172.21.15.123:0/3830859906 shutdown_connections 2023-03-08T15:49:45.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.288+0000 7fc651a76700 1 -- 172.21.15.123:0/3830859906 wait complete. 2023-03-08T15:49:45.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.289+0000 7fc651a76700 1 Processor -- start 2023-03-08T15:49:45.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.289+0000 7fc651a76700 1 -- start start 2023-03-08T15:49:45.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.290+0000 7fc651a76700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc64c06b530 0x7fc64c149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.290+0000 7fc651a76700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc64c06f8d0 0x7fc64c151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.290+0000 7fc651a76700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc64c140980 0x7fc64c14fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.290+0000 7fc651a76700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c149cc0 con 0x7fc64c06b530 2023-03-08T15:49:45.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.290+0000 7fc651a76700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c1e49b0 con 0x7fc64c06f8d0 2023-03-08T15:49:45.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.290+0000 7fc651a76700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c13dea0 con 0x7fc64c140980 2023-03-08T15:49:45.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.290+0000 7fc64bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc64c140980 0x7fc64c14fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.291+0000 7fc64bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc64c140980 0x7fc64c14fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:57948/0 (socket says 172.21.15.123:57948) 2023-03-08T15:49:45.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.291+0000 7fc64bfff700 1 -- 172.21.15.123:0/479071122 learned_addr learned my addr 172.21.15.123:0/479071122 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.291+0000 7fc64bfff700 1 -- 172.21.15.123:0/479071122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc64c06f8d0 msgr2=0x7fc64c151a90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-08T15:49:45.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.291+0000 7fc64bfff700 1 --2- 172.21.15.123:0/479071122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc64c06f8d0 0x7fc64c151a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.291+0000 7fc64bfff700 1 -- 172.21.15.123:0/479071122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc64c06b530 msgr2=0x7fc64c149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.291+0000 7fc64bfff700 1 --2- 172.21.15.123:0/479071122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc64c06b530 0x7fc64c149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.291+0000 7fc64bfff700 1 -- 172.21.15.123:0/479071122 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc640009550 con 0x7fc64c140980 2023-03-08T15:49:45.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.292+0000 7fc64bfff700 1 --2- 172.21.15.123:0/479071122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc64c140980 0x7fc64c14fb60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc640009c10 tx=0x7fc640004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.293+0000 7f8c0a7fc700 1 -- 172.21.15.123:0/397732539 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c0093c0 con 0x7f8c1414a8a0 2023-03-08T15:49:45.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.293+0000 7f8c0a7fc700 1 -- 172.21.15.123:0/397732539 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c009a10 con 0x7f8c1414a8a0 2023-03-08T15:49:45.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.293+0000 7f8c1bef9700 1 -- 172.21.15.123:0/397732539 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c14141d20 con 0x7f8c1414a8a0 2023-03-08T15:49:45.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.293+0000 7f8c0a7fc700 1 -- 172.21.15.123:0/397732539 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c009dc0 con 0x7f8c1414a8a0 2023-03-08T15:49:45.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.293+0000 7f8c1bef9700 1 -- 172.21.15.123:0/397732539 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c14141b90 con 0x7f8c1414a8a0 2023-03-08T15:49:45.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.294+0000 7f7b197fa700 1 -- 172.21.15.123:0/1029421241 <== osd.1 v2:172.21.15.123:6824/143187 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7b00006bb0 con 0x7f7b000015d0 2023-03-08T15:49:45.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.294+0000 7f8c1bef9700 1 -- 172.21.15.123:0/397732539 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8bfc000fb0 con 0x7f8c1414a8a0 2023-03-08T15:49:45.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.295+0000 7f8c0a7fc700 1 -- 172.21.15.123:0/397732539 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f8c0c02d070 con 0x7f8c1414a8a0 2023-03-08T15:49:45.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.296+0000 7f8c0a7fc700 1 --2- 172.21.15.123:0/397732539 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8bf8069900 0x7f8bf806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.296+0000 7f8c0a7fc700 1 -- 172.21.15.123:0/397732539 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c0c089650 con 0x7f8c1414a8a0 2023-03-08T15:49:45.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.296+0000 7f8c0a7fc700 1 --2- 172.21.15.123:0/397732539 >> [v2:172.21.15.123:6816/143196,v1:172.21.15.123:6817/143196] conn(0x7f8bf8072130 0x7f8bf8074540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.296+0000 7f8c0a7fc700 1 -- 172.21.15.123:0/397732539 --> [v2:172.21.15.123:6816/143196,v1:172.21.15.123:6817/143196] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8bf8074bf0 con 0x7f8bf8072130 2023-03-08T15:49:45.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.296+0000 7f8c0a7fc700 1 -- 172.21.15.123:0/397732539 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c0c089ab0 con 0x7f8c1414a8a0 2023-03-08T15:49:45.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.297+0000 7f784cf43700 1 -- 172.21.15.123:0/2805183836 --> [v2:172.21.15.175:6808/114830,v1:172.21.15.175:6809/114830] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f782c002d30 con 0x7f78280721d0 2023-03-08T15:49:45.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.297+0000 7f8c19494700 1 --2- 172.21.15.123:0/397732539 >> [v2:172.21.15.123:6816/143196,v1:172.21.15.123:6817/143196] conn(0x7f8bf8072130 0x7f8bf8074540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.297+0000 7f8c19c95700 1 --2- 172.21.15.123:0/397732539 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8bf8069900 0x7f8bf806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.297+0000 7f8c19c95700 1 --2- 172.21.15.123:0/397732539 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8bf8069900 0x7f8bf806bdb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009960 tx=0x7f8c100090e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.297+0000 7f8c19494700 1 --2- 172.21.15.123:0/397732539 >> [v2:172.21.15.123:6816/143196,v1:172.21.15.123:6817/143196] conn(0x7f8bf8072130 0x7f8bf8074540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.298+0000 7f8c0a7fc700 1 -- 172.21.15.123:0/397732539 <== osd.3 v2:172.21.15.123:6816/143196 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8bf8074bf0 con 0x7f8bf8072130 2023-03-08T15:49:45.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.301+0000 7f61dfb01700 1 -- 172.21.15.123:0/574609865 --> [v2:172.21.15.123:6808/143186,v1:172.21.15.123:6809/143186] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f61c0002d30 con 0x7f61bc072080 2023-03-08T15:49:45.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.301+0000 7f61ce7fc700 1 -- 172.21.15.123:0/574609865 <== osd.2 v2:172.21.15.123:6808/143186 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f61c0002d30 con 0x7f61bc072080 2023-03-08T15:49:45.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.302+0000 7f61dfb01700 1 -- 172.21.15.123:0/574609865 >> [v2:172.21.15.123:6808/143186,v1:172.21.15.123:6809/143186] conn(0x7f61bc072080 msgr2=0x7f61bc074490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.302+0000 7f61dfb01700 1 --2- 172.21.15.123:0/574609865 >> [v2:172.21.15.123:6808/143186,v1:172.21.15.123:6809/143186] conn(0x7f61bc072080 0x7f61bc074490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.302+0000 7f61dfb01700 1 -- 172.21.15.123:0/574609865 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f61bc0698d0 msgr2=0x7f61bc06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.302+0000 7f61dfb01700 1 --2- 172.21.15.123:0/574609865 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f61bc0698d0 0x7f61bc06bd80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61d4000f60 tx=0x7f61d4007a60 comp rx=0 tx=0).stop 2023-03-08T15:49:45.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.302+0000 7f61dfb01700 1 -- 172.21.15.123:0/574609865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d8140df0 msgr2=0x7f61d813cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.302+0000 7f61dfb01700 1 --2- 172.21.15.123:0/574609865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d8140df0 0x7f61d813cb00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f61c800c500 tx=0x7f61c800c8c0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.302+0000 7f61de09e700 1 -- 172.21.15.123:0/574609865 reap_dead start 2023-03-08T15:49:45.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.303+0000 7fc633fff700 1 -- 172.21.15.123:0/479071122 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64001d070 con 0x7fc64c140980 2023-03-08T15:49:45.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.304+0000 7f7836ffd700 1 -- 172.21.15.123:0/2805183836 <== osd.6 v2:172.21.15.175:6808/114830 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f782c002d30 con 0x7f78280721d0 2023-03-08T15:49:45.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.303+0000 7fc633fff700 1 -- 172.21.15.123:0/479071122 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc640004220 con 0x7fc64c140980 2023-03-08T15:49:45.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.303+0000 7fc633fff700 1 -- 172.21.15.123:0/479071122 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640003ab0 con 0x7fc64c140980 2023-03-08T15:49:45.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.303+0000 7fc651a76700 1 -- 172.21.15.123:0/479071122 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c071820 con 0x7fc64c140980 2023-03-08T15:49:45.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.303+0000 7fc651a76700 1 -- 172.21.15.123:0/479071122 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c06fe60 con 0x7fc64c140980 2023-03-08T15:49:45.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.305+0000 7fc633fff700 1 -- 172.21.15.123:0/479071122 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fc640028030 con 0x7fc64c140980 2023-03-08T15:49:45.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.305+0000 7fc633fff700 1 --2- 172.21.15.123:0/479071122 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc638069920 0x7fc63806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.305+0000 7fc633fff700 1 -- 172.21.15.123:0/479071122 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6400885c0 con 0x7fc64c140980 2023-03-08T15:49:45.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.305+0000 7fc64b7fe700 1 --2- 172.21.15.123:0/479071122 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc638069920 0x7fc63806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.306+0000 7fc64b7fe700 1 --2- 172.21.15.123:0/479071122 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc638069920 0x7fc63806bdd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc644007fd0 tx=0x7fc644007da0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.307+0000 7f4fe0e70700 1 -- 172.21.15.123:0/3965735064 --> [v2:172.21.15.175:6816/114842,v1:172.21.15.175:6817/114842] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4fdc0744c0 con 0x7f4fbc072250 2023-03-08T15:49:45.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f61dfb01700 1 -- 172.21.15.123:0/574609865 shutdown_connections 2023-03-08T15:49:45.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f61dfb01700 1 -- 172.21.15.123:0/574609865 >> 172.21.15.123:0/574609865 conn(0x7f61d80b9800 msgr2=0x7f61d8065f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f4fcaffd700 1 -- 172.21.15.123:0/3965735064 <== osd.5 v2:172.21.15.175:6816/114842 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4fdc0744c0 con 0x7f4fbc072250 2023-03-08T15:49:45.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f4fe0e70700 1 -- 172.21.15.123:0/3965735064 >> [v2:172.21.15.175:6816/114842,v1:172.21.15.175:6817/114842] conn(0x7f4fbc072250 msgr2=0x7f4fbc074660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f4fe0e70700 1 --2- 172.21.15.123:0/3965735064 >> [v2:172.21.15.175:6816/114842,v1:172.21.15.175:6817/114842] conn(0x7f4fbc072250 0x7f4fbc074660 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f4fe0e70700 1 -- 172.21.15.123:0/3965735064 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f4fbc0699a0 msgr2=0x7f4fbc06be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f4fe0e70700 1 --2- 172.21.15.123:0/3965735064 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f4fbc0699a0 0x7f4fbc06be50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc146410 tx=0x7f4fd0006d20 comp rx=0 tx=0).stop 2023-03-08T15:49:45.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f4fe0e70700 1 -- 172.21.15.123:0/3965735064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc0b3c50 msgr2=0x7f4fdc0bc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f4fe0e70700 1 --2- 172.21.15.123:0/3965735064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fdc0b3c50 0x7f4fdc0bc4d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00c4a0 tx=0x7f4fcc00c7b0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f4fdad9d700 1 -- 172.21.15.123:0/3965735064 reap_dead start 2023-03-08T15:49:45.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f4fe0e70700 1 -- 172.21.15.123:0/3965735064 shutdown_connections 2023-03-08T15:49:45.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f4fe0e70700 1 -- 172.21.15.123:0/3965735064 >> 172.21.15.123:0/3965735064 conn(0x7f4fdc0ba3c0 msgr2=0x7f4fdc0b6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f4fe0e70700 1 -- 172.21.15.123:0/3965735064 shutdown_connections 2023-03-08T15:49:45.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f4fe0e70700 1 -- 172.21.15.123:0/3965735064 wait complete. 2023-03-08T15:49:45.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f61dfb01700 1 -- 172.21.15.123:0/574609865 shutdown_connections 2023-03-08T15:49:45.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.308+0000 7f61dfb01700 1 -- 172.21.15.123:0/574609865 wait complete. 2023-03-08T15:49:45.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.311+0000 7f784cf43700 1 -- 172.21.15.123:0/2805183836 >> [v2:172.21.15.175:6808/114830,v1:172.21.15.175:6809/114830] conn(0x7f78280721d0 msgr2=0x7f78280745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.311+0000 7f784cf43700 1 --2- 172.21.15.123:0/2805183836 >> [v2:172.21.15.175:6808/114830,v1:172.21.15.175:6809/114830] conn(0x7f78280721d0 0x7f78280745e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.311+0000 7fc651a76700 1 --2- 172.21.15.123:0/479071122 >> [v2:172.21.15.175:6824/114862,v1:172.21.15.175:6825/114862] conn(0x7fc62c0015d0 0x7fc62c003a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.311+0000 7fc651a76700 1 -- 172.21.15.123:0/479071122 --> [v2:172.21.15.175:6824/114862,v1:172.21.15.175:6825/114862] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc62c006bb0 con 0x7fc62c0015d0 2023-03-08T15:49:45.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.313+0000 7f47df7ae700 1 -- 172.21.15.123:0/276270738 --> [v2:172.21.15.123:6800/143185,v1:172.21.15.123:6801/143185] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f47d80744c0 con 0x7f47bc0721d0 2023-03-08T15:49:45.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.313+0000 7f784cf43700 1 -- 172.21.15.123:0/2805183836 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7828069920 msgr2=0x7f782806bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.313+0000 7f784cf43700 1 --2- 172.21.15.123:0/2805183836 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7828069920 0x7f782806bdd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7838006f10 tx=0x7f7838006e60 comp rx=0 tx=0).stop 2023-03-08T15:49:45.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.313+0000 7f784cf43700 1 -- 172.21.15.123:0/2805183836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78480b6500 msgr2=0x7f78481240c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.313+0000 7f784cf43700 1 --2- 172.21.15.123:0/2805183836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78480b6500 0x7f78481240c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f784806e5f0 tx=0x7f7840004ad0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.314+0000 7fc64affd700 1 --2- 172.21.15.123:0/479071122 >> [v2:172.21.15.175:6824/114862,v1:172.21.15.175:6825/114862] conn(0x7fc62c0015d0 0x7fc62c003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.314+0000 7f47d5ffb700 1 -- 172.21.15.123:0/276270738 <== osd.0 v2:172.21.15.123:6800/143185 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f47d80744c0 con 0x7f47bc0721d0 2023-03-08T15:49:45.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.314+0000 7fc64affd700 1 --2- 172.21.15.123:0/479071122 >> [v2:172.21.15.175:6824/114862,v1:172.21.15.175:6825/114862] conn(0x7fc62c0015d0 0x7fc62c003a80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.314+0000 7f7846d9d700 1 -- 172.21.15.123:0/2805183836 reap_dead start 2023-03-08T15:49:45.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.314+0000 7f784cf43700 1 -- 172.21.15.123:0/2805183836 shutdown_connections 2023-03-08T15:49:45.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.314+0000 7f784cf43700 1 -- 172.21.15.123:0/2805183836 >> 172.21.15.123:0/2805183836 conn(0x7f78480bc480 msgr2=0x7f7848148120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.314+0000 7f784cf43700 1 -- 172.21.15.123:0/2805183836 shutdown_connections 2023-03-08T15:49:45.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.314+0000 7f784cf43700 1 -- 172.21.15.123:0/2805183836 wait complete. 2023-03-08T15:49:45.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.315+0000 7f47df7ae700 1 -- 172.21.15.123:0/276270738 >> [v2:172.21.15.123:6800/143185,v1:172.21.15.123:6801/143185] conn(0x7f47bc0721d0 msgr2=0x7f47bc0745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.315+0000 7f47df7ae700 1 --2- 172.21.15.123:0/276270738 >> [v2:172.21.15.123:6800/143185,v1:172.21.15.123:6801/143185] conn(0x7f47bc0721d0 0x7f47bc0745e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.315+0000 7f47df7ae700 1 -- 172.21.15.123:0/276270738 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f47bc069920 msgr2=0x7f47bc06bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.315+0000 7f47df7ae700 1 --2- 172.21.15.123:0/276270738 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f47bc069920 0x7f47bc06bdd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f47cc000f80 tx=0x7f47cc014000 comp rx=0 tx=0).stop 2023-03-08T15:49:45.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.315+0000 7f47df7ae700 1 -- 172.21.15.123:0/276270738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47d8147470 msgr2=0x7f47d80b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.315+0000 7f47df7ae700 1 --2- 172.21.15.123:0/276270738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47d8147470 0x7f47d80b2d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f47d000c490 tx=0x7f47d0001e70 comp rx=0 tx=0).stop 2023-03-08T15:49:45.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.315+0000 7fc633fff700 1 -- 172.21.15.123:0/479071122 <== osd.7 v2:172.21.15.175:6824/114862 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc62c006bb0 con 0x7fc62c0015d0 2023-03-08T15:49:45.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.317+0000 7f462fefc700 1 -- 172.21.15.123:0/2018892233 --> [v2:172.21.15.175:6800/114829,v1:172.21.15.175:6801/114829] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4628070d00 con 0x7f460c072180 2023-03-08T15:49:45.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.318+0000 7f461e7fc700 1 -- 172.21.15.123:0/2018892233 <== osd.4 v2:172.21.15.175:6800/114829 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f46180013d0 con 0x7f460c072180 2023-03-08T15:49:45.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.319+0000 7f47ddd4b700 1 -- 172.21.15.123:0/276270738 reap_dead start 2023-03-08T15:49:45.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.319+0000 7f47df7ae700 1 -- 172.21.15.123:0/276270738 shutdown_connections 2023-03-08T15:49:45.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.319+0000 7f47df7ae700 1 -- 172.21.15.123:0/276270738 >> 172.21.15.123:0/276270738 conn(0x7f47d80bc930 msgr2=0x7f47d81d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.323+0000 7f47df7ae700 1 -- 172.21.15.123:0/276270738 shutdown_connections 2023-03-08T15:49:45.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.323+0000 7f47df7ae700 1 -- 172.21.15.123:0/276270738 wait complete. 2023-03-08T15:49:45.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.326+0000 7f7b22f76700 1 -- 172.21.15.123:0/1029421241 --> [v2:172.21.15.123:6824/143187,v1:172.21.15.123:6825/143187] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7b00005c30 con 0x7f7b000015d0 2023-03-08T15:49:45.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.327+0000 7f7b197fa700 1 -- 172.21.15.123:0/1029421241 <== osd.1 v2:172.21.15.123:6824/143187 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7b00005c30 con 0x7f7b000015d0 2023-03-08T15:49:45.376 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-03-08T15:49:45.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.328+0000 7f8c1bef9700 1 -- 172.21.15.123:0/397732539 --> [v2:172.21.15.123:6816/143196,v1:172.21.15.123:6817/143196] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8bfc002d30 con 0x7f8bf8072130 2023-03-08T15:49:45.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.328+0000 7f462fefc700 1 -- 172.21.15.123:0/2018892233 >> [v2:172.21.15.175:6800/114829,v1:172.21.15.175:6801/114829] conn(0x7f460c072180 msgr2=0x7f460c074590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.328+0000 7f462fefc700 1 --2- 172.21.15.123:0/2018892233 >> [v2:172.21.15.175:6800/114829,v1:172.21.15.175:6801/114829] conn(0x7f460c072180 0x7f460c074590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.328+0000 7f462fefc700 1 -- 172.21.15.123:0/2018892233 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f460c0698d0 msgr2=0x7f460c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.328+0000 7f462fefc700 1 --2- 172.21.15.123:0/2018892233 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f460c0698d0 0x7f460c06bd80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4620001350 tx=0x7f4620009040 comp rx=0 tx=0).stop 2023-03-08T15:49:45.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.328+0000 7f462fefc700 1 -- 172.21.15.123:0/2018892233 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46281f00c0 msgr2=0x7f46281f0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.328+0000 7f462fefc700 1 --2- 172.21.15.123:0/2018892233 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46281f00c0 0x7f46281f0530 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4624009860 tx=0x7f46240047c0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.328+0000 7f462e499700 1 -- 172.21.15.123:0/2018892233 reap_dead start 2023-03-08T15:49:45.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.329+0000 7f462fefc700 1 -- 172.21.15.123:0/2018892233 shutdown_connections 2023-03-08T15:49:45.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.329+0000 7f462fefc700 1 -- 172.21.15.123:0/2018892233 >> 172.21.15.123:0/2018892233 conn(0x7f462806a250 msgr2=0x7f46280b9860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.329+0000 7f462fefc700 1 -- 172.21.15.123:0/2018892233 shutdown_connections 2023-03-08T15:49:45.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.329+0000 7f462fefc700 1 -- 172.21.15.123:0/2018892233 wait complete. 2023-03-08T15:49:45.379 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-03-08T15:49:45.380 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-03-08T15:49:45.380 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-03-08T15:49:45.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.329+0000 7f7b22f76700 1 -- 172.21.15.123:0/1029421241 >> [v2:172.21.15.123:6824/143187,v1:172.21.15.123:6825/143187] conn(0x7f7b000015d0 msgr2=0x7f7b00003a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.329+0000 7f7b22f76700 1 --2- 172.21.15.123:0/1029421241 >> [v2:172.21.15.123:6824/143187,v1:172.21.15.123:6825/143187] conn(0x7f7b000015d0 0x7f7b00003a80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.382 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-03-08T15:49:45.382 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-03-08T15:49:45.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f8c0a7fc700 1 -- 172.21.15.123:0/397732539 <== osd.3 v2:172.21.15.123:6816/143196 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8bfc002d30 con 0x7f8bf8072130 2023-03-08T15:49:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f7b22f76700 1 -- 172.21.15.123:0/1029421241 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7afc069950 msgr2=0x7f7afc06be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f7b22f76700 1 --2- 172.21.15.123:0/1029421241 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7afc069950 0x7f7afc06be00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7b04000f60 tx=0x7f7b04007a40 comp rx=0 tx=0).stop 2023-03-08T15:49:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f7b22f76700 1 -- 172.21.15.123:0/1029421241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b1c14ebb0 msgr2=0x7f7b1c1435d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f7b22f76700 1 --2- 172.21.15.123:0/1029421241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b1c14ebb0 0x7f7b1c1435d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b14012000 tx=0x7f7b14004ad0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f7b21513700 1 -- 172.21.15.123:0/1029421241 reap_dead start 2023-03-08T15:49:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f7b22f76700 1 -- 172.21.15.123:0/1029421241 shutdown_connections 2023-03-08T15:49:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f7b22f76700 1 -- 172.21.15.123:0/1029421241 >> 172.21.15.123:0/1029421241 conn(0x7f7b1c0bc930 msgr2=0x7f7b1c0b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f7b22f76700 1 -- 172.21.15.123:0/1029421241 shutdown_connections 2023-03-08T15:49:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f7b22f76700 1 -- 172.21.15.123:0/1029421241 wait complete. 2023-03-08T15:49:45.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f8c1bef9700 1 -- 172.21.15.123:0/397732539 >> [v2:172.21.15.123:6816/143196,v1:172.21.15.123:6817/143196] conn(0x7f8bf8072130 msgr2=0x7f8bf8074540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f8c1bef9700 1 --2- 172.21.15.123:0/397732539 >> [v2:172.21.15.123:6816/143196,v1:172.21.15.123:6817/143196] conn(0x7f8bf8072130 0x7f8bf8074540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f8c1bef9700 1 -- 172.21.15.123:0/397732539 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8bf8069900 msgr2=0x7f8bf806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f8c1bef9700 1 --2- 172.21.15.123:0/397732539 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8bf8069900 0x7f8bf806bdb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009960 tx=0x7f8c100090e0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f8c1bef9700 1 -- 172.21.15.123:0/397732539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c1414a8a0 msgr2=0x7f8c141446c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.330+0000 7f8c1bef9700 1 --2- 172.21.15.123:0/397732539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c1414a8a0 0x7f8c141446c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c017040 tx=0x7f8c0c004ad0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.331+0000 7f8c1a496700 1 -- 172.21.15.123:0/397732539 reap_dead start 2023-03-08T15:49:45.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.331+0000 7f8c1bef9700 1 -- 172.21.15.123:0/397732539 shutdown_connections 2023-03-08T15:49:45.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.331+0000 7f8c1bef9700 1 -- 172.21.15.123:0/397732539 >> 172.21.15.123:0/397732539 conn(0x7f8c1406b360 msgr2=0x7f8c1413f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.335+0000 7f8c1bef9700 1 -- 172.21.15.123:0/397732539 shutdown_connections 2023-03-08T15:49:45.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.336+0000 7f8c1bef9700 1 -- 172.21.15.123:0/397732539 wait complete. 2023-03-08T15:49:45.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.341+0000 7fc651a76700 1 -- 172.21.15.123:0/479071122 --> [v2:172.21.15.175:6824/114862,v1:172.21.15.175:6825/114862] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc62c005c90 con 0x7fc62c0015d0 2023-03-08T15:49:45.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.342+0000 7fc633fff700 1 -- 172.21.15.123:0/479071122 <== osd.7 v2:172.21.15.175:6824/114862 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc62c005c90 con 0x7fc62c0015d0 2023-03-08T15:49:45.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.342+0000 7fc651a76700 1 -- 172.21.15.123:0/479071122 >> [v2:172.21.15.175:6824/114862,v1:172.21.15.175:6825/114862] conn(0x7fc62c0015d0 msgr2=0x7fc62c003a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.342+0000 7fc651a76700 1 --2- 172.21.15.123:0/479071122 >> [v2:172.21.15.175:6824/114862,v1:172.21.15.175:6825/114862] conn(0x7fc62c0015d0 0x7fc62c003a80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.342+0000 7fc651a76700 1 -- 172.21.15.123:0/479071122 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc638069920 msgr2=0x7fc63806bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.342+0000 7fc651a76700 1 --2- 172.21.15.123:0/479071122 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc638069920 0x7fc63806bdd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc644007fd0 tx=0x7fc644007da0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.342+0000 7fc651a76700 1 -- 172.21.15.123:0/479071122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc64c140980 msgr2=0x7fc64c14fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.342+0000 7fc651a76700 1 --2- 172.21.15.123:0/479071122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc64c140980 0x7fc64c14fb60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc640009c10 tx=0x7fc640004750 comp rx=0 tx=0).stop 2023-03-08T15:49:45.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.342+0000 7fc64bfff700 1 -- 172.21.15.123:0/479071122 reap_dead start 2023-03-08T15:49:45.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.342+0000 7fc651a76700 1 -- 172.21.15.123:0/479071122 shutdown_connections 2023-03-08T15:49:45.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.342+0000 7fc651a76700 1 -- 172.21.15.123:0/479071122 >> 172.21.15.123:0/479071122 conn(0x7fc64c0ba3c0 msgr2=0x7fc64c13f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.343+0000 7fc651a76700 1 -- 172.21.15.123:0/479071122 shutdown_connections 2023-03-08T15:49:45.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.343+0000 7fc651a76700 1 -- 172.21.15.123:0/479071122 wait complete. 2023-03-08T15:49:45.390 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-03-08T15:49:45.391 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-03-08T15:49:45.392 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-03-08T15:49:45.392 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-03-08T15:49:45.393 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2023-03-08T15:49:45.393 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-03-08T15:49:45.394 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2023-03-08T15:49:45.394 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-03-08T15:49:45.395 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2023-03-08T15:49:45.396 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-03-08T15:49:45.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.624+0000 7f690a61a700 1 Processor -- start 2023-03-08T15:49:45.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.624+0000 7f690a61a700 1 -- start start 2023-03-08T15:49:45.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.625+0000 7f690a61a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f69040b47e0 0x7f690414f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.625+0000 7f690a61a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f690406aee0 0x7f690414f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.625+0000 7f690a61a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69040b6500 0x7f6904152150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.625+0000 7f690a61a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69040b3e00 con 0x7f69040b6500 2023-03-08T15:49:45.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.625+0000 7f690a61a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69040b4010 con 0x7f69040b47e0 2023-03-08T15:49:45.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.625+0000 7f690a61a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690414ec70 con 0x7f690406aee0 2023-03-08T15:49:45.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.626+0000 7f6908bb7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69040b6500 0x7f6904152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.626+0000 7f6903fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f69040b47e0 0x7f690414f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.626+0000 7f6908bb7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69040b6500 0x7f6904152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53836/0 (socket says 172.21.15.123:53836) 2023-03-08T15:49:45.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.626+0000 7f69037fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f690406aee0 0x7f690414f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.626+0000 7f6908bb7700 1 -- 172.21.15.123:0/3995135207 learned_addr learned my addr 172.21.15.123:0/3995135207 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.626+0000 7f6903fff700 1 -- 172.21.15.123:0/3995135207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f690406aee0 msgr2=0x7f690414f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.626+0000 7f6903fff700 1 --2- 172.21.15.123:0/3995135207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f690406aee0 0x7f690414f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.626+0000 7f6903fff700 1 -- 172.21.15.123:0/3995135207 >> v2:172.21.15.123:3300/0 conn(0x7f69040b6500 msgr2=0x7f6904152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.626+0000 7f6903fff700 1 --2- 172.21.15.123:0/3995135207 >> v2:172.21.15.123:3300/0 conn(0x7f69040b6500 0x7f6904152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.626+0000 7f6903fff700 1 -- 172.21.15.123:0/3995135207 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6904149250 con 0x7f69040b47e0 2023-03-08T15:49:45.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.626+0000 7f69037fe700 1 --2- 172.21.15.123:0/3995135207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f690406aee0 0x7f690414f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:45.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.626+0000 7f6903fff700 1 --2- 172.21.15.123:0/3995135207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69040b47e0 0x7f690414f190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6904067c60 tx=0x7f68ec009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ab8aca259bac430 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.627+0000 7fa508c1e700 1 Processor -- start 2023-03-08T15:49:45.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.627+0000 7fa508c1e700 1 -- start start 2023-03-08T15:49:45.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.628+0000 7fa508c1e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa50406fa10 0x7fa50406a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.628+0000 7fa508c1e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa504071660 0x7fa504071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.628+0000 7fa508c1e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5040b9040 con 0x7fa504148f10 2023-03-08T15:49:45.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.628+0000 7fa508c1e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5041492e0 con 0x7fa50406fa10 2023-03-08T15:49:45.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.628+0000 7fa508c1e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50406ff30 con 0x7fa504071660 2023-03-08T15:49:45.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.628+0000 7fa501d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa50406fa10 0x7fa50406a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.628+0000 7fa501d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa50406fa10 0x7fa50406a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53840/0 (socket says 172.21.15.123:53840) 2023-03-08T15:49:45.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.628+0000 7fa501d9b700 1 -- 172.21.15.123:0/2930851052 learned_addr learned my addr 172.21.15.123:0/2930851052 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.629+0000 7fa502d9d700 1 --2- 172.21.15.123:0/2930851052 >> v2:172.21.15.175:3300/0 conn(0x7fa504071660 0x7fa504071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.629+0000 7fa501d9b700 1 -- 172.21.15.123:0/2930851052 >> v2:172.21.15.175:3300/0 conn(0x7fa504071660 msgr2=0x7fa504071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.629+0000 7fa501d9b700 1 --2- 172.21.15.123:0/2930851052 >> v2:172.21.15.175:3300/0 conn(0x7fa504071660 0x7fa504071ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.629+0000 7fa501d9b700 1 -- 172.21.15.123:0/2930851052 >> v1:172.21.15.123:6789/0 conn(0x7fa504148f10 legacy=0x7fa5040b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.629+0000 7fa501d9b700 1 -- 172.21.15.123:0/2930851052 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5040b8840 con 0x7fa50406fa10 2023-03-08T15:49:45.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.629+0000 7fa501d9b700 1 --2- 172.21.15.123:0/2930851052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa50406fa10 0x7fa50406a250 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa50406f9a0 tx=0x7fa4fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d555f650a809eb6 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.629+0000 7f6902ffd700 1 -- 172.21.15.123:0/3995135207 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec011830 con 0x7f69040b47e0 2023-03-08T15:49:45.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.629+0000 7f6902ffd700 1 -- 172.21.15.123:0/3995135207 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec011990 con 0x7f69040b47e0 2023-03-08T15:49:45.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.629+0000 7f6902ffd700 1 -- 172.21.15.123:0/3995135207 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec011d20 con 0x7f69040b47e0 2023-03-08T15:49:45.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.629+0000 7fa50159a700 1 -- 172.21.15.123:0/2930851052 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc00e070 con 0x7fa50406fa10 2023-03-08T15:49:45.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7f690a61a700 1 -- 172.21.15.123:0/3995135207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69040b47e0 msgr2=0x7f690414f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7f690a61a700 1 --2- 172.21.15.123:0/3995135207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69040b47e0 0x7f690414f190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6904067c60 tx=0x7f68ec009b20 comp rx=0 tx=0).stop 2023-03-08T15:49:45.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7f690a61a700 1 -- 172.21.15.123:0/3995135207 shutdown_connections 2023-03-08T15:49:45.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7f690a61a700 1 --2- 172.21.15.123:0/3995135207 >> v2:172.21.15.123:3300/0 conn(0x7f69040b6500 0x7f6904152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7f690a61a700 1 --2- 172.21.15.123:0/3995135207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69040b47e0 0x7f690414f190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7f690a61a700 1 --2- 172.21.15.123:0/3995135207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f690406aee0 0x7f690414f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7f690a61a700 1 -- 172.21.15.123:0/3995135207 >> 172.21.15.123:0/3995135207 conn(0x7f69040bc480 msgr2=0x7f69040bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7f690a61a700 1 -- 172.21.15.123:0/3995135207 shutdown_connections 2023-03-08T15:49:45.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7f690a61a700 1 -- 172.21.15.123:0/3995135207 wait complete. 2023-03-08T15:49:45.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.631+0000 7f959f1a9700 1 Processor -- start 2023-03-08T15:49:45.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.632+0000 7f959f1a9700 1 -- start start 2023-03-08T15:49:45.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.632+0000 7f690a61a700 1 Processor -- start 2023-03-08T15:49:45.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.632+0000 7f690a61a700 1 -- start start 2023-03-08T15:49:45.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.632+0000 7f959f1a9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9598144a60 0x7f95980b8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.632+0000 7f959f1a9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f95980b7d70 0x7f95980b8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.632+0000 7f959f1a9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9598072000 con 0x7f95980b9080 2023-03-08T15:49:45.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.632+0000 7f959f1a9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959806fca0 con 0x7f95980b7d70 2023-03-08T15:49:45.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.632+0000 7f959f1a9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9598070bc0 con 0x7f9598144a60 2023-03-08T15:49:45.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f959cf45700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9598144a60 0x7f95980b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.639 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f959cf45700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9598144a60 0x7f95980b8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:57966/0 (socket says 172.21.15.123:57966) 2023-03-08T15:49:45.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f959cf45700 1 -- 172.21.15.123:0/3364588472 learned_addr learned my addr 172.21.15.123:0/3364588472 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f959d746700 1 --2- 172.21.15.123:0/3364588472 >> v2:172.21.15.123:3300/0 conn(0x7f95980b7d70 0x7f95980b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f959cf45700 1 -- 172.21.15.123:0/3364588472 >> v2:172.21.15.123:3300/0 conn(0x7f95980b7d70 msgr2=0x7f95980b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f959cf45700 1 --2- 172.21.15.123:0/3364588472 >> v2:172.21.15.123:3300/0 conn(0x7f95980b7d70 0x7f95980b8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f959cf45700 1 -- 172.21.15.123:0/3364588472 >> v1:172.21.15.123:6789/0 conn(0x7f95980b9080 legacy=0x7f95980718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f959cf45700 1 -- 172.21.15.123:0/3364588472 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598070ea0 con 0x7f9598144a60 2023-03-08T15:49:45.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f690a61a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f690406aee0 0x7f690406ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f690a61a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69040b47e0 0x7f6904138880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f690a61a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69040b6500 0x7f690414b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f690a61a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6904070510 con 0x7f69040b47e0 2023-03-08T15:49:45.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f690a61a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6904150410 con 0x7f690406aee0 2023-03-08T15:49:45.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f690a61a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6904070e20 con 0x7f69040b6500 2023-03-08T15:49:45.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f6903fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f690406aee0 0x7f690406ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f6903fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f690406aee0 0x7f690406ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:34716/0 (socket says 172.21.15.123:34716) 2023-03-08T15:49:45.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f6903fff700 1 -- 172.21.15.123:0/2642890736 learned_addr learned my addr 172.21.15.123:0/2642890736 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f959cf45700 1 --2- 172.21.15.123:0/3364588472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9598144a60 0x7f95980b8890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f958c0098f0 tx=0x7f958c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae3de7908b66a130 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f69037fe700 1 --2- 172.21.15.123:0/2642890736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69040b47e0 0x7f6904138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f95977fe700 1 -- 172.21.15.123:0/3364588472 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c00b8a0 con 0x7f9598144a60 2023-03-08T15:49:45.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f95977fe700 1 -- 172.21.15.123:0/3364588472 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c00ba00 con 0x7f9598144a60 2023-03-08T15:49:45.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.633+0000 7f95977fe700 1 -- 172.21.15.123:0/3364588472 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c00bd70 con 0x7f9598144a60 2023-03-08T15:49:45.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.629+0000 7fa50159a700 1 -- 172.21.15.123:0/2930851052 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc003a20 con 0x7fa50406fa10 2023-03-08T15:49:45.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.629+0000 7fa50159a700 1 -- 172.21.15.123:0/2930851052 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc003dd0 con 0x7fa50406fa10 2023-03-08T15:49:45.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7fa508c1e700 1 -- 172.21.15.123:0/2930851052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa50406fa10 msgr2=0x7fa50406a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7fa508c1e700 1 --2- 172.21.15.123:0/2930851052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa50406fa10 0x7fa50406a250 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa50406f9a0 tx=0x7fa4fc00b330 comp rx=0 tx=0).stop 2023-03-08T15:49:45.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7fa508c1e700 1 -- 172.21.15.123:0/2930851052 shutdown_connections 2023-03-08T15:49:45.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7fa508c1e700 1 --2- 172.21.15.123:0/2930851052 >> v2:172.21.15.175:3300/0 conn(0x7fa504071660 0x7fa504071ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7fa508c1e700 1 --2- 172.21.15.123:0/2930851052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa50406fa10 0x7fa50406a250 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7fa508c1e700 1 -- 172.21.15.123:0/2930851052 >> 172.21.15.123:0/2930851052 conn(0x7fa50406b360 msgr2=0x7fa50406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.632+0000 7fa508c1e700 1 -- 172.21.15.123:0/2930851052 shutdown_connections 2023-03-08T15:49:45.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.632+0000 7fa508c1e700 1 -- 172.21.15.123:0/2930851052 wait complete. 2023-03-08T15:49:45.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7fa508c1e700 1 Processor -- start 2023-03-08T15:49:45.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7f7405804700 1 Processor -- start 2023-03-08T15:49:45.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.630+0000 7f7405804700 1 -- start start 2023-03-08T15:49:45.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.631+0000 7f7405804700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f740008a300 0x7f74000b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.631+0000 7f7405804700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f74000b9340 0x7f7400161bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.631+0000 7f7405804700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74000b85f0 con 0x7f74000b8ed0 2023-03-08T15:49:45.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.631+0000 7f7405804700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740008a6d0 con 0x7f74000b9340 2023-03-08T15:49:45.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.631+0000 7f7405804700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74000b8890 con 0x7f740008a300 2023-03-08T15:49:45.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.631+0000 7f73ff7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f74000b9340 0x7f7400161bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.631+0000 7f73ff7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f74000b9340 0x7f7400161bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53842/0 (socket says 172.21.15.123:53842) 2023-03-08T15:49:45.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.631+0000 7f73ff7fe700 1 -- 172.21.15.123:0/96240480 learned_addr learned my addr 172.21.15.123:0/96240480 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f69037fe700 1 -- 172.21.15.123:0/2642890736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69040b6500 msgr2=0x7f690414b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f69037fe700 1 --2- 172.21.15.123:0/2642890736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69040b6500 0x7f690414b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f69037fe700 1 -- 172.21.15.123:0/2642890736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f690406aee0 msgr2=0x7f690406ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f69037fe700 1 --2- 172.21.15.123:0/2642890736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f690406aee0 0x7f690406ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f69037fe700 1 -- 172.21.15.123:0/2642890736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc0094a0 con 0x7f69040b47e0 2023-03-08T15:49:45.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7fa508c1e700 1 -- start start 2023-03-08T15:49:45.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f69037fe700 1 --2- 172.21.15.123:0/2642890736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69040b47e0 0x7f6904138880 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00e9b0 tx=0x7f68fc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.631+0000 7f73feffd700 1 --2- 172.21.15.123:0/96240480 >> v2:172.21.15.175:3300/0 conn(0x7f740008a300 0x7f74000b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f73ff7fe700 1 -- 172.21.15.123:0/96240480 >> v2:172.21.15.175:3300/0 conn(0x7f740008a300 msgr2=0x7f74000b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f73ff7fe700 1 --2- 172.21.15.123:0/96240480 >> v2:172.21.15.175:3300/0 conn(0x7f740008a300 0x7f74000b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f73ff7fe700 1 -- 172.21.15.123:0/96240480 >> v1:172.21.15.175:6789/0 conn(0x7f74000b8ed0 legacy=0x7f74000b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f73ff7fe700 1 -- 172.21.15.123:0/96240480 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74000b8b70 con 0x7f74000b9340 2023-03-08T15:49:45.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f959f1a9700 1 -- 172.21.15.123:0/3364588472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9598144a60 msgr2=0x7f95980b8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f959f1a9700 1 --2- 172.21.15.123:0/3364588472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9598144a60 0x7f95980b8890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f958c0098f0 tx=0x7f958c009c00 comp rx=0 tx=0).stop 2023-03-08T15:49:45.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f959f1a9700 1 -- 172.21.15.123:0/3364588472 shutdown_connections 2023-03-08T15:49:45.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f959f1a9700 1 --2- 172.21.15.123:0/3364588472 >> v2:172.21.15.123:3300/0 conn(0x7f95980b7d70 0x7f95980b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f959f1a9700 1 --2- 172.21.15.123:0/3364588472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9598144a60 0x7f95980b8890 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f959f1a9700 1 -- 172.21.15.123:0/3364588472 >> 172.21.15.123:0/3364588472 conn(0x7f95980b9800 msgr2=0x7f95980b9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f6900ff9700 1 -- 172.21.15.123:0/2642890736 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc004240 con 0x7f69040b47e0 2023-03-08T15:49:45.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f6900ff9700 1 -- 172.21.15.123:0/2642890736 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc0043a0 con 0x7f69040b47e0 2023-03-08T15:49:45.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f6900ff9700 1 -- 172.21.15.123:0/2642890736 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc0036a0 con 0x7f69040b47e0 2023-03-08T15:49:45.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.634+0000 7f690a61a700 1 -- 172.21.15.123:0/2642890736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ec0094a0 con 0x7f69040b47e0 2023-03-08T15:49:45.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7f690a61a700 1 -- 172.21.15.123:0/2642890736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69040b3880 con 0x7f69040b47e0 2023-03-08T15:49:45.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7f5b7fcd1700 1 Processor -- start 2023-03-08T15:49:45.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7fa508c1e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa50406fa10 0x7fa50414bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7fa508c1e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa504071660 0x7fa50414afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7fa508c1e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa504148f10 0x7fa5041f0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7fa508c1e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50414c4a0 con 0x7fa50406fa10 2023-03-08T15:49:45.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7fa508c1e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50414a3e0 con 0x7fa504148f10 2023-03-08T15:49:45.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7fa508c1e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa504149a10 con 0x7fa504071660 2023-03-08T15:49:45.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7fa502d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa504148f10 0x7fa5041f0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7fa502d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa504148f10 0x7fa5041f0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:34732/0 (socket says 172.21.15.123:34732) 2023-03-08T15:49:45.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7fa502d9d700 1 -- 172.21.15.123:0/1876122411 learned_addr learned my addr 172.21.15.123:0/1876122411 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7fa502d9d700 1 -- 172.21.15.123:0/1876122411 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa504071660 msgr2=0x7fa50414afe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-08T15:49:45.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7fa502d9d700 1 --2- 172.21.15.123:0/1876122411 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa504071660 0x7fa50414afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7fa502d9d700 1 -- 172.21.15.123:0/1876122411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa50406fa10 msgr2=0x7fa50414bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7fa502d9d700 1 --2- 172.21.15.123:0/1876122411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa50406fa10 0x7fa50414bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7fa502d9d700 1 -- 172.21.15.123:0/1876122411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc009b30 con 0x7fa504148f10 2023-03-08T15:49:45.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7fa502d9d700 1 --2- 172.21.15.123:0/1876122411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa504148f10 0x7fa5041f0620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800e800 tx=0x7fa4f800ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7fa4f2ffd700 1 -- 172.21.15.123:0/1876122411 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8013680 con 0x7fa504148f10 2023-03-08T15:49:45.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7fa4f2ffd700 1 -- 172.21.15.123:0/1876122411 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f8013800 con 0x7fa504148f10 2023-03-08T15:49:45.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7fa4f2ffd700 1 -- 172.21.15.123:0/1876122411 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8013bb0 con 0x7fa504148f10 2023-03-08T15:49:45.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7fa508c1e700 1 -- 172.21.15.123:0/1876122411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50406a790 con 0x7fa504148f10 2023-03-08T15:49:45.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f73ff7fe700 1 --2- 172.21.15.123:0/96240480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74000b9340 0x7f7400161bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f74000b9e00 tx=0x7f73f800c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f689bed5c07c7ae2 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f959f1a9700 1 -- 172.21.15.123:0/3364588472 shutdown_connections 2023-03-08T15:49:45.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.635+0000 7f5b7fcd1700 1 -- start start 2023-03-08T15:49:45.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f5b7fcd1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5b78146ad0 0x7f5b78146f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f5b7fcd1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5b78140520 0x7f5b78140960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f5b7fcd1700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b780b47d0 con 0x7f5b780b9170 2023-03-08T15:49:45.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f5b7fcd1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b78147470 con 0x7f5b78146ad0 2023-03-08T15:49:45.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f5b7fcd1700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b780b4a70 con 0x7f5b78140520 2023-03-08T15:49:45.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f5b7e26e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5b78140520 0x7f5b78140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f5b7d26c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5b78146ad0 0x7f5b78146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f5b7e26e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5b78140520 0x7f5b78140960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:34736/0 (socket says 172.21.15.123:34736) 2023-03-08T15:49:45.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f5b7e26e700 1 -- 172.21.15.123:0/1049535212 learned_addr learned my addr 172.21.15.123:0/1049535212 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f5b7d26c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5b78146ad0 0x7f5b78146f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53882/0 (socket says 172.21.15.123:53882) 2023-03-08T15:49:45.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f5b7d26c700 1 -- 172.21.15.123:0/1049535212 >> v2:172.21.15.175:3300/0 conn(0x7f5b78140520 msgr2=0x7f5b78140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f5b7d26c700 1 --2- 172.21.15.123:0/1049535212 >> v2:172.21.15.175:3300/0 conn(0x7f5b78140520 0x7f5b78140960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f5b7d26c700 1 -- 172.21.15.123:0/1049535212 >> v1:172.21.15.123:6789/0 conn(0x7f5b780b9170 legacy=0x7f5b780b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f5b7d26c700 1 -- 172.21.15.123:0/1049535212 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b780b4d50 con 0x7f5b78146ad0 2023-03-08T15:49:45.659 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.637+0000 7f5b7d26c700 1 --2- 172.21.15.123:0/1049535212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b78146ad0 0x7f5b78146f30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b780b5d70 tx=0x7f5b70006500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3dadcf11c568a0d server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.637+0000 7f5b7ca6b700 1 -- 172.21.15.123:0/1049535212 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70003c20 con 0x7f5b78146ad0 2023-03-08T15:49:45.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.637+0000 7f5b7ca6b700 1 -- 172.21.15.123:0/1049535212 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b70003d80 con 0x7f5b78146ad0 2023-03-08T15:49:45.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.637+0000 7f5b7ca6b700 1 -- 172.21.15.123:0/1049535212 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000db80 con 0x7f5b78146ad0 2023-03-08T15:49:45.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.638+0000 7f5b7fcd1700 1 -- 172.21.15.123:0/1049535212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b78146ad0 msgr2=0x7f5b78146f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.660 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.638+0000 7f5b7fcd1700 1 --2- 172.21.15.123:0/1049535212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b78146ad0 0x7f5b78146f30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b780b5d70 tx=0x7f5b70006500 comp rx=0 tx=0).stop 2023-03-08T15:49:45.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7fa508c1e700 1 -- 172.21.15.123:0/1876122411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5040b8b20 con 0x7fa504148f10 2023-03-08T15:49:45.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.637+0000 7fa508c1e700 1 -- 172.21.15.123:0/1876122411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50406a920 con 0x7fa504148f10 2023-03-08T15:49:45.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.638+0000 7fa4f2ffd700 1 -- 172.21.15.123:0/1876122411 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fa4f8019030 con 0x7fa504148f10 2023-03-08T15:49:45.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.637+0000 7f959f1a9700 1 -- 172.21.15.123:0/3364588472 wait complete. 2023-03-08T15:49:45.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.639+0000 7f959f1a9700 1 Processor -- start 2023-03-08T15:49:45.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.639+0000 7fa4f2ffd700 1 --2- 172.21.15.123:0/1876122411 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4e4069920 0x7fa4e406bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.639+0000 7fa4f2ffd700 1 -- 172.21.15.123:0/1876122411 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa4f8087390 con 0x7fa504148f10 2023-03-08T15:49:45.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.639+0000 7fa50259c700 1 --2- 172.21.15.123:0/1876122411 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4e4069920 0x7fa4e406bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.639+0000 7f6900ff9700 1 -- 172.21.15.123:0/2642890736 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f68fc003800 con 0x7f69040b47e0 2023-03-08T15:49:45.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f73fdffb700 1 -- 172.21.15.123:0/96240480 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f800cd60 con 0x7f74000b9340 2023-03-08T15:49:45.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f73fdffb700 1 -- 172.21.15.123:0/96240480 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f800cec0 con 0x7f74000b9340 2023-03-08T15:49:45.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.636+0000 7f73fdffb700 1 -- 172.21.15.123:0/96240480 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8011630 con 0x7f74000b9340 2023-03-08T15:49:45.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.637+0000 7f7405804700 1 -- 172.21.15.123:0/96240480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74000b9340 msgr2=0x7f7400161bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.637+0000 7f7405804700 1 --2- 172.21.15.123:0/96240480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74000b9340 0x7f7400161bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f74000b9e00 tx=0x7f73f800c470 comp rx=0 tx=0).stop 2023-03-08T15:49:45.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.637+0000 7f7405804700 1 -- 172.21.15.123:0/96240480 shutdown_connections 2023-03-08T15:49:45.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.637+0000 7f7405804700 1 --2- 172.21.15.123:0/96240480 >> v2:172.21.15.175:3300/0 conn(0x7f740008a300 0x7f74000b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.637+0000 7f7405804700 1 --2- 172.21.15.123:0/96240480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74000b9340 0x7f7400161bf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.637+0000 7f7405804700 1 -- 172.21.15.123:0/96240480 >> 172.21.15.123:0/96240480 conn(0x7f740006a250 msgr2=0x7f740006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.637+0000 7f7405804700 1 -- 172.21.15.123:0/96240480 shutdown_connections 2023-03-08T15:49:45.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.638+0000 7f7405804700 1 -- 172.21.15.123:0/96240480 wait complete. 2023-03-08T15:49:45.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.639+0000 7f7405804700 1 Processor -- start 2023-03-08T15:49:45.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.639+0000 7f7405804700 1 -- start start 2023-03-08T15:49:45.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.639+0000 7f6900ff9700 1 --2- 172.21.15.123:0/2642890736 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f68e40698d0 0x7f68e406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.639+0000 7f6900ff9700 1 -- 172.21.15.123:0/2642890736 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68fc087920 con 0x7f69040b47e0 2023-03-08T15:49:45.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.639+0000 7fa50259c700 1 --2- 172.21.15.123:0/1876122411 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4e4069920 0x7fa4e406bdd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4001600 tx=0x7fa4f4007a20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f690a61a700 1 -- 172.21.15.123:0/2642890736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e80052e0 con 0x7f69040b47e0 2023-03-08T15:49:45.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f6903fff700 1 --2- 172.21.15.123:0/2642890736 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f68e40698d0 0x7f68e406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f7405804700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f740008a300 0x7f7400155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f7405804700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74000b8ed0 0x7f7400152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f7405804700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74000b9340 0x7f74001ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f7405804700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74001f0720 con 0x7f74000b8ed0 2023-03-08T15:49:45.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f7405804700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74001f0980 con 0x7f740008a300 2023-03-08T15:49:45.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f7405804700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74001f0c60 con 0x7f74000b9340 2023-03-08T15:49:45.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f73fe7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74000b8ed0 0x7f7400152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f73fe7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74000b8ed0 0x7f7400152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53884/0 (socket says 172.21.15.123:53884) 2023-03-08T15:49:45.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f73fe7fc700 1 -- 172.21.15.123:0/706841559 learned_addr learned my addr 172.21.15.123:0/706841559 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f73feffd700 1 --2- 172.21.15.123:0/706841559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f740008a300 0x7f7400155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f73ff7fe700 1 --2- 172.21.15.123:0/706841559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74000b9340 0x7f74001ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.669 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f5b7fcd1700 1 -- 172.21.15.123:0/1049535212 shutdown_connections 2023-03-08T15:49:45.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f5b7fcd1700 1 --2- 172.21.15.123:0/1049535212 >> v2:172.21.15.175:3300/0 conn(0x7f5b78140520 0x7f5b78140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f5b7fcd1700 1 --2- 172.21.15.123:0/1049535212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b78146ad0 0x7f5b78146f30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f5b7fcd1700 1 -- 172.21.15.123:0/1049535212 >> 172.21.15.123:0/1049535212 conn(0x7f5b7806a250 msgr2=0x7f5b7806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f5b7fcd1700 1 -- 172.21.15.123:0/1049535212 shutdown_connections 2023-03-08T15:49:45.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f806ed1e700 1 Processor -- start 2023-03-08T15:49:45.670 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f806ed1e700 1 -- start start 2023-03-08T15:49:45.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f5b7fcd1700 1 -- 172.21.15.123:0/1049535212 wait complete. 2023-03-08T15:49:45.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f73fe7fc700 1 -- 172.21.15.123:0/706841559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74000b9340 msgr2=0x7f74001ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f73fe7fc700 1 --2- 172.21.15.123:0/706841559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74000b9340 0x7f74001ed140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f73fe7fc700 1 -- 172.21.15.123:0/706841559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f740008a300 msgr2=0x7f7400155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f73fe7fc700 1 --2- 172.21.15.123:0/706841559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f740008a300 0x7f7400155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f73fe7fc700 1 -- 172.21.15.123:0/706841559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f8008b20 con 0x7f74000b8ed0 2023-03-08T15:49:45.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.640+0000 7f959f1a9700 1 -- start start 2023-03-08T15:49:45.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f959f1a9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95980b7d70 0x7f959813c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f959f1a9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95980b9080 0x7f95980b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f959f1a9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9598144a60 0x7f95981e3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f959f1a9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9598148730 con 0x7f95980b7d70 2023-03-08T15:49:45.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f959f1a9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959813cef0 con 0x7f95980b9080 2023-03-08T15:49:45.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f959f1a9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9598149d10 con 0x7f9598144a60 2023-03-08T15:49:45.673 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f9597fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95980b9080 0x7f95980b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f959d746700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9598144a60 0x7f95981e3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f9597fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95980b9080 0x7f95980b5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:34760/0 (socket says 172.21.15.123:34760) 2023-03-08T15:49:45.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f9597fff700 1 -- 172.21.15.123:0/2421493951 learned_addr learned my addr 172.21.15.123:0/2421493951 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f806ed1e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8068148240 0x7f8068152e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f806ed1e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80680b4ec0 con 0x7f80680baa70 2023-03-08T15:49:45.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f806ed1e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80680b6f60 con 0x7f80680b4a70 2023-03-08T15:49:45.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f806ed1e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80680b9ec0 con 0x7f8068148240 2023-03-08T15:49:45.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f73fe7fc700 1 --2- 172.21.15.123:0/706841559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74000b8ed0 0x7f7400152db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f73f400c650 tx=0x7f73f400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f806caba700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f80680baa70 0x7f80680b97b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49738/0 (socket says 172.21.15.123:49738) 2023-03-08T15:49:45.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f8067fff700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f80680b4a70 0x7f8068147b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.123:38828/0 (socket says 172.21.15.123:38828) 2023-03-08T15:49:45.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f806caba700 1 -- 172.21.15.123:0/3441315891 learned_addr learned my addr 172.21.15.123:0/3441315891 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:45.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f806d2bb700 1 --2- 172.21.15.123:0/3441315891 >> v2:172.21.15.175:3300/0 conn(0x7f8068148240 0x7f8068152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f6903fff700 1 --2- 172.21.15.123:0/2642890736 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f68e40698d0 0x7f68e406bd80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f68ec000c00 tx=0x7f68ec008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.641+0000 7f959cf45700 1 --2- 172.21.15.123:0/2421493951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95980b7d70 0x7f959813c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.642+0000 7fbf34385700 1 Processor -- start 2023-03-08T15:49:45.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.642+0000 7f9597fff700 1 -- 172.21.15.123:0/2421493951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9598144a60 msgr2=0x7f95981e3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.642+0000 7f9597fff700 1 --2- 172.21.15.123:0/2421493951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9598144a60 0x7f95981e3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.642+0000 7f9597fff700 1 -- 172.21.15.123:0/2421493951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95980b7d70 msgr2=0x7f959813c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.642+0000 7f9597fff700 1 --2- 172.21.15.123:0/2421493951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95980b7d70 0x7f959813c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.642+0000 7f9597fff700 1 -- 172.21.15.123:0/2421493951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c009550 con 0x7f95980b9080 2023-03-08T15:49:45.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.642+0000 7f806d2bb700 1 -- 172.21.15.123:0/3441315891 >> v1:172.21.15.175:6789/0 conn(0x7f80680b4a70 legacy=0x7f8068147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.642+0000 7f806d2bb700 1 -- 172.21.15.123:0/3441315891 >> v1:172.21.15.123:6789/0 conn(0x7f80680baa70 legacy=0x7f80680b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.642+0000 7f806d2bb700 1 -- 172.21.15.123:0/3441315891 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80680b5650 con 0x7f8068148240 2023-03-08T15:49:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.642+0000 7fbf34385700 1 -- start start 2023-03-08T15:49:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.642+0000 7f9597fff700 1 --2- 172.21.15.123:0/2421493951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95980b9080 0x7f95980b5920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f958400c4e0 tx=0x7f958400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.642+0000 7f806d2bb700 1 --2- 172.21.15.123:0/3441315891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8068148240 0x7f8068152e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8060009d90 tx=0x7f806000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f3f540f50549976 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.642+0000 7f5b7fcd1700 1 Processor -- start 2023-03-08T15:49:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.642+0000 7f5b7fcd1700 1 -- start start 2023-03-08T15:49:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7fbf34385700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbf2c0b9170 0x7fbf2c0b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7fbf34385700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbf2c146ad0 0x7fbf2c146f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7fbf34385700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2c0b47d0 con 0x7fbf2c140520 2023-03-08T15:49:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7fbf34385700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2c147470 con 0x7fbf2c146ad0 2023-03-08T15:49:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7fbf34385700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2c0b4a70 con 0x7fbf2c0b9170 2023-03-08T15:49:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7fbf31920700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbf2c146ad0 0x7fbf2c146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7fbf31920700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbf2c146ad0 0x7fbf2c146f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53894/0 (socket says 172.21.15.123:53894) 2023-03-08T15:49:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7fbf31920700 1 -- 172.21.15.123:0/3184778594 learned_addr learned my addr 172.21.15.123:0/3184778594 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7fbf32121700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbf2c0b9170 0x7fbf2c0b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7f5b7fcd1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b780b9170 0x7f5b780bba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7f5b7fcd1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b78140520 0x7f5b781deb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7f5b7fcd1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b78146ad0 0x7f5b7813e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7f5b7fcd1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7813f900 con 0x7f5b780b9170 2023-03-08T15:49:45.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7f5b7fcd1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780bbf50 con 0x7f5b78140520 2023-03-08T15:49:45.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7f5b7fcd1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78147de0 con 0x7f5b78146ad0 2023-03-08T15:49:45.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7f5b7da6d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b780b9170 0x7f5b780bba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7fbf31920700 1 -- 172.21.15.123:0/3184778594 >> v2:172.21.15.175:3300/0 conn(0x7fbf2c0b9170 msgr2=0x7fbf2c0b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7fbf31920700 1 --2- 172.21.15.123:0/3184778594 >> v2:172.21.15.175:3300/0 conn(0x7fbf2c0b9170 0x7fbf2c0b86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7fbf31920700 1 -- 172.21.15.123:0/3184778594 >> v1:172.21.15.175:6789/0 conn(0x7fbf2c140520 legacy=0x7fbf2c140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7f5b7da6d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b780b9170 0x7f5b780bba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53896/0 (socket says 172.21.15.123:53896) 2023-03-08T15:49:45.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7f5b7da6d700 1 -- 172.21.15.123:0/1088950006 learned_addr learned my addr 172.21.15.123:0/1088950006 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.643+0000 7fbf31920700 1 -- 172.21.15.123:0/3184778594 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c0b4d50 con 0x7fbf2c146ad0 2023-03-08T15:49:45.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f5b7e26e700 1 --2- 172.21.15.123:0/1088950006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b78146ad0 0x7f5b7813e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7fbf31920700 1 --2- 172.21.15.123:0/3184778594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf2c146ad0 0x7fbf2c146f30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0b8400 tx=0x7fbf1c0094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50faa2d329c663a7 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f5b7d26c700 1 --2- 172.21.15.123:0/1088950006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b78140520 0x7f5b781deb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f5b7e26e700 1 -- 172.21.15.123:0/1088950006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b78140520 msgr2=0x7f5b781deb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f5b7e26e700 1 --2- 172.21.15.123:0/1088950006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b78140520 0x7f5b781deb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f5b7e26e700 1 -- 172.21.15.123:0/1088950006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b780b9170 msgr2=0x7f5b780bba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f5b7e26e700 1 --2- 172.21.15.123:0/1088950006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b780b9170 0x7f5b780bba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f5b7e26e700 1 -- 172.21.15.123:0/1088950006 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b70005e80 con 0x7f5b78146ad0 2023-03-08T15:49:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f5b7da6d700 1 --2- 172.21.15.123:0/1088950006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b780b9170 0x7f5b780bba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f80677fe700 1 -- 172.21.15.123:0/3441315891 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806000e070 con 0x7f8068148240 2023-03-08T15:49:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f95957fa700 1 -- 172.21.15.123:0/2421493951 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95840052d0 con 0x7f95980b9080 2023-03-08T15:49:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f95957fa700 1 -- 172.21.15.123:0/2421493951 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9584005430 con 0x7f95980b9080 2023-03-08T15:49:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f95957fa700 1 -- 172.21.15.123:0/2421493951 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95840038c0 con 0x7f95980b9080 2023-03-08T15:49:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f959f1a9700 1 -- 172.21.15.123:0/2421493951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9598144e30 con 0x7f95980b9080 2023-03-08T15:49:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f959f1a9700 1 -- 172.21.15.123:0/2421493951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9598071180 con 0x7f95980b9080 2023-03-08T15:49:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.645+0000 7f959f1a9700 1 -- 172.21.15.123:0/2421493951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9598071460 con 0x7f95980b9080 2023-03-08T15:49:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f5b7e26e700 1 --2- 172.21.15.123:0/1088950006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b78146ad0 0x7f5b7813e7b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400e840 tx=0x7f5b7400eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f5b6e7fc700 1 -- 172.21.15.123:0/1088950006 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74013680 con 0x7f5b78146ad0 2023-03-08T15:49:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f5b6e7fc700 1 -- 172.21.15.123:0/1088950006 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b740137e0 con 0x7f5b78146ad0 2023-03-08T15:49:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f5b7fcd1700 1 -- 172.21.15.123:0/1088950006 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b780b5310 con 0x7f5b78146ad0 2023-03-08T15:49:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f5b6e7fc700 1 -- 172.21.15.123:0/1088950006 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74013b70 con 0x7f5b78146ad0 2023-03-08T15:49:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f5b7fcd1700 1 -- 172.21.15.123:0/1088950006 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b780b5030 con 0x7f5b78146ad0 2023-03-08T15:49:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f80677fe700 1 -- 172.21.15.123:0/3441315891 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806000bbd0 con 0x7f8068148240 2023-03-08T15:49:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.644+0000 7f80677fe700 1 -- 172.21.15.123:0/3441315891 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060012430 con 0x7f8068148240 2023-03-08T15:49:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.645+0000 7f806ed1e700 1 -- 172.21.15.123:0/3441315891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8068148240 msgr2=0x7f8068152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.645+0000 7f806ed1e700 1 --2- 172.21.15.123:0/3441315891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8068148240 0x7f8068152e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8060009d90 tx=0x7f806000b330 comp rx=0 tx=0).stop 2023-03-08T15:49:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.645+0000 7f806ed1e700 1 -- 172.21.15.123:0/3441315891 shutdown_connections 2023-03-08T15:49:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.645+0000 7f806ed1e700 1 --2- 172.21.15.123:0/3441315891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8068148240 0x7f8068152e80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.645+0000 7f806ed1e700 1 -- 172.21.15.123:0/3441315891 >> 172.21.15.123:0/3441315891 conn(0x7f80680be2d0 msgr2=0x7f80680ba0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.645+0000 7f806ed1e700 1 -- 172.21.15.123:0/3441315891 shutdown_connections 2023-03-08T15:49:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.645+0000 7f806ed1e700 1 -- 172.21.15.123:0/3441315891 wait complete. 2023-03-08T15:49:45.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.646+0000 7f95957fa700 1 -- 172.21.15.123:0/2421493951 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f9584019030 con 0x7f95980b9080 2023-03-08T15:49:45.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.646+0000 7f95957fa700 1 --2- 172.21.15.123:0/2421493951 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f957c0698d0 0x7f957c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.646+0000 7f806ed1e700 1 Processor -- start 2023-03-08T15:49:45.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.647+0000 7f5b6e7fc700 1 -- 172.21.15.123:0/1088950006 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f5b74019030 con 0x7f5b78146ad0 2023-03-08T15:49:45.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.647+0000 7f806ed1e700 1 -- start start 2023-03-08T15:49:45.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.647+0000 7fa4f2ffd700 1 -- 172.21.15.123:0/1876122411 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fa4f8053200 con 0x7fa504148f10 2023-03-08T15:49:45.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.647+0000 7f73e7fff700 1 -- 172.21.15.123:0/706841559 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f40054e0 con 0x7f74000b8ed0 2023-03-08T15:49:45.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.647+0000 7f73e7fff700 1 -- 172.21.15.123:0/706841559 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f4003680 con 0x7f74000b8ed0 2023-03-08T15:49:45.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.647+0000 7f73e7fff700 1 -- 172.21.15.123:0/706841559 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f4003a30 con 0x7f74000b8ed0 2023-03-08T15:49:45.693 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.647+0000 7f5b6e7fc700 1 --2- 172.21.15.123:0/1088950006 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5b5c0698d0 0x7f5b5c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.647+0000 7f5b6e7fc700 1 -- 172.21.15.123:0/1088950006 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b74087440 con 0x7f5b78146ad0 2023-03-08T15:49:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.647+0000 7f6900ff9700 1 -- 172.21.15.123:0/2642890736 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f68fc053600 con 0x7f69040b47e0 2023-03-08T15:49:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.647+0000 7f7405804700 1 -- 172.21.15.123:0/706841559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74000b3ca0 con 0x7f74000b8ed0 2023-03-08T15:49:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.646+0000 7f95957fa700 1 -- 172.21.15.123:0/2421493951 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95840868a0 con 0x7f95980b9080 2023-03-08T15:49:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.646+0000 7f959cf45700 1 --2- 172.21.15.123:0/2421493951 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f957c0698d0 0x7f957c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f7405804700 1 -- 172.21.15.123:0/706841559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74000b60c0 con 0x7f74000b8ed0 2023-03-08T15:49:45.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f806ed1e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80680b4a70 0x7f80681ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f806ed1e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80680baa70 0x7f80681e9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f806ed1e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8068148240 0x7f80681ea360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f806ed1e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806815a0d0 con 0x7f8068148240 2023-03-08T15:49:45.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f806ed1e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80681ecd80 con 0x7f80680baa70 2023-03-08T15:49:45.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f806ed1e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80681ed060 con 0x7f80680b4a70 2023-03-08T15:49:45.696 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f806caba700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80680b4a70 0x7f80681ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f806caba700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80680b4a70 0x7f80681ed4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:58032/0 (socket says 172.21.15.123:58032) 2023-03-08T15:49:45.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f806caba700 1 -- 172.21.15.123:0/129516704 learned_addr learned my addr 172.21.15.123:0/129516704 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f806caba700 1 -- 172.21.15.123:0/129516704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80680baa70 msgr2=0x7f80681e9e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-08T15:49:45.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f806caba700 1 --2- 172.21.15.123:0/129516704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80680baa70 0x7f80681e9e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f806caba700 1 -- 172.21.15.123:0/129516704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8068148240 msgr2=0x7f80681ea360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-08T15:49:45.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f806caba700 1 --2- 172.21.15.123:0/129516704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8068148240 0x7f80681ea360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f806caba700 1 -- 172.21.15.123:0/129516704 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8060009a70 con 0x7f80680b4a70 2023-03-08T15:49:45.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.648+0000 7f806caba700 1 --2- 172.21.15.123:0/129516704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80680b4a70 0x7f80681ed4f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f805400c530 tx=0x7f805400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.649+0000 7f80657fa700 1 -- 172.21.15.123:0/129516704 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054005d70 con 0x7f80680b4a70 2023-03-08T15:49:45.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.649+0000 7f80657fa700 1 -- 172.21.15.123:0/129516704 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80540070d0 con 0x7f80680b4a70 2023-03-08T15:49:45.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.649+0000 7f80657fa700 1 -- 172.21.15.123:0/129516704 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054007460 con 0x7f80680b4a70 2023-03-08T15:49:45.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.649+0000 7f5b7da6d700 1 --2- 172.21.15.123:0/1088950006 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5b5c0698d0 0x7f5b5c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.649+0000 7f7405804700 1 -- 172.21.15.123:0/706841559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74000b5040 con 0x7f74000b8ed0 2023-03-08T15:49:45.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.649+0000 7fbf3111f700 1 -- 172.21.15.123:0/3184778594 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c00f940 con 0x7fbf2c146ad0 2023-03-08T15:49:45.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.649+0000 7fbf3111f700 1 -- 172.21.15.123:0/3184778594 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c00faa0 con 0x7fbf2c146ad0 2023-03-08T15:49:45.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.649+0000 7fbf3111f700 1 -- 172.21.15.123:0/3184778594 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c00fe10 con 0x7fbf2c146ad0 2023-03-08T15:49:45.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.649+0000 7f5b7da6d700 1 --2- 172.21.15.123:0/1088950006 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5b5c0698d0 0x7f5b5c06bd80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b68001d10 tx=0x7f5b68009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.650+0000 7fbf34385700 1 -- 172.21.15.123:0/3184778594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf2c146ad0 msgr2=0x7fbf2c146f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.650+0000 7fbf34385700 1 --2- 172.21.15.123:0/3184778594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf2c146ad0 0x7fbf2c146f30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0b8400 tx=0x7fbf1c0094c0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.649+0000 7f806ed1e700 1 -- 172.21.15.123:0/129516704 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80680b5c10 con 0x7f80680b4a70 2023-03-08T15:49:45.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.649+0000 7f806ed1e700 1 -- 172.21.15.123:0/129516704 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80680b5930 con 0x7f80680b4a70 2023-03-08T15:49:45.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.651+0000 7f959cf45700 1 --2- 172.21.15.123:0/2421493951 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f957c0698d0 0x7f957c06bd80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f958c014040 tx=0x7f958c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.651+0000 7f806ed1e700 1 -- 172.21.15.123:0/129516704 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80480052e0 con 0x7f80680b4a70 2023-03-08T15:49:45.702 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.652+0000 7f73e7fff700 1 -- 172.21.15.123:0/706841559 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f73f4019030 con 0x7f74000b8ed0 2023-03-08T15:49:45.702 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.652+0000 7fbf34385700 1 -- 172.21.15.123:0/3184778594 shutdown_connections 2023-03-08T15:49:45.702 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.652+0000 7fbf34385700 1 --2- 172.21.15.123:0/3184778594 >> v2:172.21.15.175:3300/0 conn(0x7fbf2c0b9170 0x7fbf2c0b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.702 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.652+0000 7fbf34385700 1 --2- 172.21.15.123:0/3184778594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf2c146ad0 0x7fbf2c146f30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.703 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.652+0000 7fbf34385700 1 -- 172.21.15.123:0/3184778594 >> 172.21.15.123:0/3184778594 conn(0x7fbf2c06a250 msgr2=0x7fbf2c06a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.703 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.652+0000 7fbf34385700 1 -- 172.21.15.123:0/3184778594 shutdown_connections 2023-03-08T15:49:45.703 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.652+0000 7fbf34385700 1 -- 172.21.15.123:0/3184778594 wait complete. 2023-03-08T15:49:45.703 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.652+0000 7fc9c3d39700 1 Processor -- start 2023-03-08T15:49:45.704 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.652+0000 7f73e7fff700 1 --2- 172.21.15.123:0/706841559 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f73ec0699a0 0x7f73ec06be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.704 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.652+0000 7f73e7fff700 1 -- 172.21.15.123:0/706841559 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73f4086a30 con 0x7f74000b8ed0 2023-03-08T15:49:45.704 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.652+0000 7f80657fa700 1 -- 172.21.15.123:0/129516704 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f8054019030 con 0x7f80680b4a70 2023-03-08T15:49:45.704 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.652+0000 7f5b7fcd1700 1 -- 172.21.15.123:0/1088950006 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b780b9540 con 0x7f5b78146ad0 2023-03-08T15:49:45.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.653+0000 7f80657fa700 1 --2- 172.21.15.123:0/129516704 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f804c0698d0 0x7f804c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.653+0000 7f80657fa700 1 -- 172.21.15.123:0/129516704 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8054086d80 con 0x7f80680b4a70 2023-03-08T15:49:45.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.652+0000 7fc9c3d39700 1 -- start start 2023-03-08T15:49:45.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.653+0000 7fc9c3d39700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9bc0baa70 0x7fc9bc0b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.653+0000 7fc9c3d39700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc9bc0b9c00 0x7fc9bc151e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.653+0000 7fc9c3d39700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc0b6f60 con 0x7fc9bc0b97b0 2023-03-08T15:49:45.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.654+0000 7fc9c3d39700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc0b5650 con 0x7fc9bc0b9c00 2023-03-08T15:49:45.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.654+0000 7fc9c3d39700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0b5930 con 0x7fc9bc0baa70 2023-03-08T15:49:45.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.654+0000 7fbf34385700 1 Processor -- start 2023-03-08T15:49:45.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.654+0000 7fc9c1ad5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9bc0baa70 0x7fc9bc0b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.654+0000 7fc9c1ad5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9bc0baa70 0x7fc9bc0b4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:58046/0 (socket says 172.21.15.123:58046) 2023-03-08T15:49:45.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.654+0000 7f8067fff700 1 --2- 172.21.15.123:0/129516704 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f804c0698d0 0x7f804c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.654+0000 7fbf34385700 1 -- start start 2023-03-08T15:49:45.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.654+0000 7fc9c1ad5700 1 -- 172.21.15.123:0/80918408 learned_addr learned my addr 172.21.15.123:0/80918408 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.654+0000 7f73feffd700 1 --2- 172.21.15.123:0/706841559 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f73ec0699a0 0x7f73ec06be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.654+0000 7f8067fff700 1 --2- 172.21.15.123:0/129516704 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f804c0698d0 0x7f804c06bd80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f80681567f0 tx=0x7f805c007a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.654+0000 7f73feffd700 1 --2- 172.21.15.123:0/706841559 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f73ec0699a0 0x7f73ec06be50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f73f000be80 tx=0x7f73f000b420 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fc9c22d6700 1 --2- 172.21.15.123:0/80918408 >> v2:172.21.15.175:3300/0 conn(0x7fc9bc0b9c00 0x7fc9bc151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fbf34385700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0b9170 0x7fbf2c070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fbf34385700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf2c140520 0x7fbf2c1db9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fbf34385700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf2c146ad0 0x7fbf2c149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fbf34385700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c1df9f0 con 0x7fbf2c146ad0 2023-03-08T15:49:45.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fbf34385700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c1486c0 con 0x7fbf2c140520 2023-03-08T15:49:45.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fbf34385700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c1dfe10 con 0x7fbf2c0b9170 2023-03-08T15:49:45.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fc9c22d6700 1 -- 172.21.15.123:0/80918408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9bc0baa70 msgr2=0x7fc9bc0b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:45.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fc9c22d6700 1 --2- 172.21.15.123:0/80918408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9bc0baa70 0x7fc9bc0b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fc9c22d6700 1 -- 172.21.15.123:0/80918408 >> v1:172.21.15.123:6789/0 conn(0x7fc9bc0b97b0 legacy=0x7fc9bc147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fc9c22d6700 1 -- 172.21.15.123:0/80918408 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc0b5c10 con 0x7fc9bc0b9c00 2023-03-08T15:49:45.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fbf32922700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf2c146ad0 0x7fbf2c149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fbf32922700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf2c146ad0 0x7fbf2c149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53912/0 (socket says 172.21.15.123:53912) 2023-03-08T15:49:45.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fbf32922700 1 -- 172.21.15.123:0/2947204303 learned_addr learned my addr 172.21.15.123:0/2947204303 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fc9c22d6700 1 --2- 172.21.15.123:0/80918408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9bc0b9c00 0x7fc9bc151e70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009840 tx=0x7fc9ac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3ede7b9405d37d server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fc9c0ad3700 1 -- 172.21.15.123:0/80918408 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac011830 con 0x7fc9bc0b9c00 2023-03-08T15:49:45.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fc9c0ad3700 1 -- 172.21.15.123:0/80918408 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac011990 con 0x7fc9bc0b9c00 2023-03-08T15:49:45.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fc9c0ad3700 1 -- 172.21.15.123:0/80918408 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac011d20 con 0x7fc9bc0b9c00 2023-03-08T15:49:45.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fbf32922700 1 -- 172.21.15.123:0/2947204303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0b9170 msgr2=0x7fbf2c070720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-08T15:49:45.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fbf32922700 1 --2- 172.21.15.123:0/2947204303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0b9170 0x7fbf2c070720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fbf32922700 1 -- 172.21.15.123:0/2947204303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf2c140520 msgr2=0x7fbf2c1db9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fbf32922700 1 --2- 172.21.15.123:0/2947204303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf2c140520 0x7fbf2c1db9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.655+0000 7fbf32922700 1 -- 172.21.15.123:0/2947204303 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c009de0 con 0x7fbf2c146ad0 2023-03-08T15:49:45.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.656+0000 7fbf32922700 1 --2- 172.21.15.123:0/2947204303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf2c146ad0 0x7fbf2c149df0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c500 tx=0x7fbf2800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.656+0000 7f95957fa700 1 -- 172.21.15.123:0/2421493951 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f9584052670 con 0x7f95980b9080 2023-03-08T15:49:45.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.656+0000 7fc9c3d39700 1 -- 172.21.15.123:0/80918408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9bc0b9c00 msgr2=0x7fc9bc151e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.656+0000 7fc9c3d39700 1 --2- 172.21.15.123:0/80918408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9bc0b9c00 0x7fc9bc151e70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009840 tx=0x7fc9ac009b50 comp rx=0 tx=0).stop 2023-03-08T15:49:45.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.656+0000 7fc9c3d39700 1 -- 172.21.15.123:0/80918408 shutdown_connections 2023-03-08T15:49:45.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.656+0000 7fc9c3d39700 1 --2- 172.21.15.123:0/80918408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9bc0b9c00 0x7fc9bc151e70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.656+0000 7fc9c3d39700 1 --2- 172.21.15.123:0/80918408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9bc0baa70 0x7fc9bc0b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.656+0000 7fc9c3d39700 1 -- 172.21.15.123:0/80918408 >> 172.21.15.123:0/80918408 conn(0x7fc9bc0be2d0 msgr2=0x7fc9bc0ba0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:45.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.656+0000 7fc9c3d39700 1 -- 172.21.15.123:0/80918408 shutdown_connections 2023-03-08T15:49:45.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.656+0000 7fc9c3d39700 1 -- 172.21.15.123:0/80918408 wait complete. 2023-03-08T15:49:45.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.656+0000 7f80657fa700 1 -- 172.21.15.123:0/129516704 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f8054052bf0 con 0x7f80680b4a70 2023-03-08T15:49:45.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.658+0000 7fc9c3d39700 1 Processor -- start 2023-03-08T15:49:45.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.659+0000 7fbf22ffd700 1 -- 172.21.15.123:0/2947204303 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf280052d0 con 0x7fbf2c146ad0 2023-03-08T15:49:45.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.659+0000 7f73e7fff700 1 -- 172.21.15.123:0/706841559 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f73f4052790 con 0x7f74000b8ed0 2023-03-08T15:49:45.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.658+0000 7fc9c3d39700 1 -- start start 2023-03-08T15:49:45.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.659+0000 7fc9c3d39700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9bc0b97b0 0x7fc9bc0a9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.659+0000 7fc9c3d39700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9bc0b9c00 0x7fc9bc0afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.659+0000 7fc9c3d39700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9bc0baa70 0x7fc9bc0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.659+0000 7fc9c3d39700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0ab1a0 con 0x7fc9bc0baa70 2023-03-08T15:49:45.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.659+0000 7fc9c3d39700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0b3530 con 0x7fc9bc0b97b0 2023-03-08T15:49:45.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.659+0000 7fc9c3d39700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0ab410 con 0x7fc9bc0b9c00 2023-03-08T15:49:45.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.659+0000 7fc9c1ad5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9bc0b97b0 0x7fc9bc0a9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.659+0000 7fc9c12d4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9bc0b9c00 0x7fc9bc0afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.659+0000 7fc9c1ad5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9bc0b97b0 0x7fc9bc0a9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:34818/0 (socket says 172.21.15.123:34818) 2023-03-08T15:49:45.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.659+0000 7fc9c12d4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9bc0b9c00 0x7fc9bc0afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:58068/0 (socket says 172.21.15.123:58068) 2023-03-08T15:49:45.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.659+0000 7fc9c1ad5700 1 -- 172.21.15.123:0/4279384795 learned_addr learned my addr 172.21.15.123:0/4279384795 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:45.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.660+0000 7fc9c1ad5700 1 -- 172.21.15.123:0/4279384795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9bc0b9c00 msgr2=0x7fc9bc0afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.660+0000 7fc9c1ad5700 1 --2- 172.21.15.123:0/4279384795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9bc0b9c00 0x7fc9bc0afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.660+0000 7fc9c1ad5700 1 -- 172.21.15.123:0/4279384795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9bc0baa70 msgr2=0x7fc9bc0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:45.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.660+0000 7fc9c1ad5700 1 --2- 172.21.15.123:0/4279384795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9bc0baa70 0x7fc9bc0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:45.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.660+0000 7fc9c1ad5700 1 -- 172.21.15.123:0/4279384795 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac0094a0 con 0x7fc9bc0b97b0 2023-03-08T15:49:45.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.660+0000 7fc9c12d4700 1 --2- 172.21.15.123:0/4279384795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9bc0b9c00 0x7fc9bc0afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:45.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.659+0000 7fbf22ffd700 1 -- 172.21.15.123:0/2947204303 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf28005430 con 0x7fbf2c146ad0 2023-03-08T15:49:45.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.659+0000 7fbf22ffd700 1 -- 172.21.15.123:0/2947204303 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28003880 con 0x7fbf2c146ad0 2023-03-08T15:49:45.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.660+0000 7fc9c1ad5700 1 --2- 172.21.15.123:0/4279384795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9bc0b97b0 0x7fc9bc0a9b90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800daa0 tx=0x7fc9b800ddb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.660+0000 7fbf34385700 1 -- 172.21.15.123:0/2947204303 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2c0b5310 con 0x7fbf2c146ad0 2023-03-08T15:49:45.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.660+0000 7fbf34385700 1 -- 172.21.15.123:0/2947204303 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2c0b5030 con 0x7fbf2c146ad0 2023-03-08T15:49:45.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.661+0000 7f5b6e7fc700 1 -- 172.21.15.123:0/1088950006 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f5b74053180 con 0x7f5b78146ad0 2023-03-08T15:49:45.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.661+0000 7fc9b27fc700 1 -- 172.21.15.123:0/4279384795 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800a970 con 0x7fc9bc0b97b0 2023-03-08T15:49:45.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.661+0000 7fc9b27fc700 1 -- 172.21.15.123:0/4279384795 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b800aad0 con 0x7fc9bc0b97b0 2023-03-08T15:49:45.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.661+0000 7fc9b27fc700 1 -- 172.21.15.123:0/4279384795 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800ae60 con 0x7fc9bc0b97b0 2023-03-08T15:49:45.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.663+0000 7fbf22ffd700 1 -- 172.21.15.123:0/2947204303 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fbf28019030 con 0x7fbf2c146ad0 2023-03-08T15:49:45.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.663+0000 7fbf22ffd700 1 --2- 172.21.15.123:0/2947204303 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fbf100698d0 0x7fbf1006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.663+0000 7fbf22ffd700 1 -- 172.21.15.123:0/2947204303 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf28086810 con 0x7fbf2c146ad0 2023-03-08T15:49:45.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.664+0000 7fbf32121700 1 --2- 172.21.15.123:0/2947204303 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fbf100698d0 0x7fbf1006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.664+0000 7fbf32121700 1 --2- 172.21.15.123:0/2947204303 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fbf100698d0 0x7fbf1006bd80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400e190 tx=0x7fbf2400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.665+0000 7fc9c3d39700 1 -- 172.21.15.123:0/4279384795 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc0bae40 con 0x7fc9bc0b97b0 2023-03-08T15:49:45.725 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.665+0000 7fc9c3d39700 1 -- 172.21.15.123:0/4279384795 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc0b5ef0 con 0x7fc9bc0b97b0 2023-03-08T15:49:45.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.667+0000 7fc9b27fc700 1 -- 172.21.15.123:0/4279384795 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fc9b8010470 con 0x7fc9bc0b97b0 2023-03-08T15:49:45.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.667+0000 7fc9b27fc700 1 --2- 172.21.15.123:0/4279384795 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc9a0069920 0x7fc9a006bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:45.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.667+0000 7fc9b27fc700 1 -- 172.21.15.123:0/4279384795 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9b8087ad0 con 0x7fc9bc0b97b0 2023-03-08T15:49:45.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.668+0000 7fbf34385700 1 -- 172.21.15.123:0/2947204303 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2c0b8bf0 con 0x7fbf2c146ad0 2023-03-08T15:49:45.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.671+0000 7fc9c12d4700 1 --2- 172.21.15.123:0/4279384795 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc9a0069920 0x7fc9a006bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:45.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.671+0000 7fc9c12d4700 1 --2- 172.21.15.123:0/4279384795 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc9a0069920 0x7fc9a006bdd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0b88e0 tx=0x7fc9b4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:45.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.682+0000 7fc9c3d39700 1 -- 172.21.15.123:0/4279384795 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc147640 con 0x7fc9bc0b97b0 2023-03-08T15:49:45.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.683+0000 7fbf22ffd700 1 -- 172.21.15.123:0/2947204303 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fbf2804c150 con 0x7fbf2c146ad0 2023-03-08T15:49:45.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:45.692+0000 7fc9b27fc700 1 -- 172.21.15.123:0/4279384795 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fc9b80572f0 con 0x7fc9bc0b97b0 2023-03-08T15:49:46.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.014+0000 7f690a61a700 1 -- 172.21.15.123:0/2642890736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f68e8005590 con 0x7f69040b47e0 2023-03-08T15:49:46.031 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2023-03-08T15:49:46.033 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.027+0000 7f6900ff9700 1 -- 172.21.15.123:0/2642890736 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f68fc056c20 con 0x7f69040b47e0 2023-03-08T15:49:46.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.034+0000 7f959f1a9700 1 -- 172.21.15.123:0/2421493951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f95980744c0 con 0x7f95980b9080 2023-03-08T15:49:46.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.035+0000 7f690a61a700 1 -- 172.21.15.123:0/2642890736 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f68e40698d0 msgr2=0x7f68e406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.035+0000 7f690a61a700 1 --2- 172.21.15.123:0/2642890736 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f68e40698d0 0x7f68e406bd80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f68ec000c00 tx=0x7f68ec008030 comp rx=0 tx=0).stop 2023-03-08T15:49:46.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.035+0000 7f690a61a700 1 -- 172.21.15.123:0/2642890736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69040b47e0 msgr2=0x7f6904138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.035+0000 7f690a61a700 1 --2- 172.21.15.123:0/2642890736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69040b47e0 0x7f6904138880 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00e9b0 tx=0x7f68fc00ecc0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.035+0000 7f690a61a700 1 -- 172.21.15.123:0/2642890736 shutdown_connections 2023-03-08T15:49:46.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.035+0000 7f690a61a700 1 --2- 172.21.15.123:0/2642890736 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f68e40698d0 0x7f68e406bd80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.035+0000 7f690a61a700 1 --2- 172.21.15.123:0/2642890736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69040b6500 0x7f690414b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.037 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.035+0000 7f690a61a700 1 --2- 172.21.15.123:0/2642890736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f690406aee0 0x7f690406ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.035+0000 7f690a61a700 1 --2- 172.21.15.123:0/2642890736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69040b47e0 0x7f6904138880 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.035+0000 7f690a61a700 1 -- 172.21.15.123:0/2642890736 >> 172.21.15.123:0/2642890736 conn(0x7f69040bc480 msgr2=0x7f690414d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:46.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.035+0000 7f95957fa700 1 -- 172.21.15.123:0/2421493951 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9584017090 con 0x7f95980b9080 2023-03-08T15:49:46.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.035+0000 7f690a61a700 1 -- 172.21.15.123:0/2642890736 shutdown_connections 2023-03-08T15:49:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.035+0000 7f690a61a700 1 -- 172.21.15.123:0/2642890736 wait complete. 2023-03-08T15:49:46.040 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2023-03-08T15:49:46.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.047+0000 7fa508c1e700 1 -- 172.21.15.123:0/1876122411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa5040744c0 con 0x7fa504148f10 2023-03-08T15:49:46.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.047+0000 7fa4f2ffd700 1 -- 172.21.15.123:0/1876122411 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4f8056820 con 0x7fa504148f10 2023-03-08T15:49:46.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.040+0000 7f959f1a9700 1 -- 172.21.15.123:0/2421493951 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f957c0698d0 msgr2=0x7f957c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.040+0000 7f959f1a9700 1 --2- 172.21.15.123:0/2421493951 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f957c0698d0 0x7f957c06bd80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f958c014040 tx=0x7f958c008030 comp rx=0 tx=0).stop 2023-03-08T15:49:46.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.040+0000 7f959f1a9700 1 -- 172.21.15.123:0/2421493951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95980b9080 msgr2=0x7f95980b5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.050 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.040+0000 7f959f1a9700 1 --2- 172.21.15.123:0/2421493951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95980b9080 0x7f95980b5920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f958400c4e0 tx=0x7f958400c7f0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.050 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2023-03-08T15:49:46.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.050+0000 7f959f1a9700 1 -- 172.21.15.123:0/2421493951 shutdown_connections 2023-03-08T15:49:46.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.050+0000 7f959f1a9700 1 --2- 172.21.15.123:0/2421493951 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f957c0698d0 0x7f957c06bd80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.050+0000 7f959f1a9700 1 --2- 172.21.15.123:0/2421493951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9598144a60 0x7f95981e3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.050+0000 7f959f1a9700 1 --2- 172.21.15.123:0/2421493951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95980b7d70 0x7f959813c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.050+0000 7f959f1a9700 1 --2- 172.21.15.123:0/2421493951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95980b9080 0x7f95980b5920 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.050+0000 7f959f1a9700 1 -- 172.21.15.123:0/2421493951 >> 172.21.15.123:0/2421493951 conn(0x7f95980b9800 msgr2=0x7f959813f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:46.053 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2023-03-08T15:49:46.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.049+0000 7f806ed1e700 1 -- 172.21.15.123:0/129516704 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8048005860 con 0x7f80680b4a70 2023-03-08T15:49:46.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.050+0000 7f80657fa700 1 -- 172.21.15.123:0/129516704 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8054017090 con 0x7f80680b4a70 2023-03-08T15:49:46.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.051+0000 7f959f1a9700 1 -- 172.21.15.123:0/2421493951 shutdown_connections 2023-03-08T15:49:46.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.051+0000 7fa508c1e700 1 -- 172.21.15.123:0/1876122411 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4e4069920 msgr2=0x7fa4e406bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.051+0000 7fa508c1e700 1 --2- 172.21.15.123:0/1876122411 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4e4069920 0x7fa4e406bdd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4001600 tx=0x7fa4f4007a20 comp rx=0 tx=0).stop 2023-03-08T15:49:46.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.051+0000 7fa508c1e700 1 -- 172.21.15.123:0/1876122411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa504148f10 msgr2=0x7fa5041f0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.054 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.051+0000 7fa508c1e700 1 --2- 172.21.15.123:0/1876122411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa504148f10 0x7fa5041f0620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800e800 tx=0x7fa4f800ebc0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.051+0000 7fa508c1e700 1 -- 172.21.15.123:0/1876122411 shutdown_connections 2023-03-08T15:49:46.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.051+0000 7fa508c1e700 1 --2- 172.21.15.123:0/1876122411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa504148f10 0x7fa5041f0620 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.051+0000 7fa508c1e700 1 --2- 172.21.15.123:0/1876122411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa50406fa10 0x7fa50414bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.051+0000 7fa508c1e700 1 --2- 172.21.15.123:0/1876122411 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4e4069920 0x7fa4e406bdd0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4001600 tx=0x7fa4f4007a20 comp rx=0 tx=0).stop 2023-03-08T15:49:46.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.051+0000 7fa508c1e700 1 --2- 172.21.15.123:0/1876122411 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa504071660 0x7fa50414afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.051+0000 7fa508c1e700 1 -- 172.21.15.123:0/1876122411 >> 172.21.15.123:0/1876122411 conn(0x7fa50406b360 msgr2=0x7fa504147a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:46.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.051+0000 7f959f1a9700 1 -- 172.21.15.123:0/2421493951 wait complete. 2023-03-08T15:49:46.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.052+0000 7fa508c1e700 1 -- 172.21.15.123:0/1876122411 shutdown_connections 2023-03-08T15:49:46.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.052+0000 7fa508c1e700 1 -- 172.21.15.123:0/1876122411 wait complete. 2023-03-08T15:49:46.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2023-03-08T15:49:46.057 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.056+0000 7f5b7fcd1700 1 -- 172.21.15.123:0/1088950006 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5b78072a30 con 0x7f5b78146ad0 2023-03-08T15:49:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.057+0000 7f5b6e7fc700 1 -- 172.21.15.123:0/1088950006 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b74021030 con 0x7f5b78146ad0 2023-03-08T15:49:46.058 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2023-03-08T15:49:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.058+0000 7f806ed1e700 1 -- 172.21.15.123:0/129516704 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f804c0698d0 msgr2=0x7f804c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.058+0000 7f806ed1e700 1 --2- 172.21.15.123:0/129516704 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f804c0698d0 0x7f804c06bd80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f80681567f0 tx=0x7f805c007a50 comp rx=0 tx=0).stop 2023-03-08T15:49:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.058+0000 7f806ed1e700 1 -- 172.21.15.123:0/129516704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80680b4a70 msgr2=0x7f80681ed4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.058+0000 7f806ed1e700 1 --2- 172.21.15.123:0/129516704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80680b4a70 0x7f80681ed4f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f805400c530 tx=0x7f805400c8f0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.059+0000 7f806ed1e700 1 -- 172.21.15.123:0/129516704 shutdown_connections 2023-03-08T15:49:46.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.059+0000 7f806ed1e700 1 --2- 172.21.15.123:0/129516704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8068148240 0x7f80681ea360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.059+0000 7f806ed1e700 1 --2- 172.21.15.123:0/129516704 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f804c0698d0 0x7f804c06bd80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.059+0000 7f806ed1e700 1 --2- 172.21.15.123:0/129516704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80680b4a70 0x7f80681ed4f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.059+0000 7f806ed1e700 1 --2- 172.21.15.123:0/129516704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80680baa70 0x7f80681e9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.059+0000 7f806ed1e700 1 -- 172.21.15.123:0/129516704 >> 172.21.15.123:0/129516704 conn(0x7f80680be2d0 msgr2=0x7f80680bbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:46.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.059+0000 7f806ed1e700 1 -- 172.21.15.123:0/129516704 shutdown_connections 2023-03-08T15:49:46.061 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.059+0000 7f806ed1e700 1 -- 172.21.15.123:0/129516704 wait complete. 2023-03-08T15:49:46.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.065+0000 7f5b7fcd1700 1 -- 172.21.15.123:0/1088950006 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5b5c0698d0 msgr2=0x7f5b5c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.065+0000 7f5b7fcd1700 1 --2- 172.21.15.123:0/1088950006 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5b5c0698d0 0x7f5b5c06bd80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b68001d10 tx=0x7f5b68009040 comp rx=0 tx=0).stop 2023-03-08T15:49:46.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.065+0000 7f5b7fcd1700 1 -- 172.21.15.123:0/1088950006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b78146ad0 msgr2=0x7f5b7813e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.065+0000 7f5b7fcd1700 1 --2- 172.21.15.123:0/1088950006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b78146ad0 0x7f5b7813e7b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400e840 tx=0x7f5b7400eb50 comp rx=0 tx=0).stop 2023-03-08T15:49:46.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.065+0000 7f5b7fcd1700 1 -- 172.21.15.123:0/1088950006 shutdown_connections 2023-03-08T15:49:46.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.065+0000 7f5b7fcd1700 1 --2- 172.21.15.123:0/1088950006 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5b5c0698d0 0x7f5b5c06bd80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.065+0000 7f5b7fcd1700 1 --2- 172.21.15.123:0/1088950006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b78146ad0 0x7f5b7813e7b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.065+0000 7f5b7fcd1700 1 --2- 172.21.15.123:0/1088950006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b780b9170 0x7f5b780bba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.065+0000 7f5b7fcd1700 1 --2- 172.21.15.123:0/1088950006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b78140520 0x7f5b781deb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.065+0000 7f5b7fcd1700 1 -- 172.21.15.123:0/1088950006 >> 172.21.15.123:0/1088950006 conn(0x7f5b7806a250 msgr2=0x7f5b781cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:46.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.065+0000 7f5b7fcd1700 1 -- 172.21.15.123:0/1088950006 shutdown_connections 2023-03-08T15:49:46.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.065+0000 7fbf34385700 1 -- 172.21.15.123:0/2947204303 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbf2c072a30 con 0x7fbf2c146ad0 2023-03-08T15:49:46.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.065+0000 7f5b7fcd1700 1 -- 172.21.15.123:0/1088950006 wait complete. 2023-03-08T15:49:46.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.067+0000 7fbf22ffd700 1 -- 172.21.15.123:0/2947204303 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf28017030 con 0x7fbf2c146ad0 2023-03-08T15:49:46.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.069+0000 7f7405804700 1 -- 172.21.15.123:0/706841559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f74000744c0 con 0x7f74000b8ed0 2023-03-08T15:49:46.070 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.069+0000 7f73e7fff700 1 -- 172.21.15.123:0/706841559 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f73f4017090 con 0x7f74000b8ed0 2023-03-08T15:49:46.071 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2023-03-08T15:49:46.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.070+0000 7fc9c3d39700 1 -- 172.21.15.123:0/4279384795 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc9bc0744c0 con 0x7fc9bc0b97b0 2023-03-08T15:49:46.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.070+0000 7fc9b27fc700 1 -- 172.21.15.123:0/4279384795 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc9b8056e80 con 0x7fc9bc0b97b0 2023-03-08T15:49:46.072 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2023-03-08T15:49:46.072 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2023-03-08T15:49:46.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-03-08T15:49:46.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.073+0000 7f7405804700 1 -- 172.21.15.123:0/706841559 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f73ec0699a0 msgr2=0x7f73ec06be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.073+0000 7f7405804700 1 --2- 172.21.15.123:0/706841559 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f73ec0699a0 0x7f73ec06be50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f73f000be80 tx=0x7f73f000b420 comp rx=0 tx=0).stop 2023-03-08T15:49:46.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.073+0000 7f7405804700 1 -- 172.21.15.123:0/706841559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74000b8ed0 msgr2=0x7f7400152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.073+0000 7f7405804700 1 --2- 172.21.15.123:0/706841559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74000b8ed0 0x7f7400152db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f73f400c650 tx=0x7f73f400c960 comp rx=0 tx=0).stop 2023-03-08T15:49:46.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fc9c3d39700 1 -- 172.21.15.123:0/4279384795 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc9a0069920 msgr2=0x7fc9a006bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fc9c3d39700 1 --2- 172.21.15.123:0/4279384795 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc9a0069920 0x7fc9a006bdd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0b88e0 tx=0x7fc9b4009040 comp rx=0 tx=0).stop 2023-03-08T15:49:46.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fc9c3d39700 1 -- 172.21.15.123:0/4279384795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9bc0b97b0 msgr2=0x7fc9bc0a9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fc9c3d39700 1 --2- 172.21.15.123:0/4279384795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9bc0b97b0 0x7fc9bc0a9b90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800daa0 tx=0x7fc9b800ddb0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fbf34385700 1 -- 172.21.15.123:0/2947204303 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fbf100698d0 msgr2=0x7fbf1006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fbf34385700 1 --2- 172.21.15.123:0/2947204303 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fbf100698d0 0x7fbf1006bd80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400e190 tx=0x7fbf2400b040 comp rx=0 tx=0).stop 2023-03-08T15:49:46.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fbf34385700 1 -- 172.21.15.123:0/2947204303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf2c146ad0 msgr2=0x7fbf2c149df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:46.077 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fbf34385700 1 --2- 172.21.15.123:0/2947204303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf2c146ad0 0x7fbf2c149df0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c500 tx=0x7fbf2800c8c0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fbf34385700 1 -- 172.21.15.123:0/2947204303 shutdown_connections 2023-03-08T15:49:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fbf34385700 1 --2- 172.21.15.123:0/2947204303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf2c146ad0 0x7fbf2c149df0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fbf34385700 1 --2- 172.21.15.123:0/2947204303 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fbf100698d0 0x7fbf1006bd80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fbf34385700 1 --2- 172.21.15.123:0/2947204303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0b9170 0x7fbf2c070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fbf34385700 1 --2- 172.21.15.123:0/2947204303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf2c140520 0x7fbf2c1db9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2023-03-08T15:49:46.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fbf34385700 1 -- 172.21.15.123:0/2947204303 >> 172.21.15.123:0/2947204303 conn(0x7fbf2c06a250 msgr2=0x7fbf2c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:46.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fbf34385700 1 -- 172.21.15.123:0/2947204303 shutdown_connections 2023-03-08T15:49:46.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.074+0000 7fbf34385700 1 -- 172.21.15.123:0/2947204303 wait complete. 2023-03-08T15:49:46.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7fc9c3d39700 1 -- 172.21.15.123:0/4279384795 shutdown_connections 2023-03-08T15:49:46.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7fc9c3d39700 1 --2- 172.21.15.123:0/4279384795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9bc0baa70 0x7fc9bc0b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7f7405804700 1 -- 172.21.15.123:0/706841559 shutdown_connections 2023-03-08T15:49:46.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7f7405804700 1 --2- 172.21.15.123:0/706841559 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f73ec0699a0 0x7f73ec06be50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7f7405804700 1 --2- 172.21.15.123:0/706841559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74000b9340 0x7f74001ed140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7f7405804700 1 --2- 172.21.15.123:0/706841559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f740008a300 0x7f7400155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7fc9c3d39700 1 --2- 172.21.15.123:0/4279384795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9bc0b97b0 0x7fc9bc0a9b90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7fc9c3d39700 1 --2- 172.21.15.123:0/4279384795 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc9a0069920 0x7fc9a006bdd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7fc9c3d39700 1 --2- 172.21.15.123:0/4279384795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9bc0b9c00 0x7fc9bc0afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7fc9c3d39700 1 -- 172.21.15.123:0/4279384795 >> 172.21.15.123:0/4279384795 conn(0x7fc9bc0be2d0 msgr2=0x7fc9bc146b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:46.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7f7405804700 1 --2- 172.21.15.123:0/706841559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74000b8ed0 0x7f7400152db0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:46.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7f7405804700 1 -- 172.21.15.123:0/706841559 >> 172.21.15.123:0/706841559 conn(0x7f740006a250 msgr2=0x7f740015a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:46.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7fc9c3d39700 1 -- 172.21.15.123:0/4279384795 shutdown_connections 2023-03-08T15:49:46.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7f7405804700 1 -- 172.21.15.123:0/706841559 shutdown_connections 2023-03-08T15:49:46.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7f7405804700 1 -- 172.21.15.123:0/706841559 wait complete. 2023-03-08T15:49:46.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:46.075+0000 7fc9c3d39700 1 -- 172.21.15.123:0/4279384795 wait complete. 2023-03-08T15:49:46.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2023-03-08T15:49:46.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-03-08T15:49:46.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-03-08T15:49:46.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-03-08T15:49:46.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-03-08T15:49:47.059 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-03-08T15:49:47.074 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-03-08T15:49:47.080 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-03-08T15:49:47.084 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-03-08T15:49:47.090 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-03-08T15:49:47.093 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-03-08T15:49:47.093 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-03-08T15:49:47.096 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-03-08T15:49:47.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.247+0000 7f06e8194700 1 Processor -- start 2023-03-08T15:49:47.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.248+0000 7f06e8194700 1 -- start start 2023-03-08T15:49:47.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.249+0000 7f06e8194700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f06e008a300 0x7f06e00b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.249+0000 7f06e8194700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06e00b8ed0 0x7f06e00b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.249+0000 7f06e8194700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e00b85f0 con 0x7f06e00b4e70 2023-03-08T15:49:47.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.249+0000 7f06e8194700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e008a6d0 con 0x7f06e008a300 2023-03-08T15:49:47.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.249+0000 7f06e8194700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00b8890 con 0x7f06e00b8ed0 2023-03-08T15:49:47.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.249+0000 7f06e572f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06e00b8ed0 0x7f06e00b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.249+0000 7f06e6731700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f06e00b4e70 0x7f06e00b6e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.123:38718/0 (socket says 172.21.15.123:38718) 2023-03-08T15:49:47.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.249+0000 7f06e6731700 1 -- 172.21.15.123:0/168152032 learned_addr learned my addr 172.21.15.123:0/168152032 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:47.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.250+0000 7f06e5f30700 1 --2- 172.21.15.123:0/168152032 >> v2:172.21.15.123:3300/0 conn(0x7f06e008a300 0x7f06e00b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.250+0000 7f06e5f30700 1 -- 172.21.15.123:0/168152032 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06e00b8ed0 msgr2=0x7f06e00b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:47.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.250+0000 7f06e5f30700 1 --2- 172.21.15.123:0/168152032 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06e00b8ed0 0x7f06e00b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.250+0000 7f06e5f30700 1 -- 172.21.15.123:0/168152032 >> v1:172.21.15.175:6789/0 conn(0x7f06e00b4e70 legacy=0x7f06e00b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.250+0000 7f06e5f30700 1 -- 172.21.15.123:0/168152032 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e00b8b70 con 0x7f06e008a300 2023-03-08T15:49:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.250+0000 7f06e5f30700 1 --2- 172.21.15.123:0/168152032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e008a300 0x7f06e00b64e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009840 tx=0x7f06d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa28624479f94809 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.251+0000 7f06e4f2e700 1 -- 172.21.15.123:0/168152032 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0004230 con 0x7f06e008a300 2023-03-08T15:49:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.251+0000 7f06e4f2e700 1 -- 172.21.15.123:0/168152032 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d0004390 con 0x7f06e008a300 2023-03-08T15:49:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.251+0000 7f06e4f2e700 1 -- 172.21.15.123:0/168152032 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d00036a0 con 0x7f06e008a300 2023-03-08T15:49:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.252+0000 7f06e8194700 1 -- 172.21.15.123:0/168152032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e008a300 msgr2=0x7f06e00b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.252+0000 7f06e8194700 1 --2- 172.21.15.123:0/168152032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e008a300 0x7f06e00b64e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009840 tx=0x7f06d0009b50 comp rx=0 tx=0).stop 2023-03-08T15:49:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.253+0000 7f06e8194700 1 -- 172.21.15.123:0/168152032 shutdown_connections 2023-03-08T15:49:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.253+0000 7f06e8194700 1 --2- 172.21.15.123:0/168152032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e008a300 0x7f06e00b64e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.253+0000 7f06e8194700 1 --2- 172.21.15.123:0/168152032 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06e00b8ed0 0x7f06e00b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.253+0000 7f06e8194700 1 -- 172.21.15.123:0/168152032 >> 172.21.15.123:0/168152032 conn(0x7f06e006a250 msgr2=0x7f06e006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.253+0000 7f06e8194700 1 -- 172.21.15.123:0/168152032 shutdown_connections 2023-03-08T15:49:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.253+0000 7f06e8194700 1 -- 172.21.15.123:0/168152032 wait complete. 2023-03-08T15:49:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.255+0000 7f06e8194700 1 Processor -- start 2023-03-08T15:49:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.255+0000 7f06e8194700 1 -- start start 2023-03-08T15:49:47.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.256+0000 7f06e8194700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06e008a300 0x7f06e01f0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.256+0000 7f06e8194700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06e00b4e70 0x7f06e01f0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.256+0000 7f06e8194700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e00b8ed0 0x7f06e00a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.256+0000 7f06e8194700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00a87b0 con 0x7f06e00b8ed0 2023-03-08T15:49:47.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.256+0000 7f06e8194700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e01f07b0 con 0x7f06e00b4e70 2023-03-08T15:49:47.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.256+0000 7f06e8194700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00a8a90 con 0x7f06e008a300 2023-03-08T15:49:47.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.256+0000 7f06e6731700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e00b8ed0 0x7f06e00a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.256+0000 7f06e6731700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e00b8ed0 0x7f06e00a8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36726/0 (socket says 172.21.15.123:36726) 2023-03-08T15:49:47.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.256+0000 7f06e6731700 1 -- 172.21.15.123:0/2633266578 learned_addr learned my addr 172.21.15.123:0/2633266578 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:47.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.257+0000 7f06e6731700 1 -- 172.21.15.123:0/2633266578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06e008a300 msgr2=0x7f06e01f0270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-08T15:49:47.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.257+0000 7f06e6731700 1 --2- 172.21.15.123:0/2633266578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06e008a300 0x7f06e01f0270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.257+0000 7f06e6731700 1 -- 172.21.15.123:0/2633266578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06e00b4e70 msgr2=0x7f06e01f0980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-08T15:49:47.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.257+0000 7f06e6731700 1 --2- 172.21.15.123:0/2633266578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06e00b4e70 0x7f06e01f0980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.257+0000 7f06e6731700 1 -- 172.21.15.123:0/2633266578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d00094a0 con 0x7f06e00b8ed0 2023-03-08T15:49:47.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.257+0000 7f06e6731700 1 --2- 172.21.15.123:0/2633266578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e00b8ed0 0x7f06e00a8ff0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f06d800cb20 tx=0x7f06d800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.258+0000 7f06d67fc700 1 -- 172.21.15.123:0/2633266578 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d800a8c0 con 0x7f06e00b8ed0 2023-03-08T15:49:47.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.258+0000 7f06d67fc700 1 -- 172.21.15.123:0/2633266578 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d800aa40 con 0x7f06e00b8ed0 2023-03-08T15:49:47.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.258+0000 7f06d67fc700 1 -- 172.21.15.123:0/2633266578 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d800adf0 con 0x7f06e00b8ed0 2023-03-08T15:49:47.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.258+0000 7f06e8194700 1 -- 172.21.15.123:0/2633266578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e00b3ca0 con 0x7f06e00b8ed0 2023-03-08T15:49:47.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.258+0000 7f06e8194700 1 -- 172.21.15.123:0/2633266578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e00b6100 con 0x7f06e00b8ed0 2023-03-08T15:49:47.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.261+0000 7f06d67fc700 1 -- 172.21.15.123:0/2633266578 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f06d8023410 con 0x7f06e00b8ed0 2023-03-08T15:49:47.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.261+0000 7f06d67fc700 1 --2- 172.21.15.123:0/2633266578 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f06c40699a0 0x7f06c406be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.261+0000 7f06d67fc700 1 -- 172.21.15.123:0/2633266578 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06d80989b0 con 0x7f06e00b8ed0 2023-03-08T15:49:47.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.266+0000 7f06e8194700 1 -- 172.21.15.123:0/2633266578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c80052e0 con 0x7f06e00b8ed0 2023-03-08T15:49:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.268+0000 7f06e5f30700 1 --2- 172.21.15.123:0/2633266578 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f06c40699a0 0x7f06c406be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.276+0000 7f06d67fc700 1 -- 172.21.15.123:0/2633266578 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f06d80646b0 con 0x7f06e00b8ed0 2023-03-08T15:49:47.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.279+0000 7f06e5f30700 1 --2- 172.21.15.123:0/2633266578 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f06c40699a0 0x7f06c406be50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06d0000c00 tx=0x7f06d0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.312+0000 7f6809d21700 1 Processor -- start 2023-03-08T15:49:47.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.312+0000 7f6809d21700 1 -- start start 2023-03-08T15:49:47.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.313+0000 7f6809d21700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68040b9170 0x7f68040b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.313+0000 7f6809d21700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6804140520 0x7f6804140930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.313+0000 7f6809d21700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68040b47d0 con 0x7f6804146ad0 2023-03-08T15:49:47.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.313+0000 7f6809d21700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68040b4a70 con 0x7f6804140520 2023-03-08T15:49:47.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.313+0000 7f6809d21700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68040b4d50 con 0x7f68040b9170 2023-03-08T15:49:47.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.314+0000 7f68037fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68040b9170 0x7f68040b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.314+0000 7f68037fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68040b9170 0x7f68040b86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:49964/0 (socket says 172.21.15.123:49964) 2023-03-08T15:49:47.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.314+0000 7f68037fe700 1 -- 172.21.15.123:0/349314635 learned_addr learned my addr 172.21.15.123:0/349314635 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:47.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.314+0000 7f6803fff700 1 --2- 172.21.15.123:0/349314635 >> v2:172.21.15.123:3300/0 conn(0x7f6804140520 0x7f6804140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.314+0000 7f6803fff700 1 -- 172.21.15.123:0/349314635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68040b9170 msgr2=0x7f68040b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:47.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.314+0000 7f6803fff700 1 --2- 172.21.15.123:0/349314635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68040b9170 0x7f68040b86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.314+0000 7f6803fff700 1 -- 172.21.15.123:0/349314635 >> v1:172.21.15.123:6789/0 conn(0x7f6804146ad0 legacy=0x7f6804146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.314+0000 7f6803fff700 1 -- 172.21.15.123:0/349314635 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040b5030 con 0x7f6804140520 2023-03-08T15:49:47.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.314+0000 7f6803fff700 1 --2- 172.21.15.123:0/349314635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6804140520 0x7f6804140930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f67f800bad0 tx=0x7f67f800bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d4481c8e442b54 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.315+0000 7f68027fc700 1 -- 172.21.15.123:0/349314635 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f8006d10 con 0x7f6804140520 2023-03-08T15:49:47.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.315+0000 7f68027fc700 1 -- 172.21.15.123:0/349314635 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f8006e70 con 0x7f6804140520 2023-03-08T15:49:47.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.315+0000 7f68027fc700 1 -- 172.21.15.123:0/349314635 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f800dc80 con 0x7f6804140520 2023-03-08T15:49:47.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.316+0000 7f6809d21700 1 -- 172.21.15.123:0/349314635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6804140520 msgr2=0x7f6804140930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.316+0000 7f6809d21700 1 --2- 172.21.15.123:0/349314635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6804140520 0x7f6804140930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f67f800bad0 tx=0x7f67f800bde0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.316+0000 7f5ed619e700 1 Processor -- start 2023-03-08T15:49:47.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.317+0000 7f5ed619e700 1 -- start start 2023-03-08T15:49:47.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.317+0000 7efed7942700 1 Processor -- start 2023-03-08T15:49:47.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7f6809d21700 1 -- 172.21.15.123:0/349314635 shutdown_connections 2023-03-08T15:49:47.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7f6809d21700 1 --2- 172.21.15.123:0/349314635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6804140520 0x7f6804140930 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7f6809d21700 1 --2- 172.21.15.123:0/349314635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68040b9170 0x7f68040b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7f6809d21700 1 -- 172.21.15.123:0/349314635 >> 172.21.15.123:0/349314635 conn(0x7f680406a250 msgr2=0x7f680406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7f5ed619e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5ed0140d50 0x7f5ed00b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7f5ed619e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ed0147590 0x7f5ed00b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7f5ed619e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed00b7170 con 0x7f5ed00b3920 2023-03-08T15:49:47.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7f5ed619e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed00b5c50 con 0x7f5ed0140d50 2023-03-08T15:49:47.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7f5ed619e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00b53d0 con 0x7f5ed0147590 2023-03-08T15:49:47.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7f835d922700 1 Processor -- start 2023-03-08T15:49:47.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7fe47cf99700 1 Processor -- start 2023-03-08T15:49:47.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7f5ed599d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5ed00b3920 0x7f5ed0149e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33552/0 (socket says 172.21.15.123:33552) 2023-03-08T15:49:47.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7f5ed599d700 1 -- 172.21.15.123:0/2459078538 learned_addr learned my addr 172.21.15.123:0/2459078538 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:47.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ed519c700 1 --2- 172.21.15.123:0/2459078538 >> v2:172.21.15.175:3300/0 conn(0x7f5ed0140d50 0x7f5ed00b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ed499b700 1 --2- 172.21.15.123:0/2459078538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ed0147590 0x7f5ed00b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7fe47cf99700 1 -- start start 2023-03-08T15:49:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7f835d922700 1 -- start start 2023-03-08T15:49:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f835d922700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f83580b9170 0x7f83580b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f835d922700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8358140520 0x7f8358140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f835d922700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83580b47d0 con 0x7f8358146ad0 2023-03-08T15:49:47.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f835d922700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83580b4a70 con 0x7f83580b9170 2023-03-08T15:49:47.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f835d922700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83580b4d50 con 0x7f8358140520 2023-03-08T15:49:47.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.318+0000 7efed7942700 1 -- start start 2023-03-08T15:49:47.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7efed7942700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed00b47e0 0x7efed014f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7efed7942700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efed00b6500 0x7efed014f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7efed7942700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed00b4010 con 0x7efed006aee0 2023-03-08T15:49:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7efed7942700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed00b3e00 con 0x7efed00b6500 2023-03-08T15:49:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7efed7942700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed014ec70 con 0x7efed00b47e0 2023-03-08T15:49:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7efed5edf700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efed00b6500 0x7efed014f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7efed5edf700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efed00b6500 0x7efed014f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:36958/0 (socket says 172.21.15.123:36958) 2023-03-08T15:49:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7efed5edf700 1 -- 172.21.15.123:0/2947188032 learned_addr learned my addr 172.21.15.123:0/2947188032 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:47.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 -- 172.21.15.123:0/2459078538 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670927148 0 0) 0x7f5ed00b7170 con 0x7f5ed00b3920 2023-03-08T15:49:47.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 -- 172.21.15.123:0/2459078538 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ebc0035b0 con 0x7f5ed00b3920 2023-03-08T15:49:47.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 -- 172.21.15.123:0/2459078538 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3349615863 0 0) 0x7f5ebc0035b0 con 0x7f5ed00b3920 2023-03-08T15:49:47.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 -- 172.21.15.123:0/2459078538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ed0147590 msgr2=0x7f5ed00b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:47.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 --2- 172.21.15.123:0/2459078538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ed0147590 0x7f5ed00b6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 -- 172.21.15.123:0/2459078538 >> v2:172.21.15.175:3300/0 conn(0x7f5ed0140d50 msgr2=0x7f5ed00b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:47.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 --2- 172.21.15.123:0/2459078538 >> v2:172.21.15.175:3300/0 conn(0x7f5ed0140d50 0x7f5ed00b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 -- 172.21.15.123:0/2459078538 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0146ab0 con 0x7f5ed00b3920 2023-03-08T15:49:47.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 -- 172.21.15.123:0/2459078538 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f5ec80019f0 con 0x7f5ed00b3920 2023-03-08T15:49:47.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 -- 172.21.15.123:0/2459078538 >> v1:172.21.15.123:6789/0 conn(0x7f5ed00b3920 legacy=0x7f5ed0149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 --2- 172.21.15.123:0/2459078538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ebc003a00 0x7f5ebc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 --2- 172.21.15.123:0/2459078538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ebc0043e0 0x7f5ebc0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 --2- 172.21.15.123:0/2459078538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc004fc0 0x7f5ebc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.327 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 -- 172.21.15.123:0/2459078538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00b5c50 con 0x7f5ebc004fc0 2023-03-08T15:49:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 -- 172.21.15.123:0/2459078538 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00b53d0 con 0x7f5ebc0043e0 2023-03-08T15:49:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.319+0000 7f5ec7fff700 1 -- 172.21.15.123:0/2459078538 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc00bf50 con 0x7f5ebc003a00 2023-03-08T15:49:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7f6809d21700 1 -- 172.21.15.123:0/349314635 shutdown_connections 2023-03-08T15:49:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7f5ed499b700 1 --2- 172.21.15.123:0/2459078538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ebc0043e0 0x7f5ebc0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7f5ed519c700 1 --2- 172.21.15.123:0/2459078538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ebc003a00 0x7f5ebc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7f83577fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8358140520 0x7f8358140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7efed5edf700 1 -- 172.21.15.123:0/2947188032 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed00b47e0 msgr2=0x7efed014f190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-08T15:49:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7efed5edf700 1 --2- 172.21.15.123:0/2947188032 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed00b47e0 0x7efed014f190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7efed5edf700 1 -- 172.21.15.123:0/2947188032 >> v1:172.21.15.123:6789/0 conn(0x7efed006aee0 legacy=0x7efed0152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7efed5edf700 1 -- 172.21.15.123:0/2947188032 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed0149250 con 0x7efed00b6500 2023-03-08T15:49:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7fe47cf99700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe478148f10 0x7fe4780b9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7fe47cf99700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe478071660 0x7fe478071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7fe47cf99700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47806a960 con 0x7fe47806fa10 2023-03-08T15:49:47.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7fe47cf99700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4781492e0 con 0x7fe478148f10 2023-03-08T15:49:47.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7fe47cf99700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780b9040 con 0x7fe478071660 2023-03-08T15:49:47.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7fe476d9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe478071660 0x7fe478071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7f83577fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8358140520 0x7f8358140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:36962/0 (socket says 172.21.15.123:36962) 2023-03-08T15:49:47.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7f83577fe700 1 -- 172.21.15.123:0/2736364076 learned_addr learned my addr 172.21.15.123:0/2736364076 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:47.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7f5ed499b700 1 -- 172.21.15.123:0/2459078538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ebc003a00 msgr2=0x7f5ebc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:47.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7f5ed499b700 1 --2- 172.21.15.123:0/2459078538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ebc003a00 0x7f5ebc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7f5ed499b700 1 -- 172.21.15.123:0/2459078538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc004fc0 msgr2=0x7f5ebc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:47.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7f5ed499b700 1 --2- 172.21.15.123:0/2459078538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc004fc0 0x7f5ebc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7f5ed499b700 1 -- 172.21.15.123:0/2459078538 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0146ab0 con 0x7f5ebc0043e0 2023-03-08T15:49:47.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7efed5edf700 1 --2- 172.21.15.123:0/2947188032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed00b6500 0x7efed014f6d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efecc0098f0 tx=0x7efecc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b52a64450f98b64 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.321+0000 7f8356ffd700 1 --2- 172.21.15.123:0/2736364076 >> v2:172.21.15.123:3300/0 conn(0x7f83580b9170 0x7f83580b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.321+0000 7fe476d9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe478071660 0x7fe478071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:49984/0 (socket says 172.21.15.123:49984) 2023-03-08T15:49:47.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.321+0000 7fe476d9d700 1 -- 172.21.15.123:0/845642596 learned_addr learned my addr 172.21.15.123:0/845642596 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:47.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.321+0000 7f83577fe700 1 -- 172.21.15.123:0/2736364076 >> v2:172.21.15.123:3300/0 conn(0x7f83580b9170 msgr2=0x7f83580b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:47.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.321+0000 7f83577fe700 1 --2- 172.21.15.123:0/2736364076 >> v2:172.21.15.123:3300/0 conn(0x7f83580b9170 0x7f83580b86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.321+0000 7f83577fe700 1 -- 172.21.15.123:0/2736364076 >> v1:172.21.15.123:6789/0 conn(0x7f8358146ad0 legacy=0x7f8358146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.321+0000 7f83577fe700 1 -- 172.21.15.123:0/2736364076 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83580b5030 con 0x7f8358140520 2023-03-08T15:49:47.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.321+0000 7fe476d9d700 1 -- 172.21.15.123:0/845642596 >> v2:172.21.15.123:3300/0 conn(0x7fe478148f10 msgr2=0x7fe4780b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:47.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.321+0000 7fe476d9d700 1 --2- 172.21.15.123:0/845642596 >> v2:172.21.15.123:3300/0 conn(0x7fe478148f10 0x7fe4780b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.321+0000 7fe476d9d700 1 -- 172.21.15.123:0/845642596 >> v1:172.21.15.175:6789/0 conn(0x7fe47806fa10 legacy=0x7fe47806a250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-08T15:49:47.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.321+0000 7fe476d9d700 1 -- 172.21.15.123:0/845642596 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47806ff30 con 0x7fe478071660 2023-03-08T15:49:47.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.320+0000 7f6809d21700 1 -- 172.21.15.123:0/349314635 wait complete. 2023-03-08T15:49:47.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7f6809d21700 1 Processor -- start 2023-03-08T15:49:47.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.321+0000 7efec7fff700 1 -- 172.21.15.123:0/2947188032 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc004230 con 0x7efed00b6500 2023-03-08T15:49:47.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.321+0000 7efec7fff700 1 -- 172.21.15.123:0/2947188032 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc004390 con 0x7efed00b6500 2023-03-08T15:49:47.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.321+0000 7efec7fff700 1 -- 172.21.15.123:0/2947188032 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc0036a0 con 0x7efed00b6500 2023-03-08T15:49:47.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7efed7942700 1 -- 172.21.15.123:0/2947188032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed00b6500 msgr2=0x7efed014f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7efed7942700 1 --2- 172.21.15.123:0/2947188032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed00b6500 0x7efed014f6d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efecc0098f0 tx=0x7efecc009c00 comp rx=0 tx=0).stop 2023-03-08T15:49:47.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7fe476d9d700 1 --2- 172.21.15.123:0/845642596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe478071660 0x7fe478071b00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe470009e50 tx=0x7fe47000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b5c3abe1ab8d449 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7efed7942700 1 -- 172.21.15.123:0/2947188032 shutdown_connections 2023-03-08T15:49:47.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7efed7942700 1 --2- 172.21.15.123:0/2947188032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed00b6500 0x7efed014f6d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7efed7942700 1 --2- 172.21.15.123:0/2947188032 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed00b47e0 0x7efed014f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7efed7942700 1 -- 172.21.15.123:0/2947188032 >> 172.21.15.123:0/2947188032 conn(0x7efed00bc480 msgr2=0x7efed00bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.321+0000 7f5ed499b700 1 --2- 172.21.15.123:0/2459078538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ebc0043e0 0x7f5ebc0048b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ed006cbc0 tx=0x7f5ebc005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1efe27ca03d43fd5 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7f5ec7fff700 1 -- 172.21.15.123:0/2459078538 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0107b0 con 0x7f5ebc0043e0 2023-03-08T15:49:47.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7f83577fe700 1 --2- 172.21.15.123:0/2736364076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8358140520 0x7f8358140940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f834c0092e0 tx=0x7f834c0095f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbd4c6bd2d373923 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7f5ec7fff700 1 -- 172.21.15.123:0/2459078538 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc010910 con 0x7f5ebc0043e0 2023-03-08T15:49:47.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7f5ec7fff700 1 -- 172.21.15.123:0/2459078538 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc010ca0 con 0x7f5ebc0043e0 2023-03-08T15:49:47.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7fe47559a700 1 -- 172.21.15.123:0/845642596 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47000e070 con 0x7fe478071660 2023-03-08T15:49:47.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7f8355ffb700 1 -- 172.21.15.123:0/2736364076 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c00c970 con 0x7f8358140520 2023-03-08T15:49:47.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7efed7942700 1 -- 172.21.15.123:0/2947188032 shutdown_connections 2023-03-08T15:49:47.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7fe47559a700 1 -- 172.21.15.123:0/845642596 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe470003a20 con 0x7fe478071660 2023-03-08T15:49:47.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7fe47559a700 1 -- 172.21.15.123:0/845642596 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470003dd0 con 0x7fe478071660 2023-03-08T15:49:47.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f5ed619e700 1 -- 172.21.15.123:0/2459078538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ebc0043e0 msgr2=0x7f5ebc0048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f5ed619e700 1 --2- 172.21.15.123:0/2459078538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ebc0043e0 0x7f5ebc0048b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ed006cbc0 tx=0x7f5ebc005880 comp rx=0 tx=0).stop 2023-03-08T15:49:47.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f5ed599d700 1 -- 172.21.15.123:0/2459078538 reap_dead start 2023-03-08T15:49:47.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f5ed619e700 1 -- 172.21.15.123:0/2459078538 shutdown_connections 2023-03-08T15:49:47.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f5ed619e700 1 -- 172.21.15.123:0/2459078538 >> 172.21.15.123:0/2459078538 conn(0x7f5ed006a250 msgr2=0x7f5ed006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7f6809d21700 1 -- start start 2023-03-08T15:49:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f6809d21700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68040b9170 0x7f68040703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f6809d21700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6804140520 0x7f68041ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f6809d21700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6804146ad0 0x7f68041ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f6809d21700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68041481d0 con 0x7f68040b9170 2023-03-08T15:49:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f6809d21700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6804070e50 con 0x7f6804146ad0 2023-03-08T15:49:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f6809d21700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680406ea20 con 0x7f6804140520 2023-03-08T15:49:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f68037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68040b9170 0x7f68040703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f68037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68040b9170 0x7f68040703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36786/0 (socket says 172.21.15.123:36786) 2023-03-08T15:49:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f68037fe700 1 -- 172.21.15.123:0/3802253404 learned_addr learned my addr 172.21.15.123:0/3802253404 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f6803fff700 1 --2- 172.21.15.123:0/3802253404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6804146ad0 0x7f68041ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f6802ffd700 1 --2- 172.21.15.123:0/3802253404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6804140520 0x7f68041ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7efed7942700 1 -- 172.21.15.123:0/2947188032 wait complete. 2023-03-08T15:49:47.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7f5ed619e700 1 -- 172.21.15.123:0/2459078538 shutdown_connections 2023-03-08T15:49:47.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7f5ed619e700 1 -- 172.21.15.123:0/2459078538 wait complete. 2023-03-08T15:49:47.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7f8355ffb700 1 -- 172.21.15.123:0/2736364076 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c00cad0 con 0x7f8358140520 2023-03-08T15:49:47.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.322+0000 7f8355ffb700 1 -- 172.21.15.123:0/2736364076 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c00ce60 con 0x7f8358140520 2023-03-08T15:49:47.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f835d922700 1 -- 172.21.15.123:0/2736364076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8358140520 msgr2=0x7f8358140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f835d922700 1 --2- 172.21.15.123:0/2736364076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8358140520 0x7f8358140940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f834c0092e0 tx=0x7f834c0095f0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7f835d922700 1 -- 172.21.15.123:0/2736364076 shutdown_connections 2023-03-08T15:49:47.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7f835d922700 1 --2- 172.21.15.123:0/2736364076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8358140520 0x7f8358140940 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7f835d922700 1 --2- 172.21.15.123:0/2736364076 >> v2:172.21.15.123:3300/0 conn(0x7f83580b9170 0x7f83580b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7f835d922700 1 -- 172.21.15.123:0/2736364076 >> 172.21.15.123:0/2736364076 conn(0x7f835806a250 msgr2=0x7f835806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f68037fe700 1 -- 172.21.15.123:0/3802253404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6804140520 msgr2=0x7f68041ed1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f68037fe700 1 --2- 172.21.15.123:0/3802253404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6804140520 0x7f68041ed1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f68037fe700 1 -- 172.21.15.123:0/3802253404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6804146ad0 msgr2=0x7f68041ed6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f68037fe700 1 --2- 172.21.15.123:0/3802253404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6804146ad0 0x7f68041ed6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.323+0000 7f68037fe700 1 -- 172.21.15.123:0/3802253404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f800b730 con 0x7f68040b9170 2023-03-08T15:49:47.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7f68037fe700 1 --2- 172.21.15.123:0/3802253404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68040b9170 0x7f68040703f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f67fc009ce0 tx=0x7f67fc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7fe47cf99700 1 -- 172.21.15.123:0/845642596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe478071660 msgr2=0x7fe478071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7fe47cf99700 1 --2- 172.21.15.123:0/845642596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe478071660 0x7fe478071b00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe470009e50 tx=0x7fe47000b330 comp rx=0 tx=0).stop 2023-03-08T15:49:47.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7fe47cf99700 1 -- 172.21.15.123:0/845642596 shutdown_connections 2023-03-08T15:49:47.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7fe47cf99700 1 --2- 172.21.15.123:0/845642596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe478071660 0x7fe478071b00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7fe47cf99700 1 --2- 172.21.15.123:0/845642596 >> v2:172.21.15.123:3300/0 conn(0x7fe478148f10 0x7fe4780b9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7fe47cf99700 1 -- 172.21.15.123:0/845642596 >> 172.21.15.123:0/845642596 conn(0x7fe47806b360 msgr2=0x7fe47806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7f67f3fff700 1 -- 172.21.15.123:0/3802253404 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc00cbb0 con 0x7f68040b9170 2023-03-08T15:49:47.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7f67f3fff700 1 -- 172.21.15.123:0/3802253404 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc00f040 con 0x7f68040b9170 2023-03-08T15:49:47.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7f67f3fff700 1 -- 172.21.15.123:0/3802253404 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc014480 con 0x7f68040b9170 2023-03-08T15:49:47.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7f6809d21700 1 -- 172.21.15.123:0/3802253404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68040b8bf0 con 0x7f68040b9170 2023-03-08T15:49:47.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.325+0000 7efed7942700 1 Processor -- start 2023-03-08T15:49:47.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.325+0000 7fe47cf99700 1 -- 172.21.15.123:0/845642596 shutdown_connections 2023-03-08T15:49:47.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7fafee27c700 1 Processor -- start 2023-03-08T15:49:47.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.324+0000 7fafee27c700 1 -- start start 2023-03-08T15:49:47.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.325+0000 7efed7942700 1 -- start start 2023-03-08T15:49:47.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.325+0000 7fe47cf99700 1 -- 172.21.15.123:0/845642596 wait complete. 2023-03-08T15:49:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7efed7942700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed006aee0 0x7efed01368f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7efed7942700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed00b6500 0x7efed012d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7efed7942700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0133f90 0x7efed012dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7efed7942700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed01472a0 con 0x7efed0133f90 2023-03-08T15:49:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7efed7942700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed0149ce0 con 0x7efed006aee0 2023-03-08T15:49:47.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7efed7942700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed01318f0 con 0x7efed00b6500 2023-03-08T15:49:47.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7efed5edf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0133f90 0x7efed012dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7efed5edf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0133f90 0x7efed012dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36796/0 (socket says 172.21.15.123:36796) 2023-03-08T15:49:47.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7efed5edf700 1 -- 172.21.15.123:0/2527689953 learned_addr learned my addr 172.21.15.123:0/2527689953 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:47.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.325+0000 7fafee27c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafe8072760 0x7fafe806fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7fafee27c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe8070670 con 0x7fafe8071df0 2023-03-08T15:49:47.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7fafee27c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe8070c50 con 0x7fafe80ba280 2023-03-08T15:49:47.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7fafee27c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe8070a40 con 0x7fafe8072760 2023-03-08T15:49:47.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7f67f3fff700 1 -- 172.21.15.123:0/3802253404 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f67fc0145e0 con 0x7f68040b9170 2023-03-08T15:49:47.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.327+0000 7f6809d21700 1 -- 172.21.15.123:0/3802253404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68040b5310 con 0x7f68040b9170 2023-03-08T15:49:47.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.327+0000 7efed5edf700 1 -- 172.21.15.123:0/2527689953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed00b6500 msgr2=0x7efed012d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.327+0000 7efed5edf700 1 --2- 172.21.15.123:0/2527689953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed00b6500 0x7efed012d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.327+0000 7efed5edf700 1 -- 172.21.15.123:0/2527689953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed006aee0 msgr2=0x7efed01368f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-08T15:49:47.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.327+0000 7efed5edf700 1 --2- 172.21.15.123:0/2527689953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed006aee0 0x7efed01368f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.327+0000 7efed5edf700 1 -- 172.21.15.123:0/2527689953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc009550 con 0x7efed0133f90 2023-03-08T15:49:47.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.327+0000 7fe47cf99700 1 Processor -- start 2023-03-08T15:49:47.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.327+0000 7fafec819700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fafe8071df0 0x7fafe814aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33596/0 (socket says 172.21.15.123:33596) 2023-03-08T15:49:47.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.327+0000 7fafec819700 1 -- 172.21.15.123:0/3975002193 learned_addr learned my addr 172.21.15.123:0/3975002193 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:47.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.327+0000 7efed5edf700 1 --2- 172.21.15.123:0/2527689953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0133f90 0x7efed012dbc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efed0067d90 tx=0x7efecc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.327+0000 7fafe77fe700 1 --2- 172.21.15.123:0/3975002193 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafe8072760 0x7fafe806fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.325+0000 7f5ed619e700 1 Processor -- start 2023-03-08T15:49:47.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.325+0000 7f5ed619e700 1 -- start start 2023-03-08T15:49:47.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7f5ed619e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ebc0043e0 0x7f5ed0070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7f5ed619e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ed01e2930 0x7f5ed0135810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7f5ed619e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ed0135d50 0x7f5ed013e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7f5ed619e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00704a0 con 0x7f5ed01e2930 2023-03-08T15:49:47.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7f5ed619e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed006fc70 con 0x7f5ebc0043e0 2023-03-08T15:49:47.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.326+0000 7f5ed619e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0070940 con 0x7f5ed0135d50 2023-03-08T15:49:47.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.327+0000 7f5ed599d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ed0135d50 0x7f5ed013e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.327+0000 7f835d922700 1 -- 172.21.15.123:0/2736364076 shutdown_connections 2023-03-08T15:49:47.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fafe77fe700 1 -- 172.21.15.123:0/3975002193 >> v1:172.21.15.175:6789/0 conn(0x7fafe80ba280 legacy=0x7fafe8141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fafe77fe700 1 -- 172.21.15.123:0/3975002193 >> v1:172.21.15.123:6789/0 conn(0x7fafe8071df0 legacy=0x7fafe814aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fafe77fe700 1 -- 172.21.15.123:0/3975002193 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe80ba650 con 0x7fafe8072760 2023-03-08T15:49:47.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.327+0000 7fe47cf99700 1 -- start start 2023-03-08T15:49:47.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe47cf99700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe47806fa10 0x7fe4780bcf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe47cf99700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe478071660 0x7fe4780bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe47cf99700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe478148f10 0x7fe4780b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.359 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe47cf99700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780bcbe0 con 0x7fe478148f10 2023-03-08T15:49:47.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe47cf99700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780bdb40 con 0x7fe47806fa10 2023-03-08T15:49:47.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe47cf99700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4781e7a90 con 0x7fe478071660 2023-03-08T15:49:47.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7efec5ffb700 1 -- 172.21.15.123:0/2527689953 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc00b660 con 0x7efed0133f90 2023-03-08T15:49:47.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7efec5ffb700 1 -- 172.21.15.123:0/2527689953 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc00b7c0 con 0x7efed0133f90 2023-03-08T15:49:47.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7efed7942700 1 -- 172.21.15.123:0/2527689953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed00b3880 con 0x7efed0133f90 2023-03-08T15:49:47.360 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7efec5ffb700 1 -- 172.21.15.123:0/2527689953 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc00bb30 con 0x7efed0133f90 2023-03-08T15:49:47.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7f67f3fff700 1 --2- 172.21.15.123:0/3802253404 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f67e80698f0 0x7f67e806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.329+0000 7f5ed519c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ebc0043e0 0x7f5ed0070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.329+0000 7f5ed519c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ebc0043e0 0x7f5ed0070fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:37004/0 (socket says 172.21.15.123:37004) 2023-03-08T15:49:47.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.329+0000 7f5ed519c700 1 -- 172.21.15.123:0/1448051297 learned_addr learned my addr 172.21.15.123:0/1448051297 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:47.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.329+0000 7f5ed499b700 1 --2- 172.21.15.123:0/1448051297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ed01e2930 0x7f5ed0135810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.329+0000 7f67f3fff700 1 -- 172.21.15.123:0/3802253404 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f67fc0112c0 con 0x7f68040b9170 2023-03-08T15:49:47.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7f835d922700 1 -- 172.21.15.123:0/2736364076 wait complete. 2023-03-08T15:49:47.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.329+0000 7f835d922700 1 Processor -- start 2023-03-08T15:49:47.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe476d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe478148f10 0x7fe4780b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe476d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe478148f10 0x7fe4780b66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36822/0 (socket says 172.21.15.123:36822) 2023-03-08T15:49:47.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe476d9d700 1 -- 172.21.15.123:0/1409546202 learned_addr learned my addr 172.21.15.123:0/1409546202 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:47.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe47659c700 1 --2- 172.21.15.123:0/1409546202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe47806fa10 0x7fe4780bcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.363 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe476d9d700 1 -- 172.21.15.123:0/1409546202 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe478071660 msgr2=0x7fe4780bc6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-08T15:49:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe476d9d700 1 --2- 172.21.15.123:0/1409546202 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe478071660 0x7fe4780bc6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe476d9d700 1 -- 172.21.15.123:0/1409546202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe47806fa10 msgr2=0x7fe4780bcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe476d9d700 1 --2- 172.21.15.123:0/1409546202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe47806fa10 0x7fe4780bcf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe476d9d700 1 -- 172.21.15.123:0/1409546202 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe470009b30 con 0x7fe478148f10 2023-03-08T15:49:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.328+0000 7fe476d9d700 1 --2- 172.21.15.123:0/1409546202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe478148f10 0x7fe4780b66d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe47000bee0 tx=0x7fe470004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.329+0000 7efed7942700 1 -- 172.21.15.123:0/2527689953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed00b42f0 con 0x7efed0133f90 2023-03-08T15:49:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.329+0000 7f835d922700 1 -- start start 2023-03-08T15:49:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7fafe77fe700 1 --2- 172.21.15.123:0/3975002193 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafe8072760 0x7fafe806fff0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fafe0009dc0 tx=0x7fafe000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eddbf66450ae6cac server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7fafe6ffd700 1 -- 172.21.15.123:0/3975002193 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe000e070 con 0x7fafe8072760 2023-03-08T15:49:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7fafe6ffd700 1 -- 172.21.15.123:0/3975002193 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe000bbd0 con 0x7fafe8072760 2023-03-08T15:49:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7fafe6ffd700 1 -- 172.21.15.123:0/3975002193 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0012430 con 0x7fafe8072760 2023-03-08T15:49:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7fafee27c700 1 -- 172.21.15.123:0/3975002193 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafe8072760 msgr2=0x7fafe806fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.366 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7fafee27c700 1 --2- 172.21.15.123:0/3975002193 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafe8072760 0x7fafe806fff0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fafe0009dc0 tx=0x7fafe000b330 comp rx=0 tx=0).stop 2023-03-08T15:49:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7f5ed499b700 1 -- 172.21.15.123:0/1448051297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ed0135d50 msgr2=0x7f5ed013e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7f5ed499b700 1 --2- 172.21.15.123:0/1448051297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ed0135d50 0x7f5ed013e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7f5ed499b700 1 -- 172.21.15.123:0/1448051297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ebc0043e0 msgr2=0x7f5ed0070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7f5ed499b700 1 --2- 172.21.15.123:0/1448051297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ebc0043e0 0x7f5ed0070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7f5ed499b700 1 -- 172.21.15.123:0/1448051297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0147070 con 0x7f5ed01e2930 2023-03-08T15:49:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7f5ed499b700 1 --2- 172.21.15.123:0/1448051297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ed01e2930 0x7f5ed0135810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5ed006cbc0 tx=0x7f5ecc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7f5ec5ffb700 1 -- 172.21.15.123:0/1448051297 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc021070 con 0x7f5ed01e2930 2023-03-08T15:49:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7f5ec5ffb700 1 -- 172.21.15.123:0/1448051297 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc010e50 con 0x7f5ed01e2930 2023-03-08T15:49:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7f5ed619e700 1 -- 172.21.15.123:0/1448051297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed0146d90 con 0x7f5ed01e2930 2023-03-08T15:49:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7f5ec5ffb700 1 -- 172.21.15.123:0/1448051297 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc012c30 con 0x7f5ed01e2930 2023-03-08T15:49:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7f5ed619e700 1 -- 172.21.15.123:0/1448051297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed00b9b80 con 0x7f5ed01e2930 2023-03-08T15:49:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7f5ed519c700 1 --2- 172.21.15.123:0/1448051297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ebc0043e0 0x7f5ed0070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7fafee27c700 1 -- 172.21.15.123:0/3975002193 shutdown_connections 2023-03-08T15:49:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7fafee27c700 1 --2- 172.21.15.123:0/3975002193 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafe8072760 0x7fafe806fff0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7fafee27c700 1 -- 172.21.15.123:0/3975002193 >> 172.21.15.123:0/3975002193 conn(0x7fafe806b360 msgr2=0x7fafe806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7fafee27c700 1 -- 172.21.15.123:0/3975002193 shutdown_connections 2023-03-08T15:49:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.332+0000 7f6809d21700 1 -- 172.21.15.123:0/3802253404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68040b9540 con 0x7f68040b9170 2023-03-08T15:49:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7f835d922700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83580b9170 0x7f8358141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7f835d922700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8358140520 0x7f8358143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7f835d922700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8358146ad0 0x7f835813a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7f835d922700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83581420b0 con 0x7f8358146ad0 2023-03-08T15:49:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7f835d922700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8358142d40 con 0x7f83580b9170 2023-03-08T15:49:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7f835d922700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8358143cc0 con 0x7f8358140520 2023-03-08T15:49:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7f8356ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83580b9170 0x7f8358141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7f8356ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83580b9170 0x7f8358141b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:37022/0 (socket says 172.21.15.123:37022) 2023-03-08T15:49:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7f8356ffd700 1 -- 172.21.15.123:0/4197932307 learned_addr learned my addr 172.21.15.123:0/4197932307 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7f83567fc700 1 --2- 172.21.15.123:0/4197932307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8358140520 0x7f8358143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7f8356ffd700 1 -- 172.21.15.123:0/4197932307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8358140520 msgr2=0x7f8358143780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7f8356ffd700 1 --2- 172.21.15.123:0/4197932307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8358140520 0x7f8358143780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7f8356ffd700 1 -- 172.21.15.123:0/4197932307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8358146ad0 msgr2=0x7f835813a830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-08T15:49:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7f8356ffd700 1 --2- 172.21.15.123:0/4197932307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8358146ad0 0x7f835813a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7f8356ffd700 1 -- 172.21.15.123:0/4197932307 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c009de0 con 0x7f83580b9170 2023-03-08T15:49:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.332+0000 7f8356ffd700 1 --2- 172.21.15.123:0/4197932307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83580b9170 0x7f8358141b70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8350007ef0 tx=0x7f835000e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.332+0000 7f833ffff700 1 -- 172.21.15.123:0/4197932307 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835000ee40 con 0x7f83580b9170 2023-03-08T15:49:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.332+0000 7f833ffff700 1 -- 172.21.15.123:0/4197932307 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8350014420 con 0x7f83580b9170 2023-03-08T15:49:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.332+0000 7f835d922700 1 -- 172.21.15.123:0/4197932307 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83580b8bf0 con 0x7f83580b9170 2023-03-08T15:49:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.332+0000 7f833ffff700 1 -- 172.21.15.123:0/4197932307 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500147b0 con 0x7f83580b9170 2023-03-08T15:49:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.332+0000 7f835d922700 1 -- 172.21.15.123:0/4197932307 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83580b5310 con 0x7f83580b9170 2023-03-08T15:49:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.330+0000 7efed7942700 1 -- 172.21.15.123:0/2527689953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed00b3a10 con 0x7efed0133f90 2023-03-08T15:49:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7efec5ffb700 1 -- 172.21.15.123:0/2527689953 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7efecc017020 con 0x7efed0133f90 2023-03-08T15:49:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7efec5ffb700 1 --2- 172.21.15.123:0/2527689953 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7efeb4069920 0x7efeb406bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7efed56de700 1 --2- 172.21.15.123:0/2527689953 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7efeb4069920 0x7efeb406bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7efec5ffb700 1 -- 172.21.15.123:0/2527689953 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efecc088f90 con 0x7efed0133f90 2023-03-08T15:49:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.332+0000 7efed56de700 1 --2- 172.21.15.123:0/2527689953 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7efeb4069920 0x7efeb406bdd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efed0067c60 tx=0x7efec8009250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.334+0000 7fe466ffd700 1 -- 172.21.15.123:0/1409546202 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470004440 con 0x7fe478148f10 2023-03-08T15:49:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.331+0000 7fafee27c700 1 -- 172.21.15.123:0/3975002193 wait complete. 2023-03-08T15:49:47.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.333+0000 7fafee27c700 1 Processor -- start 2023-03-08T15:49:47.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.333+0000 7fafee27c700 1 -- start start 2023-03-08T15:49:47.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.334+0000 7fafee27c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafe8071df0 0x7fafe80b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.334+0000 7fafee27c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafe80ba280 0x7fafe8145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.334+0000 7fafee27c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafe81453b0 0x7fafe80b6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.334+0000 7fafee27c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80b6b40 con 0x7fafe80ba280 2023-03-08T15:49:47.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.334+0000 7fafee27c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80b7030 con 0x7fafe8071df0 2023-03-08T15:49:47.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.334+0000 7fafee27c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe813d0a0 con 0x7fafe81453b0 2023-03-08T15:49:47.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.334+0000 7fafec819700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafe81453b0 0x7fafe80b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.334+0000 7fafec819700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafe81453b0 0x7fafe80b6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:50056/0 (socket says 172.21.15.123:50056) 2023-03-08T15:49:47.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.334+0000 7fafec819700 1 -- 172.21.15.123:0/979403112 learned_addr learned my addr 172.21.15.123:0/979403112 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:47.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.334+0000 7f835d922700 1 -- 172.21.15.123:0/4197932307 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83580b9540 con 0x7f83580b9170 2023-03-08T15:49:47.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.334+0000 7fafe77fe700 1 --2- 172.21.15.123:0/979403112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafe80ba280 0x7fafe8145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.335+0000 7fafe77fe700 1 -- 172.21.15.123:0/979403112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafe81453b0 msgr2=0x7fafe80b6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.335+0000 7fafe77fe700 1 --2- 172.21.15.123:0/979403112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafe81453b0 0x7fafe80b6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.335+0000 7fafe77fe700 1 -- 172.21.15.123:0/979403112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafe8071df0 msgr2=0x7fafe80b74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.335+0000 7fafe77fe700 1 --2- 172.21.15.123:0/979403112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafe8071df0 0x7fafe80b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.335+0000 7fafe77fe700 1 -- 172.21.15.123:0/979403112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0009a70 con 0x7fafe80ba280 2023-03-08T15:49:47.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.335+0000 7fafe77fe700 1 --2- 172.21.15.123:0/979403112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafe80ba280 0x7fafe8145f40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fafe0016000 tx=0x7fafe0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.335+0000 7f5ebb7fe700 1 -- 172.21.15.123:0/1448051297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed00b8ae0 con 0x7f5ed01e2930 2023-03-08T15:49:47.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.334+0000 7fe466ffd700 1 -- 172.21.15.123:0/1409546202 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4700045a0 con 0x7fe478148f10 2023-03-08T15:49:47.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.334+0000 7fe466ffd700 1 -- 172.21.15.123:0/1409546202 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470004950 con 0x7fe478148f10 2023-03-08T15:49:47.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.334+0000 7f833ffff700 1 -- 172.21.15.123:0/4197932307 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f8350012050 con 0x7f83580b9170 2023-03-08T15:49:47.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.335+0000 7f833ffff700 1 --2- 172.21.15.123:0/4197932307 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8344069920 0x7f834406bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.335+0000 7f833ffff700 1 -- 172.21.15.123:0/4197932307 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f83500873f0 con 0x7f83580b9170 2023-03-08T15:49:47.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.335+0000 7f83567fc700 1 --2- 172.21.15.123:0/4197932307 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8344069920 0x7f834406bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.336+0000 7f83567fc700 1 --2- 172.21.15.123:0/4197932307 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8344069920 0x7f834406bdd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f835814aef0 tx=0x7f8348009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.337+0000 7f6802ffd700 1 --2- 172.21.15.123:0/3802253404 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f67e80698f0 0x7f67e806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.337+0000 7fe47cf99700 1 -- 172.21.15.123:0/1409546202 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4780b8b20 con 0x7fe478148f10 2023-03-08T15:49:47.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.337+0000 7fe47cf99700 1 -- 172.21.15.123:0/1409546202 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4780b8840 con 0x7fe478148f10 2023-03-08T15:49:47.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.337+0000 7f6802ffd700 1 --2- 172.21.15.123:0/3802253404 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f67e80698f0 0x7f67e806bda0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f680406fa40 tx=0x7f67f4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.338+0000 7fe47cf99700 1 -- 172.21.15.123:0/1409546202 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4780b97c0 con 0x7fe478148f10 2023-03-08T15:49:47.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.338+0000 7efec5ffb700 1 -- 172.21.15.123:0/2527689953 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7efecc054e00 con 0x7efed0133f90 2023-03-08T15:49:47.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.341+0000 7f833ffff700 1 -- 172.21.15.123:0/4197932307 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f8350053160 con 0x7f83580b9170 2023-03-08T15:49:47.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.343+0000 7f67f3fff700 1 -- 172.21.15.123:0/3802253404 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f67fc0531b0 con 0x7f68040b9170 2023-03-08T15:49:47.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.345+0000 7f5ec5ffb700 1 -- 172.21.15.123:0/1448051297 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f5ecc02c030 con 0x7f5ed01e2930 2023-03-08T15:49:47.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.345+0000 7f5ec5ffb700 1 --2- 172.21.15.123:0/1448051297 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5eb4069950 0x7f5eb406be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.346+0000 7f5ec5ffb700 1 -- 172.21.15.123:0/1448051297 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ecc0880f0 con 0x7f5ed01e2930 2023-03-08T15:49:47.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.352+0000 7fc52e317700 1 Processor -- start 2023-03-08T15:49:47.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.352+0000 7f5ed519c700 1 --2- 172.21.15.123:0/1448051297 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5eb4069950 0x7f5eb406be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.352+0000 7fc52e317700 1 -- start start 2023-03-08T15:49:47.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.352+0000 7f5ed519c700 1 --2- 172.21.15.123:0/1448051297 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5eb4069950 0x7f5eb406be00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0011370 tx=0x7f5ec0012040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fc52e317700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc52814c170 0x7fc5280bd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fc52e317700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc52806f0c0 0x7fc52814f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fc52e317700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52814ec60 con 0x7fc52806f530 2023-03-08T15:49:47.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fc52e317700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52806fd20 con 0x7fc52814c170 2023-03-08T15:49:47.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fc52e317700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc528070da0 con 0x7fc52806f0c0 2023-03-08T15:49:47.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fc527fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc52814c170 0x7fc5280bd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.385 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fc527fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc52814c170 0x7fc5280bd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36840/0 (socket says 172.21.15.123:36840) 2023-03-08T15:49:47.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fc527fff700 1 -- 172.21.15.123:0/3100185443 learned_addr learned my addr 172.21.15.123:0/3100185443 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:47.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fc527fff700 1 -- 172.21.15.123:0/3100185443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc52806f0c0 msgr2=0x7fc52814f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:47.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fc527fff700 1 --2- 172.21.15.123:0/3100185443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc52806f0c0 0x7fc52814f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fc527fff700 1 -- 172.21.15.123:0/3100185443 >> v1:172.21.15.175:6789/0 conn(0x7fc52806f530 legacy=0x7fc528152030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-08T15:49:47.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fc527fff700 1 -- 172.21.15.123:0/3100185443 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5280709f0 con 0x7fc52814c170 2023-03-08T15:49:47.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fafe4ff9700 1 -- 172.21.15.123:0/979403112 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe00048b0 con 0x7fafe80ba280 2023-03-08T15:49:47.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fafe4ff9700 1 -- 172.21.15.123:0/979403112 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe0020070 con 0x7fafe80ba280 2023-03-08T15:49:47.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fafe4ff9700 1 -- 172.21.15.123:0/979403112 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0027680 con 0x7fafe80ba280 2023-03-08T15:49:47.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.353+0000 7fafee27c700 1 -- 172.21.15.123:0/979403112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe8141d20 con 0x7fafe80ba280 2023-03-08T15:49:47.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.354+0000 7fafee27c700 1 -- 172.21.15.123:0/979403112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe8141b90 con 0x7fafe80ba280 2023-03-08T15:49:47.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.354+0000 7fe466ffd700 1 -- 172.21.15.123:0/1409546202 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fe470031430 con 0x7fe478148f10 2023-03-08T15:49:47.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.354+0000 7fc527fff700 1 --2- 172.21.15.123:0/3100185443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc52814c170 0x7fc5280bd420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0098f0 tx=0x7fc51c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0b0719a9d5df27 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.355+0000 7fe466ffd700 1 --2- 172.21.15.123:0/1409546202 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe458069920 0x7fe45806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.355+0000 7fe466ffd700 1 -- 172.21.15.123:0/1409546202 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4700893c0 con 0x7fe478148f10 2023-03-08T15:49:47.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.355+0000 7fe47659c700 1 --2- 172.21.15.123:0/1409546202 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe458069920 0x7fe45806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.355+0000 7fe47659c700 1 --2- 172.21.15.123:0/1409546202 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe458069920 0x7fe45806bdd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009970 tx=0x7fe46c009110 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.356+0000 7fafee27c700 1 -- 172.21.15.123:0/979403112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe814b1c0 con 0x7fafe80ba280 2023-03-08T15:49:47.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.356+0000 7f5ec5ffb700 1 -- 172.21.15.123:0/1448051297 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f5ecc053f60 con 0x7f5ed01e2930 2023-03-08T15:49:47.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.367+0000 7fc526ffd700 1 -- 172.21.15.123:0/3100185443 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c004230 con 0x7fc52814c170 2023-03-08T15:49:47.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.367+0000 7fc526ffd700 1 -- 172.21.15.123:0/3100185443 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c004390 con 0x7fc52814c170 2023-03-08T15:49:47.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.367+0000 7fc526ffd700 1 -- 172.21.15.123:0/3100185443 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c0036a0 con 0x7fc52814c170 2023-03-08T15:49:47.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.368+0000 7fc52e317700 1 -- 172.21.15.123:0/3100185443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc52814c170 msgr2=0x7fc5280bd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.368+0000 7fc52e317700 1 --2- 172.21.15.123:0/3100185443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc52814c170 0x7fc5280bd420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0098f0 tx=0x7fc51c009c00 comp rx=0 tx=0).stop 2023-03-08T15:49:47.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.368+0000 7fe466ffd700 1 -- 172.21.15.123:0/1409546202 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fe4700551d0 con 0x7fe478148f10 2023-03-08T15:49:47.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.368+0000 7fc52e317700 1 -- 172.21.15.123:0/3100185443 shutdown_connections 2023-03-08T15:49:47.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.368+0000 7fc52e317700 1 --2- 172.21.15.123:0/3100185443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc52814c170 0x7fc5280bd420 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.368+0000 7fc52e317700 1 --2- 172.21.15.123:0/3100185443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc52806f0c0 0x7fc52814f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.368+0000 7fc52e317700 1 -- 172.21.15.123:0/3100185443 >> 172.21.15.123:0/3100185443 conn(0x7fc5280ba3c0 msgr2=0x7fc5280bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.368+0000 7fc52e317700 1 -- 172.21.15.123:0/3100185443 shutdown_connections 2023-03-08T15:49:47.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.368+0000 7fc52e317700 1 -- 172.21.15.123:0/3100185443 wait complete. 2023-03-08T15:49:47.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.370+0000 7fc52e317700 1 Processor -- start 2023-03-08T15:49:47.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.371+0000 7fc52e317700 1 -- start start 2023-03-08T15:49:47.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.372+0000 7fc52e317700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc52806f0c0 0x7fc5281df360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.372+0000 7fc52e317700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc52806f530 0x7fc5280bcb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.372+0000 7fc52e317700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc52814c170 0x7fc5280bbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.372+0000 7fc52e317700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52814e3a0 con 0x7fc52814c170 2023-03-08T15:49:47.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.372+0000 7fc52e317700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5281df8a0 con 0x7fc52806f530 2023-03-08T15:49:47.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.372+0000 7fc52e317700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5280bacb0 con 0x7fc52806f0c0 2023-03-08T15:49:47.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.372+0000 7fc52c8b4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc52814c170 0x7fc5280bbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.372+0000 7fc52c8b4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc52814c170 0x7fc5280bbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36844/0 (socket says 172.21.15.123:36844) 2023-03-08T15:49:47.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.372+0000 7fc52c8b4700 1 -- 172.21.15.123:0/1073624863 learned_addr learned my addr 172.21.15.123:0/1073624863 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:47.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.373+0000 7fc5277fe700 1 --2- 172.21.15.123:0/1073624863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc52806f530 0x7fc5280bcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.373+0000 7fc527fff700 1 --2- 172.21.15.123:0/1073624863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc52806f0c0 0x7fc5281df360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.370+0000 7fafe4ff9700 1 -- 172.21.15.123:0/979403112 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fafe0012430 con 0x7fafe80ba280 2023-03-08T15:49:47.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.370+0000 7fafe4ff9700 1 --2- 172.21.15.123:0/979403112 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafd40699a0 0x7fafd406be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.370+0000 7fafe4ff9700 1 -- 172.21.15.123:0/979403112 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fafe0022070 con 0x7fafe80ba280 2023-03-08T15:49:47.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.373+0000 7fc52c8b4700 1 -- 172.21.15.123:0/1073624863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc52806f0c0 msgr2=0x7fc5281df360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.373+0000 7fc52c8b4700 1 --2- 172.21.15.123:0/1073624863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc52806f0c0 0x7fc5281df360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.373+0000 7fc52c8b4700 1 -- 172.21.15.123:0/1073624863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc52806f530 msgr2=0x7fc5280bcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.373+0000 7fc52c8b4700 1 --2- 172.21.15.123:0/1073624863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc52806f530 0x7fc5280bcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.373+0000 7fc52c8b4700 1 -- 172.21.15.123:0/1073624863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c009550 con 0x7fc52814c170 2023-03-08T15:49:47.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.373+0000 7fc52c8b4700 1 --2- 172.21.15.123:0/1073624863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc52814c170 0x7fc5280bbca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc52000b780 tx=0x7fc52000bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.383+0000 7fc524ff9700 1 -- 172.21.15.123:0/1073624863 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52000f840 con 0x7fc52814c170 2023-03-08T15:49:47.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.383+0000 7fc524ff9700 1 -- 172.21.15.123:0/1073624863 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52000f9a0 con 0x7fc52814c170 2023-03-08T15:49:47.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.383+0000 7fc524ff9700 1 -- 172.21.15.123:0/1073624863 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52000fd30 con 0x7fc52814c170 2023-03-08T15:49:47.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.383+0000 7fc52e317700 1 -- 172.21.15.123:0/1073624863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52806b400 con 0x7fc52814c170 2023-03-08T15:49:47.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.383+0000 7fc52e317700 1 -- 172.21.15.123:0/1073624863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52814c540 con 0x7fc52814c170 2023-03-08T15:49:47.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.374+0000 7fafe7fff700 1 --2- 172.21.15.123:0/979403112 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafd40699a0 0x7fafd406be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.374+0000 7fafe4ff9700 1 -- 172.21.15.123:0/979403112 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fafe00560a0 con 0x7fafe80ba280 2023-03-08T15:49:47.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.379+0000 7fafe7fff700 1 --2- 172.21.15.123:0/979403112 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafd40699a0 0x7fafd406be50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fafd8000f60 tx=0x7fafd8007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.389+0000 7fc52e317700 1 -- 172.21.15.123:0/1073624863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc514005310 con 0x7fc52814c170 2023-03-08T15:49:47.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.400+0000 7fc524ff9700 1 -- 172.21.15.123:0/1073624863 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fc520017400 con 0x7fc52814c170 2023-03-08T15:49:47.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.401+0000 7fc524ff9700 1 --2- 172.21.15.123:0/1073624863 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc510069b10 0x7fc51006bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.401+0000 7fc524ff9700 1 -- 172.21.15.123:0/1073624863 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc520087b50 con 0x7fc52814c170 2023-03-08T15:49:47.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.401+0000 7fc524ff9700 1 -- 172.21.15.123:0/1073624863 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fc52008b2a0 con 0x7fc52814c170 2023-03-08T15:49:47.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.402+0000 7fc527fff700 1 --2- 172.21.15.123:0/1073624863 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc510069b10 0x7fc51006bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.402+0000 7fc527fff700 1 --2- 172.21.15.123:0/1073624863 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc510069b10 0x7fc51006bfc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009c40 tx=0x7fc51c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.650+0000 7f06e8194700 1 -- 172.21.15.123:0/2633266578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f06c8005590 con 0x7f06e00b8ed0 2023-03-08T15:49:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.651+0000 7f06d67fc700 1 -- 172.21.15.123:0/2633266578 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06d8067cd0 con 0x7f06e00b8ed0 2023-03-08T15:49:47.655 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-03-08T15:49:47.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.654+0000 7f06e8194700 1 -- 172.21.15.123:0/2633266578 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f06c40699a0 msgr2=0x7f06c406be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.654+0000 7f06e8194700 1 --2- 172.21.15.123:0/2633266578 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f06c40699a0 0x7f06c406be50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06d0000c00 tx=0x7f06d0008030 comp rx=0 tx=0).stop 2023-03-08T15:49:47.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.654+0000 7f06e8194700 1 -- 172.21.15.123:0/2633266578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e00b8ed0 msgr2=0x7f06e00a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.654+0000 7f06e8194700 1 --2- 172.21.15.123:0/2633266578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e00b8ed0 0x7f06e00a8ff0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f06d800cb20 tx=0x7f06d800cee0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.655+0000 7f06e8194700 1 -- 172.21.15.123:0/2633266578 shutdown_connections 2023-03-08T15:49:47.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.655+0000 7f06e8194700 1 --2- 172.21.15.123:0/2633266578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e00b8ed0 0x7f06e00a8ff0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.655+0000 7f06e8194700 1 --2- 172.21.15.123:0/2633266578 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f06c40699a0 0x7f06c406be50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.655+0000 7f06e8194700 1 --2- 172.21.15.123:0/2633266578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06e008a300 0x7f06e01f0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.655+0000 7f06e8194700 1 --2- 172.21.15.123:0/2633266578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06e00b4e70 0x7f06e01f0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.655+0000 7f06e8194700 1 -- 172.21.15.123:0/2633266578 >> 172.21.15.123:0/2633266578 conn(0x7f06e006a250 msgr2=0x7f06e0088610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.655+0000 7f06e8194700 1 -- 172.21.15.123:0/2633266578 shutdown_connections 2023-03-08T15:49:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.655+0000 7f06e8194700 1 -- 172.21.15.123:0/2633266578 wait complete. 2023-03-08T15:49:47.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-03-08T15:49:47.674 DEBUG:teuthology.parallel:result is None 2023-03-08T15:49:47.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.706+0000 7f6809d21700 1 -- 172.21.15.123:0/3802253404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6804072a30 con 0x7f68040b9170 2023-03-08T15:49:47.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.706+0000 7f67f3fff700 1 -- 172.21.15.123:0/3802253404 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67fc0567d0 con 0x7f68040b9170 2023-03-08T15:49:47.708 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2023-03-08T15:49:47.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.711+0000 7f6809d21700 1 -- 172.21.15.123:0/3802253404 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f67e80698f0 msgr2=0x7f67e806bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.711+0000 7f6809d21700 1 --2- 172.21.15.123:0/3802253404 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f67e80698f0 0x7f67e806bda0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f680406fa40 tx=0x7f67f4009040 comp rx=0 tx=0).stop 2023-03-08T15:49:47.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.711+0000 7f6809d21700 1 -- 172.21.15.123:0/3802253404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68040b9170 msgr2=0x7f68040703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.711+0000 7f6809d21700 1 --2- 172.21.15.123:0/3802253404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68040b9170 0x7f68040703f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f67fc009ce0 tx=0x7f67fc00c3a0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.714+0000 7f6809d21700 1 -- 172.21.15.123:0/3802253404 shutdown_connections 2023-03-08T15:49:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.714+0000 7f6809d21700 1 --2- 172.21.15.123:0/3802253404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6804146ad0 0x7f68041ed6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.714+0000 7f6809d21700 1 --2- 172.21.15.123:0/3802253404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68040b9170 0x7f68040703f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.714+0000 7f6809d21700 1 --2- 172.21.15.123:0/3802253404 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f67e80698f0 0x7f67e806bda0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.714+0000 7f6809d21700 1 --2- 172.21.15.123:0/3802253404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6804140520 0x7f68041ed1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.714+0000 7f6809d21700 1 -- 172.21.15.123:0/3802253404 >> 172.21.15.123:0/3802253404 conn(0x7f680406a250 msgr2=0x7f6804145e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.715+0000 7f6809d21700 1 -- 172.21.15.123:0/3802253404 shutdown_connections 2023-03-08T15:49:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.715+0000 7f6809d21700 1 -- 172.21.15.123:0/3802253404 wait complete. 2023-03-08T15:49:47.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-03-08T15:49:47.729 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.727+0000 7f835d922700 1 -- 172.21.15.123:0/4197932307 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8358072a30 con 0x7f83580b9170 2023-03-08T15:49:47.729 DEBUG:teuthology.parallel:result is None 2023-03-08T15:49:47.730 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2023-03-08T15:49:47.730 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.728+0000 7f833ffff700 1 -- 172.21.15.123:0/4197932307 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8350056780 con 0x7f83580b9170 2023-03-08T15:49:47.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.731+0000 7f835d922700 1 -- 172.21.15.123:0/4197932307 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8344069920 msgr2=0x7f834406bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.731+0000 7f835d922700 1 --2- 172.21.15.123:0/4197932307 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8344069920 0x7f834406bdd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f835814aef0 tx=0x7f8348009040 comp rx=0 tx=0).stop 2023-03-08T15:49:47.732 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.731+0000 7f835d922700 1 -- 172.21.15.123:0/4197932307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83580b9170 msgr2=0x7f8358141b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.731+0000 7f835d922700 1 --2- 172.21.15.123:0/4197932307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83580b9170 0x7f8358141b70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8350007ef0 tx=0x7f835000e3c0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.732+0000 7f835d922700 1 -- 172.21.15.123:0/4197932307 shutdown_connections 2023-03-08T15:49:47.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.732+0000 7f835d922700 1 --2- 172.21.15.123:0/4197932307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8358146ad0 0x7f835813a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.732+0000 7f835d922700 1 --2- 172.21.15.123:0/4197932307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83580b9170 0x7f8358141b70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.732+0000 7f835d922700 1 --2- 172.21.15.123:0/4197932307 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8344069920 0x7f834406bdd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.732+0000 7f835d922700 1 --2- 172.21.15.123:0/4197932307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8358140520 0x7f8358143780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.732+0000 7f835d922700 1 -- 172.21.15.123:0/4197932307 >> 172.21.15.123:0/4197932307 conn(0x7f835806a250 msgr2=0x7f8358146f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.732+0000 7f835d922700 1 -- 172.21.15.123:0/4197932307 shutdown_connections 2023-03-08T15:49:47.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.732+0000 7f835d922700 1 -- 172.21.15.123:0/4197932307 wait complete. 2023-03-08T15:49:47.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.733+0000 7efed7942700 1 -- 172.21.15.123:0/2527689953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7efed0147bd0 con 0x7efed0133f90 2023-03-08T15:49:47.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.733+0000 7efec5ffb700 1 -- 172.21.15.123:0/2527689953 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efecc058420 con 0x7efed0133f90 2023-03-08T15:49:47.735 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-03-08T15:49:47.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.735+0000 7efed7942700 1 -- 172.21.15.123:0/2527689953 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7efeb4069920 msgr2=0x7efeb406bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.736+0000 7efed7942700 1 --2- 172.21.15.123:0/2527689953 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7efeb4069920 0x7efeb406bdd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efed0067c60 tx=0x7efec8009250 comp rx=0 tx=0).stop 2023-03-08T15:49:47.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.736+0000 7efed7942700 1 -- 172.21.15.123:0/2527689953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0133f90 msgr2=0x7efed012dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.736+0000 7efed7942700 1 --2- 172.21.15.123:0/2527689953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0133f90 0x7efed012dbc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efed0067d90 tx=0x7efecc004750 comp rx=0 tx=0).stop 2023-03-08T15:49:47.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.737+0000 7efed7942700 1 -- 172.21.15.123:0/2527689953 shutdown_connections 2023-03-08T15:49:47.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.737+0000 7efed7942700 1 --2- 172.21.15.123:0/2527689953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0133f90 0x7efed012dbc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.737+0000 7efed7942700 1 --2- 172.21.15.123:0/2527689953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed006aee0 0x7efed01368f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.737+0000 7efed7942700 1 --2- 172.21.15.123:0/2527689953 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7efeb4069920 0x7efeb406bdd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.737+0000 7efed7942700 1 --2- 172.21.15.123:0/2527689953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efed00b6500 0x7efed012d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.738 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.737+0000 7efed7942700 1 -- 172.21.15.123:0/2527689953 >> 172.21.15.123:0/2527689953 conn(0x7efed00bc480 msgr2=0x7efed01474c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.738+0000 7efed7942700 1 -- 172.21.15.123:0/2527689953 shutdown_connections 2023-03-08T15:49:47.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.738+0000 7efed7942700 1 -- 172.21.15.123:0/2527689953 wait complete. 2023-03-08T15:49:47.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.744+0000 7f5ebb7fe700 1 -- 172.21.15.123:0/1448051297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5ed0071570 con 0x7f5ed01e2930 2023-03-08T15:49:47.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.744+0000 7f5ec5ffb700 1 -- 172.21.15.123:0/1448051297 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ecc02a020 con 0x7f5ed01e2930 2023-03-08T15:49:47.747 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2023-03-08T15:49:47.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.749+0000 7f5ebb7fe700 1 -- 172.21.15.123:0/1448051297 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5eb4069950 msgr2=0x7f5eb406be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.749+0000 7f5ebb7fe700 1 --2- 172.21.15.123:0/1448051297 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5eb4069950 0x7f5eb406be00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0011370 tx=0x7f5ec0012040 comp rx=0 tx=0).stop 2023-03-08T15:49:47.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.749+0000 7f5ebb7fe700 1 -- 172.21.15.123:0/1448051297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ed01e2930 msgr2=0x7f5ed0135810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.749+0000 7f5ebb7fe700 1 --2- 172.21.15.123:0/1448051297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ed01e2930 0x7f5ed0135810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5ed006cbc0 tx=0x7f5ecc0047c0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-03-08T15:49:47.752 DEBUG:teuthology.parallel:result is None 2023-03-08T15:49:47.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.751+0000 7f5ebb7fe700 1 -- 172.21.15.123:0/1448051297 shutdown_connections 2023-03-08T15:49:47.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.751+0000 7f5ebb7fe700 1 --2- 172.21.15.123:0/1448051297 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5eb4069950 0x7f5eb406be00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.751+0000 7f5ebb7fe700 1 --2- 172.21.15.123:0/1448051297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ed0135d50 0x7f5ed013e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.751+0000 7f5ebb7fe700 1 --2- 172.21.15.123:0/1448051297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ebc0043e0 0x7f5ed0070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.751+0000 7f5ebb7fe700 1 --2- 172.21.15.123:0/1448051297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ed01e2930 0x7f5ed0135810 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.751+0000 7f5ebb7fe700 1 -- 172.21.15.123:0/1448051297 >> 172.21.15.123:0/1448051297 conn(0x7f5ed006a250 msgr2=0x7f5ed013afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.751+0000 7f5ebb7fe700 1 -- 172.21.15.123:0/1448051297 shutdown_connections 2023-03-08T15:49:47.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.751+0000 7f5ebb7fe700 1 -- 172.21.15.123:0/1448051297 wait complete. 2023-03-08T15:49:47.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-03-08T15:49:47.758 DEBUG:teuthology.parallel:result is None 2023-03-08T15:49:47.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.761+0000 7fe47cf99700 1 -- 172.21.15.123:0/1409546202 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe4780744c0 con 0x7fe478148f10 2023-03-08T15:49:47.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.762+0000 7fe466ffd700 1 -- 172.21.15.123:0/1409546202 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe4700587f0 con 0x7fe478148f10 2023-03-08T15:49:47.763 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-03-08T15:49:47.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.765+0000 7fe47cf99700 1 -- 172.21.15.123:0/1409546202 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe458069920 msgr2=0x7fe45806bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.765+0000 7fe47cf99700 1 --2- 172.21.15.123:0/1409546202 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe458069920 0x7fe45806bdd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009970 tx=0x7fe46c009110 comp rx=0 tx=0).stop 2023-03-08T15:49:47.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.765+0000 7fe47cf99700 1 -- 172.21.15.123:0/1409546202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe478148f10 msgr2=0x7fe4780b66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.765+0000 7fe47cf99700 1 --2- 172.21.15.123:0/1409546202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe478148f10 0x7fe4780b66d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe47000bee0 tx=0x7fe470004ad0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.765+0000 7fe47cf99700 1 -- 172.21.15.123:0/1409546202 shutdown_connections 2023-03-08T15:49:47.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.765+0000 7fe47cf99700 1 --2- 172.21.15.123:0/1409546202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe478148f10 0x7fe4780b66d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.765+0000 7fe47cf99700 1 --2- 172.21.15.123:0/1409546202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe47806fa10 0x7fe4780bcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.765+0000 7fe47cf99700 1 --2- 172.21.15.123:0/1409546202 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe458069920 0x7fe45806bdd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.765+0000 7fe47cf99700 1 --2- 172.21.15.123:0/1409546202 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe478071660 0x7fe4780bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.765+0000 7fe47cf99700 1 -- 172.21.15.123:0/1409546202 >> 172.21.15.123:0/1409546202 conn(0x7fe47806b360 msgr2=0x7fe478143ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.765+0000 7fe47cf99700 1 -- 172.21.15.123:0/1409546202 shutdown_connections 2023-03-08T15:49:47.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.765+0000 7fe47cf99700 1 -- 172.21.15.123:0/1409546202 wait complete. 2023-03-08T15:49:47.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-03-08T15:49:47.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.767+0000 7fafee27c700 1 -- 172.21.15.123:0/979403112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fafe80b7310 con 0x7fafe80ba280 2023-03-08T15:49:47.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.767+0000 7fafe4ff9700 1 -- 172.21.15.123:0/979403112 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fafe00596c0 con 0x7fafe80ba280 2023-03-08T15:49:47.769 DEBUG:teuthology.parallel:result is None 2023-03-08T15:49:47.770 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-03-08T15:49:47.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.769+0000 7fafee27c700 1 -- 172.21.15.123:0/979403112 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafd40699a0 msgr2=0x7fafd406be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.769+0000 7fafee27c700 1 --2- 172.21.15.123:0/979403112 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafd40699a0 0x7fafd406be50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fafd8000f60 tx=0x7fafd8007a40 comp rx=0 tx=0).stop 2023-03-08T15:49:47.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.769+0000 7fafee27c700 1 -- 172.21.15.123:0/979403112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafe80ba280 msgr2=0x7fafe8145f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.769+0000 7fafee27c700 1 --2- 172.21.15.123:0/979403112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafe80ba280 0x7fafe8145f40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fafe0016000 tx=0x7fafe0004ad0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.770+0000 7fafee27c700 1 -- 172.21.15.123:0/979403112 shutdown_connections 2023-03-08T15:49:47.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.770+0000 7fafee27c700 1 --2- 172.21.15.123:0/979403112 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafd40699a0 0x7fafd406be50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.770+0000 7fafee27c700 1 --2- 172.21.15.123:0/979403112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafe81453b0 0x7fafe80b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.770+0000 7fafee27c700 1 --2- 172.21.15.123:0/979403112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafe8071df0 0x7fafe80b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.770+0000 7fafee27c700 1 --2- 172.21.15.123:0/979403112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafe80ba280 0x7fafe8145f40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.770+0000 7fafee27c700 1 -- 172.21.15.123:0/979403112 >> 172.21.15.123:0/979403112 conn(0x7fafe806b360 msgr2=0x7fafe80b8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.770+0000 7fafee27c700 1 -- 172.21.15.123:0/979403112 shutdown_connections 2023-03-08T15:49:47.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.770+0000 7fafee27c700 1 -- 172.21.15.123:0/979403112 wait complete. 2023-03-08T15:49:47.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-03-08T15:49:47.784 DEBUG:teuthology.parallel:result is None 2023-03-08T15:49:47.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-03-08T15:49:47.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.784+0000 7fc52e317700 1 -- 172.21.15.123:0/1073624863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc5140055c0 con 0x7fc52814c170 2023-03-08T15:49:47.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.784+0000 7fc524ff9700 1 -- 172.21.15.123:0/1073624863 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc520053850 con 0x7fc52814c170 2023-03-08T15:49:47.786 DEBUG:teuthology.parallel:result is None 2023-03-08T15:49:47.786 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2023-03-08T15:49:47.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.786+0000 7fc52e317700 1 -- 172.21.15.123:0/1073624863 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc510069b10 msgr2=0x7fc51006bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.786+0000 7fc52e317700 1 --2- 172.21.15.123:0/1073624863 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc510069b10 0x7fc51006bfc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009c40 tx=0x7fc51c008030 comp rx=0 tx=0).stop 2023-03-08T15:49:47.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.786+0000 7fc52e317700 1 -- 172.21.15.123:0/1073624863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc52814c170 msgr2=0x7fc5280bbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.786+0000 7fc52e317700 1 --2- 172.21.15.123:0/1073624863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc52814c170 0x7fc5280bbca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc52000b780 tx=0x7fc52000bb40 comp rx=0 tx=0).stop 2023-03-08T15:49:47.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.786+0000 7fc52e317700 1 -- 172.21.15.123:0/1073624863 shutdown_connections 2023-03-08T15:49:47.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.786+0000 7fc52e317700 1 --2- 172.21.15.123:0/1073624863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc52814c170 0x7fc5280bbca0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.787+0000 7fc52e317700 1 --2- 172.21.15.123:0/1073624863 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc510069b10 0x7fc51006bfc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.787+0000 7fc52e317700 1 --2- 172.21.15.123:0/1073624863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc52806f0c0 0x7fc5281df360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.787+0000 7fc52e317700 1 --2- 172.21.15.123:0/1073624863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc52806f530 0x7fc5280bcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.787+0000 7fc52e317700 1 -- 172.21.15.123:0/1073624863 >> 172.21.15.123:0/1073624863 conn(0x7fc5280ba3c0 msgr2=0x7fc52814aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.787+0000 7fc52e317700 1 -- 172.21.15.123:0/1073624863 shutdown_connections 2023-03-08T15:49:47.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.787+0000 7fc52e317700 1 -- 172.21.15.123:0/1073624863 wait complete. 2023-03-08T15:49:47.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-03-08T15:49:47.800 DEBUG:teuthology.parallel:result is None 2023-03-08T15:49:47.800 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-03-08T15:49:47.800 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-08T15:49:47.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.958+0000 7fee30113700 1 Processor -- start 2023-03-08T15:49:47.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.958+0000 7fee30113700 1 -- start start 2023-03-08T15:49:47.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.959+0000 7fee30113700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee280b7900 0x7fee28140990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.959+0000 7fee30113700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee2806aee0 0x7fee28140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.959+0000 7fee30113700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee280b59c0 con 0x7fee280b8320 2023-03-08T15:49:47.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.959+0000 7fee30113700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee280b8b10 con 0x7fee280b7900 2023-03-08T15:49:47.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.959+0000 7fee30113700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee280b56e0 con 0x7fee2806aee0 2023-03-08T15:49:47.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.959+0000 7fee2deaf700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee280b7900 0x7fee28140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.959+0000 7fee2e6b0700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fee280b8320 0x7fee28146fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33602/0 (socket says 172.21.15.123:33602) 2023-03-08T15:49:47.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.959+0000 7fee2e6b0700 1 -- 172.21.15.123:0/3752034697 learned_addr learned my addr 172.21.15.123:0/3752034697 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:47.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.959+0000 7fee2d6ae700 1 --2- 172.21.15.123:0/3752034697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee2806aee0 0x7fee28140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.959+0000 7fee2deaf700 1 -- 172.21.15.123:0/3752034697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee2806aee0 msgr2=0x7fee28140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:47.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.959+0000 7fee2deaf700 1 --2- 172.21.15.123:0/3752034697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee2806aee0 0x7fee28140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.959+0000 7fee2deaf700 1 -- 172.21.15.123:0/3752034697 >> v1:172.21.15.123:6789/0 conn(0x7fee280b8320 legacy=0x7fee28146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.959+0000 7fee2deaf700 1 -- 172.21.15.123:0/3752034697 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee280b7cd0 con 0x7fee280b7900 2023-03-08T15:49:47.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.959+0000 7fee2cead700 1 -- 172.21.15.123:0/3752034697 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097266068 0 0) 0x7fee280b59c0 con 0x7fee280b8320 2023-03-08T15:49:47.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.960+0000 7fee2d6ae700 1 --2- 172.21.15.123:0/3752034697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee2806aee0 0x7fee28140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:49:47.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.960+0000 7fee2deaf700 1 --2- 172.21.15.123:0/3752034697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee280b7900 0x7fee28140990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fee18009840 tx=0x7fee18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31dca3d651c6123 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.960+0000 7fee2cead700 1 -- 172.21.15.123:0/3752034697 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee18011830 con 0x7fee280b7900 2023-03-08T15:49:47.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.960+0000 7fee2cead700 1 -- 172.21.15.123:0/3752034697 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee18011990 con 0x7fee280b7900 2023-03-08T15:49:47.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.960+0000 7fee2cead700 1 -- 172.21.15.123:0/3752034697 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee18011d20 con 0x7fee280b7900 2023-03-08T15:49:47.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.960+0000 7fee30113700 1 -- 172.21.15.123:0/3752034697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee280b7900 msgr2=0x7fee28140990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.960+0000 7fee30113700 1 --2- 172.21.15.123:0/3752034697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee280b7900 0x7fee28140990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fee18009840 tx=0x7fee18009b50 comp rx=0 tx=0).stop 2023-03-08T15:49:47.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.960+0000 7fee30113700 1 -- 172.21.15.123:0/3752034697 shutdown_connections 2023-03-08T15:49:47.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.960+0000 7fee30113700 1 --2- 172.21.15.123:0/3752034697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee280b7900 0x7fee28140990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.960+0000 7fee30113700 1 --2- 172.21.15.123:0/3752034697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee2806aee0 0x7fee28140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.960+0000 7fee30113700 1 -- 172.21.15.123:0/3752034697 >> 172.21.15.123:0/3752034697 conn(0x7fee280bc480 msgr2=0x7fee280bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:47.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.960+0000 7fee30113700 1 -- 172.21.15.123:0/3752034697 shutdown_connections 2023-03-08T15:49:47.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.960+0000 7fee30113700 1 -- 172.21.15.123:0/3752034697 wait complete. 2023-03-08T15:49:47.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.961+0000 7fee30113700 1 Processor -- start 2023-03-08T15:49:47.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.961+0000 7fee30113700 1 -- start start 2023-03-08T15:49:47.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee30113700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee2806aee0 0x7fee28143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee30113700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee280b7900 0x7fee281ddec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee30113700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee280b8320 0x7fee281de400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee30113700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee281ddaa0 con 0x7fee280b8320 2023-03-08T15:49:47.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee30113700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee28141bb0 con 0x7fee280b7900 2023-03-08T15:49:47.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee30113700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee28141ee0 con 0x7fee2806aee0 2023-03-08T15:49:47.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee2e6b0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee280b8320 0x7fee281de400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee2e6b0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee280b8320 0x7fee281de400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36854/0 (socket says 172.21.15.123:36854) 2023-03-08T15:49:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee2e6b0700 1 -- 172.21.15.123:0/719097348 learned_addr learned my addr 172.21.15.123:0/719097348 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee2deaf700 1 --2- 172.21.15.123:0/719097348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee2806aee0 0x7fee28143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee2e6b0700 1 -- 172.21.15.123:0/719097348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee2806aee0 msgr2=0x7fee28143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee2e6b0700 1 --2- 172.21.15.123:0/719097348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee2806aee0 0x7fee28143230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee2e6b0700 1 -- 172.21.15.123:0/719097348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee280b7900 msgr2=0x7fee281ddec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee2e6b0700 1 --2- 172.21.15.123:0/719097348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee280b7900 0x7fee281ddec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:47.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee2e6b0700 1 -- 172.21.15.123:0/719097348 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee180094a0 con 0x7fee280b8320 2023-03-08T15:49:47.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee2deaf700 1 --2- 172.21.15.123:0/719097348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee2806aee0 0x7fee28143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:49:47.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.962+0000 7fee2e6b0700 1 --2- 172.21.15.123:0/719097348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee280b8320 0x7fee281de400 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee2000cb60 tx=0x7fee2000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.963+0000 7fee1e7fc700 1 -- 172.21.15.123:0/719097348 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2000ab50 con 0x7fee280b8320 2023-03-08T15:49:47.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.963+0000 7fee1e7fc700 1 -- 172.21.15.123:0/719097348 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2000acb0 con 0x7fee280b8320 2023-03-08T15:49:47.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.963+0000 7fee30113700 1 -- 172.21.15.123:0/719097348 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee280bd360 con 0x7fee280b8320 2023-03-08T15:49:47.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.963+0000 7fee1e7fc700 1 -- 172.21.15.123:0/719097348 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20007310 con 0x7fee280b8320 2023-03-08T15:49:47.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.963+0000 7fee30113700 1 -- 172.21.15.123:0/719097348 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee280bd1d0 con 0x7fee280b8320 2023-03-08T15:49:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.963+0000 7fee30113700 1 -- 172.21.15.123:0/719097348 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee281476e0 con 0x7fee280b8320 2023-03-08T15:49:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.964+0000 7fee1e7fc700 1 -- 172.21.15.123:0/719097348 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fee20010070 con 0x7fee280b8320 2023-03-08T15:49:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.965+0000 7fee1e7fc700 1 --2- 172.21.15.123:0/719097348 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee0c0698d0 0x7fee0c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.965+0000 7fee1e7fc700 1 -- 172.21.15.123:0/719097348 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee20087400 con 0x7fee280b8320 2023-03-08T15:49:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.965+0000 7fee2deaf700 1 --2- 172.21.15.123:0/719097348 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee0c0698d0 0x7fee0c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.965+0000 7fee2deaf700 1 --2- 172.21.15.123:0/719097348 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee0c0698d0 0x7fee0c06bd80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fee180090b0 tx=0x7fee18008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:47.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:47.968+0000 7fee1e7fc700 1 -- 172.21.15.123:0/719097348 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fee20053270 con 0x7fee280b8320 2023-03-08T15:49:48.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.151+0000 7fee30113700 1 -- 172.21.15.123:0/719097348 --> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fee280b61f0 con 0x7fee0c0698d0 2023-03-08T15:49:48.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.158+0000 7fee1e7fc700 1 -- 172.21.15.123:0/719097348 <== mgr.4098 v2:172.21.15.123:6832/142884 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286597 (secure 0 0 0) 0x7fee280b61f0 con 0x7fee0c0698d0 2023-03-08T15:49:48.162 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:48.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.161+0000 7fee30113700 1 -- 172.21.15.123:0/719097348 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee0c0698d0 msgr2=0x7fee0c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:48.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.161+0000 7fee30113700 1 --2- 172.21.15.123:0/719097348 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee0c0698d0 0x7fee0c06bd80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fee180090b0 tx=0x7fee18008030 comp rx=0 tx=0).stop 2023-03-08T15:49:48.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.161+0000 7fee30113700 1 -- 172.21.15.123:0/719097348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee280b8320 msgr2=0x7fee281de400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:48.164 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.161+0000 7fee30113700 1 --2- 172.21.15.123:0/719097348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee280b8320 0x7fee281de400 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee2000cb60 tx=0x7fee2000cf20 comp rx=0 tx=0).stop 2023-03-08T15:49:48.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.161+0000 7fee30113700 1 -- 172.21.15.123:0/719097348 shutdown_connections 2023-03-08T15:49:48.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.161+0000 7fee30113700 1 --2- 172.21.15.123:0/719097348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee280b8320 0x7fee281de400 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.162+0000 7fee30113700 1 --2- 172.21.15.123:0/719097348 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee0c0698d0 0x7fee0c06bd80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.162+0000 7fee30113700 1 --2- 172.21.15.123:0/719097348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee2806aee0 0x7fee28143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.162+0000 7fee30113700 1 --2- 172.21.15.123:0/719097348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee280b7900 0x7fee281ddec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.162+0000 7fee30113700 1 -- 172.21.15.123:0/719097348 >> 172.21.15.123:0/719097348 conn(0x7fee280bc480 msgr2=0x7fee280b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:48.165 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.162+0000 7fee30113700 1 -- 172.21.15.123:0/719097348 shutdown_connections 2023-03-08T15:49:48.166 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.162+0000 7fee30113700 1 -- 172.21.15.123:0/719097348 wait complete. 2023-03-08T15:49:48.166 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-03-08T15:49:48.175 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-03-08T15:49:47.974578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66280,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908440,"statfs":{"total":773094113280,"available":773026242560,"internally_reserved":0,"allocated":3186688,"data_stored":1902188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.483891"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515200+0000","last_change":"2023-03-08T15:49:39.500574+0000","last_active":"2023-03-08T15:49:40.515200+0000","last_peered":"2023-03-08T15:49:40.515200+0000","last_clean":"2023-03-08T15:49:40.515200+0000","last_became_active":"2023-03-08T15:49:39.500324+0000","last_became_peered":"2023-03-08T15:49:39.500324+0000","last_unstale":"2023-03-08T15:49:40.515200+0000","last_undegraded":"2023-03-08T15:49:40.515200+0000","last_fullsized":"2023-03-08T15:49:40.515200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:54.873584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516498+0000","last_change":"2023-03-08T15:49:39.510529+0000","last_active":"2023-03-08T15:49:40.516498+0000","last_peered":"2023-03-08T15:49:40.516498+0000","last_clean":"2023-03-08T15:49:40.516498+0000","last_became_active":"2023-03-08T15:49:39.510227+0000","last_became_peered":"2023-03-08T15:49:39.510227+0000","last_unstale":"2023-03-08T15:49:40.516498+0000","last_undegraded":"2023-03-08T15:49:40.516498+0000","last_fullsized":"2023-03-08T15:49:40.516498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498504+0000","last_change":"2023-03-08T15:49:39.507276+0000","last_active":"2023-03-08T15:49:40.498504+0000","last_peered":"2023-03-08T15:49:40.498504+0000","last_clean":"2023-03-08T15:49:40.498504+0000","last_became_active":"2023-03-08T15:49:39.506954+0000","last_became_peered":"2023-03-08T15:49:39.506954+0000","last_unstale":"2023-03-08T15:49:40.498504+0000","last_undegraded":"2023-03-08T15:49:40.498504+0000","last_fullsized":"2023-03-08T15:49:40.498504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516428+0000","last_change":"2023-03-08T15:49:39.511677+0000","last_active":"2023-03-08T15:49:40.516428+0000","last_peered":"2023-03-08T15:49:40.516428+0000","last_clean":"2023-03-08T15:49:40.516428+0000","last_became_active":"2023-03-08T15:49:39.508018+0000","last_became_peered":"2023-03-08T15:49:39.508018+0000","last_unstale":"2023-03-08T15:49:40.516428+0000","last_undegraded":"2023-03-08T15:49:40.516428+0000","last_fullsized":"2023-03-08T15:49:40.516428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:08:10.089458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515126+0000","last_change":"2023-03-08T15:49:39.509835+0000","last_active":"2023-03-08T15:49:40.515126+0000","last_peered":"2023-03-08T15:49:40.515126+0000","last_clean":"2023-03-08T15:49:40.515126+0000","last_became_active":"2023-03-08T15:49:39.507785+0000","last_became_peered":"2023-03-08T15:49:39.507785+0000","last_unstale":"2023-03-08T15:49:40.515126+0000","last_undegraded":"2023-03-08T15:49:40.515126+0000","last_fullsized":"2023-03-08T15:49:40.515126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:41:05.974121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498456+0000","last_change":"2023-03-08T15:49:39.514008+0000","last_active":"2023-03-08T15:49:40.498456+0000","last_peered":"2023-03-08T15:49:40.498456+0000","last_clean":"2023-03-08T15:49:40.498456+0000","last_became_active":"2023-03-08T15:49:39.508486+0000","last_became_peered":"2023-03-08T15:49:39.508486+0000","last_unstale":"2023-03-08T15:49:40.498456+0000","last_undegraded":"2023-03-08T15:49:40.498456+0000","last_fullsized":"2023-03-08T15:49:40.498456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:00:34.312638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515812+0000","last_change":"2023-03-08T15:49:39.517513+0000","last_active":"2023-03-08T15:49:40.515812+0000","last_peered":"2023-03-08T15:49:40.515812+0000","last_clean":"2023-03-08T15:49:40.515812+0000","last_became_active":"2023-03-08T15:49:39.517157+0000","last_became_peered":"2023-03-08T15:49:39.517157+0000","last_unstale":"2023-03-08T15:49:40.515812+0000","last_undegraded":"2023-03-08T15:49:40.515812+0000","last_fullsized":"2023-03-08T15:49:40.515812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515450+0000","last_change":"2023-03-08T15:49:39.515299+0000","last_active":"2023-03-08T15:49:40.515450+0000","last_peered":"2023-03-08T15:49:40.515450+0000","last_clean":"2023-03-08T15:49:40.515450+0000","last_became_active":"2023-03-08T15:49:39.515005+0000","last_became_peered":"2023-03-08T15:49:39.515005+0000","last_unstale":"2023-03-08T15:49:40.515450+0000","last_undegraded":"2023-03-08T15:49:40.515450+0000","last_fullsized":"2023-03-08T15:49:40.515450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:07:36.774920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515469+0000","last_change":"2023-03-08T15:49:39.511832+0000","last_active":"2023-03-08T15:49:40.515469+0000","last_peered":"2023-03-08T15:49:40.515469+0000","last_clean":"2023-03-08T15:49:40.515469+0000","last_became_active":"2023-03-08T15:49:39.511580+0000","last_became_peered":"2023-03-08T15:49:39.511580+0000","last_unstale":"2023-03-08T15:49:40.515469+0000","last_undegraded":"2023-03-08T15:49:40.515469+0000","last_fullsized":"2023-03-08T15:49:40.515469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516671+0000","last_change":"2023-03-08T15:49:39.509905+0000","last_active":"2023-03-08T15:49:40.516671+0000","last_peered":"2023-03-08T15:49:40.516671+0000","last_clean":"2023-03-08T15:49:40.516671+0000","last_became_active":"2023-03-08T15:49:39.509656+0000","last_became_peered":"2023-03-08T15:49:39.509656+0000","last_unstale":"2023-03-08T15:49:40.516671+0000","last_undegraded":"2023-03-08T15:49:40.516671+0000","last_fullsized":"2023-03-08T15:49:40.516671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:02:38.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498546+0000","last_change":"2023-03-08T15:49:39.512652+0000","last_active":"2023-03-08T15:49:40.498546+0000","last_peered":"2023-03-08T15:49:40.498546+0000","last_clean":"2023-03-08T15:49:40.498546+0000","last_became_active":"2023-03-08T15:49:39.512339+0000","last_became_peered":"2023-03-08T15:49:39.512339+0000","last_unstale":"2023-03-08T15:49:40.498546+0000","last_undegraded":"2023-03-08T15:49:40.498546+0000","last_fullsized":"2023-03-08T15:49:40.498546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515136+0000","last_change":"2023-03-08T15:49:39.501468+0000","last_active":"2023-03-08T15:49:40.515136+0000","last_peered":"2023-03-08T15:49:40.515136+0000","last_clean":"2023-03-08T15:49:40.515136+0000","last_became_active":"2023-03-08T15:49:39.501217+0000","last_became_peered":"2023-03-08T15:49:39.501217+0000","last_unstale":"2023-03-08T15:49:40.515136+0000","last_undegraded":"2023-03-08T15:49:40.515136+0000","last_fullsized":"2023-03-08T15:49:40.515136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:04.540991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515081+0000","last_change":"2023-03-08T15:49:39.500058+0000","last_active":"2023-03-08T15:49:40.515081+0000","last_peered":"2023-03-08T15:49:40.515081+0000","last_clean":"2023-03-08T15:49:40.515081+0000","last_became_active":"2023-03-08T15:49:39.499799+0000","last_became_peered":"2023-03-08T15:49:39.499799+0000","last_unstale":"2023-03-08T15:49:40.515081+0000","last_undegraded":"2023-03-08T15:49:40.515081+0000","last_fullsized":"2023-03-08T15:49:40.515081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:22.868366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516068+0000","last_change":"2023-03-08T15:49:39.509813+0000","last_active":"2023-03-08T15:49:40.516068+0000","last_peered":"2023-03-08T15:49:40.516068+0000","last_clean":"2023-03-08T15:49:40.516068+0000","last_became_active":"2023-03-08T15:49:39.509515+0000","last_became_peered":"2023-03-08T15:49:39.509515+0000","last_unstale":"2023-03-08T15:49:40.516068+0000","last_undegraded":"2023-03-08T15:49:40.516068+0000","last_fullsized":"2023-03-08T15:49:40.516068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516019+0000","last_change":"2023-03-08T15:49:39.517988+0000","last_active":"2023-03-08T15:49:40.516019+0000","last_peered":"2023-03-08T15:49:40.516019+0000","last_clean":"2023-03-08T15:49:40.516019+0000","last_became_active":"2023-03-08T15:49:39.517729+0000","last_became_peered":"2023-03-08T15:49:39.517729+0000","last_unstale":"2023-03-08T15:49:40.516019+0000","last_undegraded":"2023-03-08T15:49:40.516019+0000","last_fullsized":"2023-03-08T15:49:40.516019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498160+0000","last_change":"2023-03-08T15:49:39.507303+0000","last_active":"2023-03-08T15:49:40.498160+0000","last_peered":"2023-03-08T15:49:40.498160+0000","last_clean":"2023-03-08T15:49:40.498160+0000","last_became_active":"2023-03-08T15:49:39.506847+0000","last_became_peered":"2023-03-08T15:49:39.506847+0000","last_unstale":"2023-03-08T15:49:40.498160+0000","last_undegraded":"2023-03-08T15:49:40.498160+0000","last_fullsized":"2023-03-08T15:49:40.498160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:55:21.101920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515522+0000","last_change":"2023-03-08T15:49:39.511674+0000","last_active":"2023-03-08T15:49:40.515522+0000","last_peered":"2023-03-08T15:49:40.515522+0000","last_clean":"2023-03-08T15:49:40.515522+0000","last_became_active":"2023-03-08T15:49:39.511293+0000","last_became_peered":"2023-03-08T15:49:39.511293+0000","last_unstale":"2023-03-08T15:49:40.515522+0000","last_undegraded":"2023-03-08T15:49:40.515522+0000","last_fullsized":"2023-03-08T15:49:40.515522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:15:10.927104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498599+0000","last_change":"2023-03-08T15:49:39.507528+0000","last_active":"2023-03-08T15:49:40.498599+0000","last_peered":"2023-03-08T15:49:40.498599+0000","last_clean":"2023-03-08T15:49:40.498599+0000","last_became_active":"2023-03-08T15:49:39.507193+0000","last_became_peered":"2023-03-08T15:49:39.507193+0000","last_unstale":"2023-03-08T15:49:40.498599+0000","last_undegraded":"2023-03-08T15:49:40.498599+0000","last_fullsized":"2023-03-08T15:49:40.498599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:09:02.915110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515398+0000","last_change":"2023-03-08T15:49:39.503980+0000","last_active":"2023-03-08T15:49:40.515398+0000","last_peered":"2023-03-08T15:49:40.515398+0000","last_clean":"2023-03-08T15:49:40.515398+0000","last_became_active":"2023-03-08T15:49:39.503703+0000","last_became_peered":"2023-03-08T15:49:39.503703+0000","last_unstale":"2023-03-08T15:49:40.515398+0000","last_undegraded":"2023-03-08T15:49:40.515398+0000","last_fullsized":"2023-03-08T15:49:40.515398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:45.599141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498726+0000","last_change":"2023-03-08T15:49:39.505726+0000","last_active":"2023-03-08T15:49:40.498726+0000","last_peered":"2023-03-08T15:49:40.498726+0000","last_clean":"2023-03-08T15:49:40.498726+0000","last_became_active":"2023-03-08T15:49:39.505103+0000","last_became_peered":"2023-03-08T15:49:39.505103+0000","last_unstale":"2023-03-08T15:49:40.498726+0000","last_undegraded":"2023-03-08T15:49:40.498726+0000","last_fullsized":"2023-03-08T15:49:40.498726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:01:00.216256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516218+0000","last_change":"2023-03-08T15:49:39.520100+0000","last_active":"2023-03-08T15:49:40.516218+0000","last_peered":"2023-03-08T15:49:40.516218+0000","last_clean":"2023-03-08T15:49:40.516218+0000","last_became_active":"2023-03-08T15:49:39.519799+0000","last_became_peered":"2023-03-08T15:49:39.519799+0000","last_unstale":"2023-03-08T15:49:40.516218+0000","last_undegraded":"2023-03-08T15:49:40.516218+0000","last_fullsized":"2023-03-08T15:49:40.516218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515704+0000","last_change":"2023-03-08T15:49:39.513354+0000","last_active":"2023-03-08T15:49:40.515704+0000","last_peered":"2023-03-08T15:49:40.515704+0000","last_clean":"2023-03-08T15:49:40.515704+0000","last_became_active":"2023-03-08T15:49:39.513104+0000","last_became_peered":"2023-03-08T15:49:39.513104+0000","last_unstale":"2023-03-08T15:49:40.515704+0000","last_undegraded":"2023-03-08T15:49:40.515704+0000","last_fullsized":"2023-03-08T15:49:40.515704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497212+0000","last_change":"2023-03-08T15:49:39.505113+0000","last_active":"2023-03-08T15:49:40.497212+0000","last_peered":"2023-03-08T15:49:40.497212+0000","last_clean":"2023-03-08T15:49:40.497212+0000","last_became_active":"2023-03-08T15:49:39.504875+0000","last_became_peered":"2023-03-08T15:49:39.504875+0000","last_unstale":"2023-03-08T15:49:40.497212+0000","last_undegraded":"2023-03-08T15:49:40.497212+0000","last_fullsized":"2023-03-08T15:49:40.497212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:03:30.032957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516293+0000","last_change":"2023-03-08T15:49:39.520457+0000","last_active":"2023-03-08T15:49:40.516293+0000","last_peered":"2023-03-08T15:49:40.516293+0000","last_clean":"2023-03-08T15:49:40.516293+0000","last_became_active":"2023-03-08T15:49:39.520170+0000","last_became_peered":"2023-03-08T15:49:39.520170+0000","last_unstale":"2023-03-08T15:49:40.516293+0000","last_undegraded":"2023-03-08T15:49:40.516293+0000","last_fullsized":"2023-03-08T15:49:40.516293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499040+0000","last_change":"2023-03-08T15:49:39.505287+0000","last_active":"2023-03-08T15:49:40.499040+0000","last_peered":"2023-03-08T15:49:40.499040+0000","last_clean":"2023-03-08T15:49:40.499040+0000","last_became_active":"2023-03-08T15:49:39.505030+0000","last_became_peered":"2023-03-08T15:49:39.505030+0000","last_unstale":"2023-03-08T15:49:40.499040+0000","last_undegraded":"2023-03-08T15:49:40.499040+0000","last_fullsized":"2023-03-08T15:49:40.499040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:42:50.682185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499114+0000","last_change":"2023-03-08T15:49:39.509614+0000","last_active":"2023-03-08T15:49:40.499114+0000","last_peered":"2023-03-08T15:49:40.499114+0000","last_clean":"2023-03-08T15:49:40.499114+0000","last_became_active":"2023-03-08T15:49:39.509049+0000","last_became_peered":"2023-03-08T15:49:39.509049+0000","last_unstale":"2023-03-08T15:49:40.499114+0000","last_undegraded":"2023-03-08T15:49:40.499114+0000","last_fullsized":"2023-03-08T15:49:40.499114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516066+0000","last_change":"2023-03-08T15:49:39.518389+0000","last_active":"2023-03-08T15:49:40.516066+0000","last_peered":"2023-03-08T15:49:40.516066+0000","last_clean":"2023-03-08T15:49:40.516066+0000","last_became_active":"2023-03-08T15:49:39.518107+0000","last_became_peered":"2023-03-08T15:49:39.518107+0000","last_unstale":"2023-03-08T15:49:40.516066+0000","last_undegraded":"2023-03-08T15:49:40.516066+0000","last_fullsized":"2023-03-08T15:49:40.516066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498736+0000","last_change":"2023-03-08T15:49:39.076740+0000","last_active":"2023-03-08T15:49:40.498736+0000","last_peered":"2023-03-08T15:49:40.498736+0000","last_clean":"2023-03-08T15:49:40.498736+0000","last_became_active":"2023-03-08T15:49:39.075420+0000","last_became_peered":"2023-03-08T15:49:39.075420+0000","last_unstale":"2023-03-08T15:49:40.498736+0000","last_undegraded":"2023-03-08T15:49:40.498736+0000","last_fullsized":"2023-03-08T15:49:40.498736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:39:52.448950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497861+0000","last_change":"2023-03-08T15:49:39.506581+0000","last_active":"2023-03-08T15:49:40.497861+0000","last_peered":"2023-03-08T15:49:40.497861+0000","last_clean":"2023-03-08T15:49:40.497861+0000","last_became_active":"2023-03-08T15:49:39.505867+0000","last_became_peered":"2023-03-08T15:49:39.505867+0000","last_unstale":"2023-03-08T15:49:40.497861+0000","last_undegraded":"2023-03-08T15:49:40.497861+0000","last_fullsized":"2023-03-08T15:49:40.497861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:41:05.974121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498634+0000","last_change":"2023-03-08T15:49:39.064465+0000","last_active":"2023-03-08T15:49:40.498634+0000","last_peered":"2023-03-08T15:49:40.498634+0000","last_clean":"2023-03-08T15:49:40.498634+0000","last_became_active":"2023-03-08T15:49:39.064180+0000","last_became_peered":"2023-03-08T15:49:39.064180+0000","last_unstale":"2023-03-08T15:49:40.498634+0000","last_undegraded":"2023-03-08T15:49:40.498634+0000","last_fullsized":"2023-03-08T15:49:40.498634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515371+0000","last_change":"2023-03-08T15:49:39.517781+0000","last_active":"2023-03-08T15:49:40.515371+0000","last_peered":"2023-03-08T15:49:40.515371+0000","last_clean":"2023-03-08T15:49:40.515371+0000","last_became_active":"2023-03-08T15:49:39.517522+0000","last_became_peered":"2023-03-08T15:49:39.517522+0000","last_unstale":"2023-03-08T15:49:40.515371+0000","last_undegraded":"2023-03-08T15:49:40.515371+0000","last_fullsized":"2023-03-08T15:49:40.515371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:59:37.837477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497190+0000","last_change":"2023-03-08T15:49:39.073238+0000","last_active":"2023-03-08T15:49:40.497190+0000","last_peered":"2023-03-08T15:49:40.497190+0000","last_clean":"2023-03-08T15:49:40.497190+0000","last_became_active":"2023-03-08T15:49:39.072946+0000","last_became_peered":"2023-03-08T15:49:39.072946+0000","last_unstale":"2023-03-08T15:49:40.497190+0000","last_undegraded":"2023-03-08T15:49:40.497190+0000","last_fullsized":"2023-03-08T15:49:40.497190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:07:57.155564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516703+0000","last_change":"2023-03-08T15:49:39.511074+0000","last_active":"2023-03-08T15:49:40.516703+0000","last_peered":"2023-03-08T15:49:40.516703+0000","last_clean":"2023-03-08T15:49:40.516703+0000","last_became_active":"2023-03-08T15:49:39.510818+0000","last_became_peered":"2023-03-08T15:49:39.510818+0000","last_unstale":"2023-03-08T15:49:40.516703+0000","last_undegraded":"2023-03-08T15:49:40.516703+0000","last_fullsized":"2023-03-08T15:49:40.516703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:04.540991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515561+0000","last_change":"2023-03-08T15:49:39.070465+0000","last_active":"2023-03-08T15:49:40.515561+0000","last_peered":"2023-03-08T15:49:40.515561+0000","last_clean":"2023-03-08T15:49:40.515561+0000","last_became_active":"2023-03-08T15:49:39.069996+0000","last_became_peered":"2023-03-08T15:49:39.069996+0000","last_unstale":"2023-03-08T15:49:40.515561+0000","last_undegraded":"2023-03-08T15:49:40.515561+0000","last_fullsized":"2023-03-08T15:49:40.515561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:53.868715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497272+0000","last_change":"2023-03-08T15:49:39.506567+0000","last_active":"2023-03-08T15:49:40.497272+0000","last_peered":"2023-03-08T15:49:40.497272+0000","last_clean":"2023-03-08T15:49:40.497272+0000","last_became_active":"2023-03-08T15:49:39.506069+0000","last_became_peered":"2023-03-08T15:49:39.506069+0000","last_unstale":"2023-03-08T15:49:40.497272+0000","last_undegraded":"2023-03-08T15:49:40.497272+0000","last_fullsized":"2023-03-08T15:49:40.497272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:02:38.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516579+0000","last_change":"2023-03-08T15:49:39.071437+0000","last_active":"2023-03-08T15:49:40.516579+0000","last_peered":"2023-03-08T15:49:40.516579+0000","last_clean":"2023-03-08T15:49:40.516579+0000","last_became_active":"2023-03-08T15:49:39.071152+0000","last_became_peered":"2023-03-08T15:49:39.071152+0000","last_unstale":"2023-03-08T15:49:40.516579+0000","last_undegraded":"2023-03-08T15:49:40.516579+0000","last_fullsized":"2023-03-08T15:49:40.516579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:21.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497294+0000","last_change":"2023-03-08T15:49:39.517658+0000","last_active":"2023-03-08T15:49:40.497294+0000","last_peered":"2023-03-08T15:49:40.497294+0000","last_clean":"2023-03-08T15:49:40.497294+0000","last_became_active":"2023-03-08T15:49:39.517399+0000","last_became_peered":"2023-03-08T15:49:39.517399+0000","last_unstale":"2023-03-08T15:49:40.497294+0000","last_undegraded":"2023-03-08T15:49:40.497294+0000","last_fullsized":"2023-03-08T15:49:40.497294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:07:36.774920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516663+0000","last_change":"2023-03-08T15:49:39.067519+0000","last_active":"2023-03-08T15:49:40.516663+0000","last_peered":"2023-03-08T15:49:40.516663+0000","last_clean":"2023-03-08T15:49:40.516663+0000","last_became_active":"2023-03-08T15:49:39.067254+0000","last_became_peered":"2023-03-08T15:49:39.067254+0000","last_unstale":"2023-03-08T15:49:40.516663+0000","last_undegraded":"2023-03-08T15:49:40.516663+0000","last_fullsized":"2023-03-08T15:49:40.516663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498632+0000","last_change":"2023-03-08T15:49:39.504530+0000","last_active":"2023-03-08T15:49:40.498632+0000","last_peered":"2023-03-08T15:49:40.498632+0000","last_clean":"2023-03-08T15:49:40.498632+0000","last_became_active":"2023-03-08T15:49:39.504282+0000","last_became_peered":"2023-03-08T15:49:39.504282+0000","last_unstale":"2023-03-08T15:49:40.498632+0000","last_undegraded":"2023-03-08T15:49:40.498632+0000","last_fullsized":"2023-03-08T15:49:40.498632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:11:06.014260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498452+0000","last_change":"2023-03-08T15:49:39.077464+0000","last_active":"2023-03-08T15:49:40.498452+0000","last_peered":"2023-03-08T15:49:40.498452+0000","last_clean":"2023-03-08T15:49:40.498452+0000","last_became_active":"2023-03-08T15:49:39.077166+0000","last_became_peered":"2023-03-08T15:49:39.077166+0000","last_unstale":"2023-03-08T15:49:40.498452+0000","last_undegraded":"2023-03-08T15:49:40.498452+0000","last_fullsized":"2023-03-08T15:49:40.498452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498301+0000","last_change":"2023-03-08T15:49:39.503655+0000","last_active":"2023-03-08T15:49:40.498301+0000","last_peered":"2023-03-08T15:49:40.498301+0000","last_clean":"2023-03-08T15:49:40.498301+0000","last_became_active":"2023-03-08T15:49:39.503231+0000","last_became_peered":"2023-03-08T15:49:39.503231+0000","last_unstale":"2023-03-08T15:49:40.498301+0000","last_undegraded":"2023-03-08T15:49:40.498301+0000","last_fullsized":"2023-03-08T15:49:40.498301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:17:21.576214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516115+0000","last_change":"2023-03-08T15:49:39.079358+0000","last_active":"2023-03-08T15:49:40.516115+0000","last_peered":"2023-03-08T15:49:40.516115+0000","last_clean":"2023-03-08T15:49:40.516115+0000","last_became_active":"2023-03-08T15:49:39.079094+0000","last_became_peered":"2023-03-08T15:49:39.079094+0000","last_unstale":"2023-03-08T15:49:40.516115+0000","last_undegraded":"2023-03-08T15:49:40.516115+0000","last_fullsized":"2023-03-08T15:49:40.516115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:03.536123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497687+0000","last_change":"2023-03-08T15:49:39.506844+0000","last_active":"2023-03-08T15:49:40.497687+0000","last_peered":"2023-03-08T15:49:40.497687+0000","last_clean":"2023-03-08T15:49:40.497687+0000","last_became_active":"2023-03-08T15:49:39.506035+0000","last_became_peered":"2023-03-08T15:49:39.506035+0000","last_unstale":"2023-03-08T15:49:40.497687+0000","last_undegraded":"2023-03-08T15:49:40.497687+0000","last_fullsized":"2023-03-08T15:49:40.497687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515656+0000","last_change":"2023-03-08T15:49:39.072231+0000","last_active":"2023-03-08T15:49:40.515656+0000","last_peered":"2023-03-08T15:49:40.515656+0000","last_clean":"2023-03-08T15:49:40.515656+0000","last_became_active":"2023-03-08T15:49:39.071935+0000","last_became_peered":"2023-03-08T15:49:39.071935+0000","last_unstale":"2023-03-08T15:49:40.515656+0000","last_undegraded":"2023-03-08T15:49:40.515656+0000","last_fullsized":"2023-03-08T15:49:40.515656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:21.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516172+0000","last_change":"2023-03-08T15:49:39.518337+0000","last_active":"2023-03-08T15:49:40.516172+0000","last_peered":"2023-03-08T15:49:40.516172+0000","last_clean":"2023-03-08T15:49:40.516172+0000","last_became_active":"2023-03-08T15:49:39.517689+0000","last_became_peered":"2023-03-08T15:49:39.517689+0000","last_unstale":"2023-03-08T15:49:40.516172+0000","last_undegraded":"2023-03-08T15:49:40.516172+0000","last_fullsized":"2023-03-08T15:49:40.516172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515907+0000","last_change":"2023-03-08T15:49:39.076491+0000","last_active":"2023-03-08T15:49:40.515907+0000","last_peered":"2023-03-08T15:49:40.515907+0000","last_clean":"2023-03-08T15:49:40.515907+0000","last_became_active":"2023-03-08T15:49:39.076238+0000","last_became_peered":"2023-03-08T15:49:39.076238+0000","last_unstale":"2023-03-08T15:49:40.515907+0000","last_undegraded":"2023-03-08T15:49:40.515907+0000","last_fullsized":"2023-03-08T15:49:40.515907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:13:15.662118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515323+0000","last_change":"2023-03-08T15:49:39.508617+0000","last_active":"2023-03-08T15:49:40.515323+0000","last_peered":"2023-03-08T15:49:40.515323+0000","last_clean":"2023-03-08T15:49:40.515323+0000","last_became_active":"2023-03-08T15:49:39.508246+0000","last_became_peered":"2023-03-08T15:49:39.508246+0000","last_unstale":"2023-03-08T15:49:40.515323+0000","last_undegraded":"2023-03-08T15:49:40.515323+0000","last_fullsized":"2023-03-08T15:49:40.515323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:07:36.774920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515652+0000","last_change":"2023-03-08T15:49:39.072472+0000","last_active":"2023-03-08T15:49:40.515652+0000","last_peered":"2023-03-08T15:49:40.515652+0000","last_clean":"2023-03-08T15:49:40.515652+0000","last_became_active":"2023-03-08T15:49:39.072182+0000","last_became_peered":"2023-03-08T15:49:39.072182+0000","last_unstale":"2023-03-08T15:49:40.515652+0000","last_undegraded":"2023-03-08T15:49:40.515652+0000","last_fullsized":"2023-03-08T15:49:40.515652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:02:08.526616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498081+0000","last_change":"2023-03-08T15:49:39.517141+0000","last_active":"2023-03-08T15:49:40.498081+0000","last_peered":"2023-03-08T15:49:40.498081+0000","last_clean":"2023-03-08T15:49:40.498081+0000","last_became_active":"2023-03-08T15:49:39.516875+0000","last_became_peered":"2023-03-08T15:49:39.516875+0000","last_unstale":"2023-03-08T15:49:40.498081+0000","last_undegraded":"2023-03-08T15:49:40.498081+0000","last_fullsized":"2023-03-08T15:49:40.498081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515921+0000","last_change":"2023-03-08T15:49:39.072643+0000","last_active":"2023-03-08T15:49:40.515921+0000","last_peered":"2023-03-08T15:49:40.515921+0000","last_clean":"2023-03-08T15:49:40.515921+0000","last_became_active":"2023-03-08T15:49:39.072348+0000","last_became_peered":"2023-03-08T15:49:39.072348+0000","last_unstale":"2023-03-08T15:49:40.515921+0000","last_undegraded":"2023-03-08T15:49:40.515921+0000","last_fullsized":"2023-03-08T15:49:40.515921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:08:09.084589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515584+0000","last_change":"2023-03-08T15:49:39.518066+0000","last_active":"2023-03-08T15:49:40.515584+0000","last_peered":"2023-03-08T15:49:40.515584+0000","last_clean":"2023-03-08T15:49:40.515584+0000","last_became_active":"2023-03-08T15:49:39.517777+0000","last_became_peered":"2023-03-08T15:49:39.517777+0000","last_unstale":"2023-03-08T15:49:40.515584+0000","last_undegraded":"2023-03-08T15:49:40.515584+0000","last_fullsized":"2023-03-08T15:49:40.515584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516345+0000","last_change":"2023-03-08T15:49:39.078315+0000","last_active":"2023-03-08T15:49:40.516345+0000","last_peered":"2023-03-08T15:49:40.516345+0000","last_clean":"2023-03-08T15:49:40.516345+0000","last_became_active":"2023-03-08T15:49:39.078043+0000","last_became_peered":"2023-03-08T15:49:39.078043+0000","last_unstale":"2023-03-08T15:49:40.516345+0000","last_undegraded":"2023-03-08T15:49:40.516345+0000","last_fullsized":"2023-03-08T15:49:40.516345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:11:05.009391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498117+0000","last_change":"2023-03-08T15:49:39.513221+0000","last_active":"2023-03-08T15:49:40.498117+0000","last_peered":"2023-03-08T15:49:40.498117+0000","last_clean":"2023-03-08T15:49:40.498117+0000","last_became_active":"2023-03-08T15:49:39.512950+0000","last_became_peered":"2023-03-08T15:49:39.512950+0000","last_unstale":"2023-03-08T15:49:40.498117+0000","last_undegraded":"2023-03-08T15:49:40.498117+0000","last_fullsized":"2023-03-08T15:49:40.498117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516833+0000","last_change":"2023-03-08T15:49:39.068973+0000","last_active":"2023-03-08T15:49:40.516833+0000","last_peered":"2023-03-08T15:49:40.516833+0000","last_clean":"2023-03-08T15:49:40.516833+0000","last_became_active":"2023-03-08T15:49:39.068694+0000","last_became_peered":"2023-03-08T15:49:39.068694+0000","last_unstale":"2023-03-08T15:49:40.516833+0000","last_undegraded":"2023-03-08T15:49:40.516833+0000","last_fullsized":"2023-03-08T15:49:40.516833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:55:20.097052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515855+0000","last_change":"2023-03-08T15:49:39.510470+0000","last_active":"2023-03-08T15:49:40.515855+0000","last_peered":"2023-03-08T15:49:40.515855+0000","last_clean":"2023-03-08T15:49:40.515855+0000","last_became_active":"2023-03-08T15:49:39.510205+0000","last_became_peered":"2023-03-08T15:49:39.510205+0000","last_unstale":"2023-03-08T15:49:40.515855+0000","last_undegraded":"2023-03-08T15:49:40.515855+0000","last_fullsized":"2023-03-08T15:49:40.515855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:45.599141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515854+0000","last_change":"2023-03-08T15:49:39.067592+0000","last_active":"2023-03-08T15:49:40.515854+0000","last_peered":"2023-03-08T15:49:40.515854+0000","last_clean":"2023-03-08T15:49:40.515854+0000","last_became_active":"2023-03-08T15:49:39.067309+0000","last_became_peered":"2023-03-08T15:49:39.067309+0000","last_unstale":"2023-03-08T15:49:40.515854+0000","last_undegraded":"2023-03-08T15:49:40.515854+0000","last_fullsized":"2023-03-08T15:49:40.515854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:53.868715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.514896+0000","last_change":"2023-03-08T15:49:39.510190+0000","last_active":"2023-03-08T15:49:40.514896+0000","last_peered":"2023-03-08T15:49:40.514896+0000","last_clean":"2023-03-08T15:49:40.514896+0000","last_became_active":"2023-03-08T15:49:39.509892+0000","last_became_peered":"2023-03-08T15:49:39.509892+0000","last_unstale":"2023-03-08T15:49:40.514896+0000","last_undegraded":"2023-03-08T15:49:40.514896+0000","last_fullsized":"2023-03-08T15:49:40.514896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:09:32.633312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497690+0000","last_change":"2023-03-08T15:49:39.073755+0000","last_active":"2023-03-08T15:49:40.497690+0000","last_peered":"2023-03-08T15:49:40.497690+0000","last_clean":"2023-03-08T15:49:40.497690+0000","last_became_active":"2023-03-08T15:49:39.073472+0000","last_became_peered":"2023-03-08T15:49:39.073472+0000","last_unstale":"2023-03-08T15:49:40.497690+0000","last_undegraded":"2023-03-08T15:49:40.497690+0000","last_fullsized":"2023-03-08T15:49:40.497690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:53.868715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498326+0000","last_change":"2023-03-08T15:49:39.505358+0000","last_active":"2023-03-08T15:49:40.498326+0000","last_peered":"2023-03-08T15:49:40.498326+0000","last_clean":"2023-03-08T15:49:40.498326+0000","last_became_active":"2023-03-08T15:49:39.504755+0000","last_became_peered":"2023-03-08T15:49:39.504755+0000","last_unstale":"2023-03-08T15:49:40.498326+0000","last_undegraded":"2023-03-08T15:49:40.498326+0000","last_fullsized":"2023-03-08T15:49:40.498326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:03:30.032957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515748+0000","last_change":"2023-03-08T15:49:39.076072+0000","last_active":"2023-03-08T15:49:40.515748+0000","last_peered":"2023-03-08T15:49:40.515748+0000","last_clean":"2023-03-08T15:49:40.515748+0000","last_became_active":"2023-03-08T15:49:39.075810+0000","last_became_peered":"2023-03-08T15:49:39.075810+0000","last_unstale":"2023-03-08T15:49:40.515748+0000","last_undegraded":"2023-03-08T15:49:40.515748+0000","last_fullsized":"2023-03-08T15:49:40.515748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498686+0000","last_change":"2023-03-08T15:49:39.505109+0000","last_active":"2023-03-08T15:49:40.498686+0000","last_peered":"2023-03-08T15:49:40.498686+0000","last_clean":"2023-03-08T15:49:40.498686+0000","last_became_active":"2023-03-08T15:49:39.504889+0000","last_became_peered":"2023-03-08T15:49:39.504889+0000","last_unstale":"2023-03-08T15:49:40.498686+0000","last_undegraded":"2023-03-08T15:49:40.498686+0000","last_fullsized":"2023-03-08T15:49:40.498686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498254+0000","last_change":"2023-03-08T15:49:39.077380+0000","last_active":"2023-03-08T15:49:40.498254+0000","last_peered":"2023-03-08T15:49:40.498254+0000","last_clean":"2023-03-08T15:49:40.498254+0000","last_became_active":"2023-03-08T15:49:39.077041+0000","last_became_peered":"2023-03-08T15:49:39.077041+0000","last_unstale":"2023-03-08T15:49:40.498254+0000","last_undegraded":"2023-03-08T15:49:40.498254+0000","last_fullsized":"2023-03-08T15:49:40.498254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:02:08.526616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498825+0000","last_change":"2023-03-08T15:49:39.512506+0000","last_active":"2023-03-08T15:49:40.498825+0000","last_peered":"2023-03-08T15:49:40.498825+0000","last_clean":"2023-03-08T15:49:40.498825+0000","last_became_active":"2023-03-08T15:49:39.512103+0000","last_became_peered":"2023-03-08T15:49:39.512103+0000","last_unstale":"2023-03-08T15:49:40.498825+0000","last_undegraded":"2023-03-08T15:49:40.498825+0000","last_fullsized":"2023-03-08T15:49:40.498825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:09:32.633312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497106+0000","last_change":"2023-03-08T15:49:39.065317+0000","last_active":"2023-03-08T15:49:40.497106+0000","last_peered":"2023-03-08T15:49:40.497106+0000","last_clean":"2023-03-08T15:49:40.497106+0000","last_became_active":"2023-03-08T15:49:39.065033+0000","last_became_peered":"2023-03-08T15:49:39.065033+0000","last_unstale":"2023-03-08T15:49:40.497106+0000","last_undegraded":"2023-03-08T15:49:40.497106+0000","last_fullsized":"2023-03-08T15:49:40.497106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499131+0000","last_change":"2023-03-08T15:49:39.508113+0000","last_active":"2023-03-08T15:49:40.499131+0000","last_peered":"2023-03-08T15:49:40.499131+0000","last_clean":"2023-03-08T15:49:40.499131+0000","last_became_active":"2023-03-08T15:49:39.507782+0000","last_became_peered":"2023-03-08T15:49:39.507782+0000","last_unstale":"2023-03-08T15:49:40.499131+0000","last_undegraded":"2023-03-08T15:49:40.499131+0000","last_fullsized":"2023-03-08T15:49:40.499131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:17:16.405869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.497607+0000","last_change":"2023-03-08T15:49:34.914364+0000","last_active":"2023-03-08T15:49:39.497607+0000","last_peered":"2023-03-08T15:49:39.497607+0000","last_clean":"2023-03-08T15:49:39.497607+0000","last_became_active":"2023-03-08T15:49:34.914037+0000","last_became_peered":"2023-03-08T15:49:34.914037+0000","last_unstale":"2023-03-08T15:49:39.497607+0000","last_undegraded":"2023-03-08T15:49:39.497607+0000","last_fullsized":"2023-03-08T15:49:39.497607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:55:29.151326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516267+0000","last_change":"2023-03-08T15:49:39.071150+0000","last_active":"2023-03-08T15:49:40.516267+0000","last_peered":"2023-03-08T15:49:40.516267+0000","last_clean":"2023-03-08T15:49:40.516267+0000","last_became_active":"2023-03-08T15:49:39.070851+0000","last_became_peered":"2023-03-08T15:49:39.070851+0000","last_unstale":"2023-03-08T15:49:40.516267+0000","last_undegraded":"2023-03-08T15:49:40.516267+0000","last_fullsized":"2023-03-08T15:49:40.516267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498773+0000","last_change":"2023-03-08T15:49:39.513676+0000","last_active":"2023-03-08T15:49:40.498773+0000","last_peered":"2023-03-08T15:49:40.498773+0000","last_clean":"2023-03-08T15:49:40.498773+0000","last_became_active":"2023-03-08T15:49:39.513236+0000","last_became_peered":"2023-03-08T15:49:39.513236+0000","last_unstale":"2023-03-08T15:49:40.498773+0000","last_undegraded":"2023-03-08T15:49:40.498773+0000","last_fullsized":"2023-03-08T15:49:40.498773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:15:10.927104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.500443+0000","last_change":"2023-03-08T15:49:34.036801+0000","last_active":"2023-03-08T15:49:39.500443+0000","last_peered":"2023-03-08T15:49:39.500443+0000","last_clean":"2023-03-08T15:49:39.500443+0000","last_became_active":"2023-03-08T15:49:34.036484+0000","last_became_peered":"2023-03-08T15:49:34.036484+0000","last_unstale":"2023-03-08T15:49:39.500443+0000","last_undegraded":"2023-03-08T15:49:39.500443+0000","last_fullsized":"2023-03-08T15:49:39.500443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498573+0000","last_change":"2023-03-08T15:49:39.077024+0000","last_active":"2023-03-08T15:49:40.498573+0000","last_peered":"2023-03-08T15:49:40.498573+0000","last_clean":"2023-03-08T15:49:40.498573+0000","last_became_active":"2023-03-08T15:49:39.075919+0000","last_became_peered":"2023-03-08T15:49:39.075919+0000","last_unstale":"2023-03-08T15:49:40.498573+0000","last_undegraded":"2023-03-08T15:49:40.498573+0000","last_fullsized":"2023-03-08T15:49:40.498573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:53:57.255123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498923+0000","last_change":"2023-03-08T15:49:39.506861+0000","last_active":"2023-03-08T15:49:40.498923+0000","last_peered":"2023-03-08T15:49:40.498923+0000","last_clean":"2023-03-08T15:49:40.498923+0000","last_became_active":"2023-03-08T15:49:39.506532+0000","last_became_peered":"2023-03-08T15:49:39.506532+0000","last_unstale":"2023-03-08T15:49:40.498923+0000","last_undegraded":"2023-03-08T15:49:40.498923+0000","last_fullsized":"2023-03-08T15:49:40.498923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.494252+0000","last_change":"2023-03-08T15:49:34.968598+0000","last_active":"2023-03-08T15:49:39.494252+0000","last_peered":"2023-03-08T15:49:39.494252+0000","last_clean":"2023-03-08T15:49:39.494252+0000","last_became_active":"2023-03-08T15:49:34.968300+0000","last_became_peered":"2023-03-08T15:49:34.968300+0000","last_unstale":"2023-03-08T15:49:39.494252+0000","last_undegraded":"2023-03-08T15:49:39.494252+0000","last_fullsized":"2023-03-08T15:49:39.494252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:39:14.985725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498575+0000","last_change":"2023-03-08T15:49:39.069250+0000","last_active":"2023-03-08T15:49:40.498575+0000","last_peered":"2023-03-08T15:49:40.498575+0000","last_clean":"2023-03-08T15:49:40.498575+0000","last_became_active":"2023-03-08T15:49:39.068876+0000","last_became_peered":"2023-03-08T15:49:39.068876+0000","last_unstale":"2023-03-08T15:49:40.498575+0000","last_undegraded":"2023-03-08T15:49:40.498575+0000","last_fullsized":"2023-03-08T15:49:40.498575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:53:57.255123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499084+0000","last_change":"2023-03-08T15:49:39.510119+0000","last_active":"2023-03-08T15:49:40.499084+0000","last_peered":"2023-03-08T15:49:40.499084+0000","last_clean":"2023-03-08T15:49:40.499084+0000","last_became_active":"2023-03-08T15:49:39.509867+0000","last_became_peered":"2023-03-08T15:49:39.509867+0000","last_unstale":"2023-03-08T15:49:40.499084+0000","last_undegraded":"2023-03-08T15:49:40.499084+0000","last_fullsized":"2023-03-08T15:49:40.499084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:59:37.837477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.497279+0000","last_change":"2023-03-08T15:49:34.042076+0000","last_active":"2023-03-08T15:49:39.497279+0000","last_peered":"2023-03-08T15:49:39.497279+0000","last_clean":"2023-03-08T15:49:39.497279+0000","last_became_active":"2023-03-08T15:49:34.041670+0000","last_became_peered":"2023-03-08T15:49:34.041670+0000","last_unstale":"2023-03-08T15:49:39.497279+0000","last_undegraded":"2023-03-08T15:49:39.497279+0000","last_fullsized":"2023-03-08T15:49:39.497279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:46:37.870016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.509020+0000","last_change":"2023-03-08T15:49:27.814075+0000","last_active":"2023-03-08T15:49:39.509020+0000","last_peered":"2023-03-08T15:49:39.509020+0000","last_clean":"2023-03-08T15:49:39.509020+0000","last_became_active":"2023-03-08T15:49:27.813798+0000","last_became_peered":"2023-03-08T15:49:27.813798+0000","last_unstale":"2023-03-08T15:49:39.509020+0000","last_undegraded":"2023-03-08T15:49:39.509020+0000","last_fullsized":"2023-03-08T15:49:39.509020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_clean_scrub_stamp":"2023-03-08T15:49:26.430262+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:31:30.865216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497255+0000","last_change":"2023-03-08T15:49:39.067474+0000","last_active":"2023-03-08T15:49:40.497255+0000","last_peered":"2023-03-08T15:49:40.497255+0000","last_clean":"2023-03-08T15:49:40.497255+0000","last_became_active":"2023-03-08T15:49:39.067137+0000","last_became_peered":"2023-03-08T15:49:39.067137+0000","last_unstale":"2023-03-08T15:49:40.497255+0000","last_undegraded":"2023-03-08T15:49:40.497255+0000","last_fullsized":"2023-03-08T15:49:40.497255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:31:20.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516821+0000","last_change":"2023-03-08T15:49:39.514869+0000","last_active":"2023-03-08T15:49:40.516821+0000","last_peered":"2023-03-08T15:49:40.516821+0000","last_clean":"2023-03-08T15:49:40.516821+0000","last_became_active":"2023-03-08T15:49:39.514600+0000","last_became_peered":"2023-03-08T15:49:39.514600+0000","last_unstale":"2023-03-08T15:49:40.516821+0000","last_undegraded":"2023-03-08T15:49:40.516821+0000","last_fullsized":"2023-03-08T15:49:40.516821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:11:06.014260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.509646+0000","last_change":"2023-03-08T15:49:34.042085+0000","last_active":"2023-03-08T15:49:39.509646+0000","last_peered":"2023-03-08T15:49:39.509646+0000","last_clean":"2023-03-08T15:49:39.509646+0000","last_became_active":"2023-03-08T15:49:34.041754+0000","last_became_peered":"2023-03-08T15:49:34.041754+0000","last_unstale":"2023-03-08T15:49:39.509646+0000","last_undegraded":"2023-03-08T15:49:39.509646+0000","last_fullsized":"2023-03-08T15:49:39.509646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.514893+0000","last_change":"2023-03-08T15:49:39.072478+0000","last_active":"2023-03-08T15:49:40.514893+0000","last_peered":"2023-03-08T15:49:40.514893+0000","last_clean":"2023-03-08T15:49:40.514893+0000","last_became_active":"2023-03-08T15:49:39.072186+0000","last_became_peered":"2023-03-08T15:49:39.072186+0000","last_unstale":"2023-03-08T15:49:40.514893+0000","last_undegraded":"2023-03-08T15:49:40.514893+0000","last_fullsized":"2023-03-08T15:49:40.514893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:07:57.155564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515455+0000","last_change":"2023-03-08T15:49:39.511543+0000","last_active":"2023-03-08T15:49:40.515455+0000","last_peered":"2023-03-08T15:49:40.515455+0000","last_clean":"2023-03-08T15:49:40.515455+0000","last_became_active":"2023-03-08T15:49:39.511257+0000","last_became_peered":"2023-03-08T15:49:39.511257+0000","last_unstale":"2023-03-08T15:49:40.515455+0000","last_undegraded":"2023-03-08T15:49:40.515455+0000","last_fullsized":"2023-03-08T15:49:40.515455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:02:38.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.510687+0000","last_change":"2023-03-08T15:49:34.914757+0000","last_active":"2023-03-08T15:49:39.510687+0000","last_peered":"2023-03-08T15:49:39.510687+0000","last_clean":"2023-03-08T15:49:39.510687+0000","last_became_active":"2023-03-08T15:49:34.914391+0000","last_became_peered":"2023-03-08T15:49:34.914391+0000","last_unstale":"2023-03-08T15:49:39.510687+0000","last_undegraded":"2023-03-08T15:49:39.510687+0000","last_fullsized":"2023-03-08T15:49:39.510687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:09:02.620210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498918+0000","last_change":"2023-03-08T15:49:39.069904+0000","last_active":"2023-03-08T15:49:40.498918+0000","last_peered":"2023-03-08T15:49:40.498918+0000","last_clean":"2023-03-08T15:49:40.498918+0000","last_became_active":"2023-03-08T15:49:39.069513+0000","last_became_peered":"2023-03-08T15:49:39.069513+0000","last_unstale":"2023-03-08T15:49:40.498918+0000","last_undegraded":"2023-03-08T15:49:40.498918+0000","last_fullsized":"2023-03-08T15:49:40.498918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:29:04.866450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515223+0000","last_change":"2023-03-08T15:49:39.512846+0000","last_active":"2023-03-08T15:49:40.515223+0000","last_peered":"2023-03-08T15:49:40.515223+0000","last_clean":"2023-03-08T15:49:40.515223+0000","last_became_active":"2023-03-08T15:49:39.512561+0000","last_became_peered":"2023-03-08T15:49:39.512561+0000","last_unstale":"2023-03-08T15:49:40.515223+0000","last_undegraded":"2023-03-08T15:49:40.515223+0000","last_fullsized":"2023-03-08T15:49:40.515223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498020+0000","last_change":"2023-03-08T15:49:39.067777+0000","last_active":"2023-03-08T15:49:40.498020+0000","last_peered":"2023-03-08T15:49:40.498020+0000","last_clean":"2023-03-08T15:49:40.498020+0000","last_became_active":"2023-03-08T15:49:39.067461+0000","last_became_peered":"2023-03-08T15:49:39.067461+0000","last_unstale":"2023-03-08T15:49:40.498020+0000","last_undegraded":"2023-03-08T15:49:40.498020+0000","last_fullsized":"2023-03-08T15:49:40.498020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:21.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.498744+0000","last_change":"2023-03-08T15:49:34.039636+0000","last_active":"2023-03-08T15:49:39.498744+0000","last_peered":"2023-03-08T15:49:39.498744+0000","last_clean":"2023-03-08T15:49:39.498744+0000","last_became_active":"2023-03-08T15:49:34.039383+0000","last_became_peered":"2023-03-08T15:49:34.039383+0000","last_unstale":"2023-03-08T15:49:39.498744+0000","last_undegraded":"2023-03-08T15:49:39.498744+0000","last_fullsized":"2023-03-08T15:49:39.498744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:27:38.358539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497091+0000","last_change":"2023-03-08T15:49:39.518195+0000","last_active":"2023-03-08T15:49:40.497091+0000","last_peered":"2023-03-08T15:49:40.497091+0000","last_clean":"2023-03-08T15:49:40.497091+0000","last_became_active":"2023-03-08T15:49:39.517992+0000","last_became_peered":"2023-03-08T15:49:39.517992+0000","last_unstale":"2023-03-08T15:49:40.497091+0000","last_undegraded":"2023-03-08T15:49:40.497091+0000","last_fullsized":"2023-03-08T15:49:40.497091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.498866+0000","last_change":"2023-03-08T15:49:34.040711+0000","last_active":"2023-03-08T15:49:39.498866+0000","last_peered":"2023-03-08T15:49:39.498866+0000","last_clean":"2023-03-08T15:49:39.498866+0000","last_became_active":"2023-03-08T15:49:34.040328+0000","last_became_peered":"2023-03-08T15:49:34.040328+0000","last_unstale":"2023-03-08T15:49:39.498866+0000","last_undegraded":"2023-03-08T15:49:39.498866+0000","last_fullsized":"2023-03-08T15:49:39.498866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:34:43.169713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:41.038333+0000","last_change":"2023-03-08T15:49:39.073837+0000","last_active":"2023-03-08T15:49:41.038333+0000","last_peered":"2023-03-08T15:49:41.038333+0000","last_clean":"2023-03-08T15:49:41.038333+0000","last_became_active":"2023-03-08T15:49:39.073103+0000","last_became_peered":"2023-03-08T15:49:39.073103+0000","last_unstale":"2023-03-08T15:49:41.038333+0000","last_undegraded":"2023-03-08T15:49:41.038333+0000","last_fullsized":"2023-03-08T15:49:41.038333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:53:57.255123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498138+0000","last_change":"2023-03-08T15:49:39.506282+0000","last_active":"2023-03-08T15:49:40.498138+0000","last_peered":"2023-03-08T15:49:40.498138+0000","last_clean":"2023-03-08T15:49:40.498138+0000","last_became_active":"2023-03-08T15:49:39.505963+0000","last_became_peered":"2023-03-08T15:49:39.505963+0000","last_unstale":"2023-03-08T15:49:40.498138+0000","last_undegraded":"2023-03-08T15:49:40.498138+0000","last_fullsized":"2023-03-08T15:49:40.498138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:18:53.422253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515312+0000","last_change":"2023-03-08T15:49:39.077529+0000","last_active":"2023-03-08T15:49:40.515312+0000","last_peered":"2023-03-08T15:49:40.515312+0000","last_clean":"2023-03-08T15:49:40.515312+0000","last_became_active":"2023-03-08T15:49:39.077214+0000","last_became_peered":"2023-03-08T15:49:39.077214+0000","last_unstale":"2023-03-08T15:49:40.515312+0000","last_undegraded":"2023-03-08T15:49:40.515312+0000","last_fullsized":"2023-03-08T15:49:40.515312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:31:20.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515304+0000","last_change":"2023-03-08T15:49:39.505582+0000","last_active":"2023-03-08T15:49:40.515304+0000","last_peered":"2023-03-08T15:49:40.515304+0000","last_clean":"2023-03-08T15:49:40.515304+0000","last_became_active":"2023-03-08T15:49:39.505317+0000","last_became_peered":"2023-03-08T15:49:39.505317+0000","last_unstale":"2023-03-08T15:49:40.515304+0000","last_undegraded":"2023-03-08T15:49:40.515304+0000","last_fullsized":"2023-03-08T15:49:40.515304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:31:21.040757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515757+0000","last_change":"2023-03-08T15:49:39.074108+0000","last_active":"2023-03-08T15:49:40.515757+0000","last_peered":"2023-03-08T15:49:40.515757+0000","last_clean":"2023-03-08T15:49:40.515757+0000","last_became_active":"2023-03-08T15:49:39.073843+0000","last_became_peered":"2023-03-08T15:49:39.073843+0000","last_unstale":"2023-03-08T15:49:40.515757+0000","last_undegraded":"2023-03-08T15:49:40.515757+0000","last_fullsized":"2023-03-08T15:49:40.515757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:13:15.662118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498719+0000","last_change":"2023-03-08T15:49:39.506927+0000","last_active":"2023-03-08T15:49:40.498719+0000","last_peered":"2023-03-08T15:49:40.498719+0000","last_clean":"2023-03-08T15:49:40.498719+0000","last_became_active":"2023-03-08T15:49:39.505636+0000","last_became_peered":"2023-03-08T15:49:39.505636+0000","last_unstale":"2023-03-08T15:49:40.498719+0000","last_undegraded":"2023-03-08T15:49:40.498719+0000","last_fullsized":"2023-03-08T15:49:40.498719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:21:33.395756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516368+0000","last_change":"2023-03-08T15:49:39.073044+0000","last_active":"2023-03-08T15:49:40.516368+0000","last_peered":"2023-03-08T15:49:40.516368+0000","last_clean":"2023-03-08T15:49:40.516368+0000","last_became_active":"2023-03-08T15:49:39.072756+0000","last_became_peered":"2023-03-08T15:49:39.072756+0000","last_unstale":"2023-03-08T15:49:40.516368+0000","last_undegraded":"2023-03-08T15:49:40.516368+0000","last_fullsized":"2023-03-08T15:49:40.516368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:03.536123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498753+0000","last_change":"2023-03-08T15:49:39.500630+0000","last_active":"2023-03-08T15:49:40.498753+0000","last_peered":"2023-03-08T15:49:40.498753+0000","last_clean":"2023-03-08T15:49:40.498753+0000","last_became_active":"2023-03-08T15:49:39.500345+0000","last_became_peered":"2023-03-08T15:49:39.500345+0000","last_unstale":"2023-03-08T15:49:40.498753+0000","last_undegraded":"2023-03-08T15:49:40.498753+0000","last_fullsized":"2023-03-08T15:49:40.498753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:41:05.974121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497768+0000","last_change":"2023-03-08T15:49:39.066336+0000","last_active":"2023-03-08T15:49:40.497768+0000","last_peered":"2023-03-08T15:49:40.497768+0000","last_clean":"2023-03-08T15:49:40.497768+0000","last_became_active":"2023-03-08T15:49:39.066086+0000","last_became_peered":"2023-03-08T15:49:39.066086+0000","last_unstale":"2023-03-08T15:49:40.497768+0000","last_undegraded":"2023-03-08T15:49:40.497768+0000","last_fullsized":"2023-03-08T15:49:40.497768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497183+0000","last_change":"2023-03-08T15:49:39.501364+0000","last_active":"2023-03-08T15:49:40.497183+0000","last_peered":"2023-03-08T15:49:40.497183+0000","last_clean":"2023-03-08T15:49:40.497183+0000","last_became_active":"2023-03-08T15:49:39.501117+0000","last_became_peered":"2023-03-08T15:49:39.501117+0000","last_unstale":"2023-03-08T15:49:40.497183+0000","last_undegraded":"2023-03-08T15:49:40.497183+0000","last_fullsized":"2023-03-08T15:49:40.497183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:09:32.633312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515603+0000","last_change":"2023-03-08T15:49:39.070288+0000","last_active":"2023-03-08T15:49:40.515603+0000","last_peered":"2023-03-08T15:49:40.515603+0000","last_clean":"2023-03-08T15:49:40.515603+0000","last_became_active":"2023-03-08T15:49:39.069630+0000","last_became_peered":"2023-03-08T15:49:39.069630+0000","last_unstale":"2023-03-08T15:49:40.515603+0000","last_undegraded":"2023-03-08T15:49:40.515603+0000","last_fullsized":"2023-03-08T15:49:40.515603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498057+0000","last_change":"2023-03-08T15:49:39.504481+0000","last_active":"2023-03-08T15:49:40.498057+0000","last_peered":"2023-03-08T15:49:40.498057+0000","last_clean":"2023-03-08T15:49:40.498057+0000","last_became_active":"2023-03-08T15:49:39.504153+0000","last_became_peered":"2023-03-08T15:49:39.504153+0000","last_unstale":"2023-03-08T15:49:40.498057+0000","last_undegraded":"2023-03-08T15:49:40.498057+0000","last_fullsized":"2023-03-08T15:49:40.498057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:35:39.586275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515765+0000","last_change":"2023-03-08T15:49:39.512615+0000","last_active":"2023-03-08T15:49:40.515765+0000","last_peered":"2023-03-08T15:49:40.515765+0000","last_clean":"2023-03-08T15:49:40.515765+0000","last_became_active":"2023-03-08T15:49:39.511936+0000","last_became_peered":"2023-03-08T15:49:39.511936+0000","last_unstale":"2023-03-08T15:49:40.515765+0000","last_undegraded":"2023-03-08T15:49:40.515765+0000","last_fullsized":"2023-03-08T15:49:40.515765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:13:16.666986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497118+0000","last_change":"2023-03-08T15:49:39.506060+0000","last_active":"2023-03-08T15:49:40.497118+0000","last_peered":"2023-03-08T15:49:40.497118+0000","last_clean":"2023-03-08T15:49:40.497118+0000","last_became_active":"2023-03-08T15:49:39.505789+0000","last_became_peered":"2023-03-08T15:49:39.505789+0000","last_unstale":"2023-03-08T15:49:40.497118+0000","last_undegraded":"2023-03-08T15:49:40.497118+0000","last_fullsized":"2023-03-08T15:49:40.497118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:09:02.915110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498616+0000","last_change":"2023-03-08T15:49:39.504399+0000","last_active":"2023-03-08T15:49:40.498616+0000","last_peered":"2023-03-08T15:49:40.498616+0000","last_clean":"2023-03-08T15:49:40.498616+0000","last_became_active":"2023-03-08T15:49:39.504110+0000","last_became_peered":"2023-03-08T15:49:39.504110+0000","last_unstale":"2023-03-08T15:49:40.498616+0000","last_undegraded":"2023-03-08T15:49:40.498616+0000","last_fullsized":"2023-03-08T15:49:40.498616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:31:20.377122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497746+0000","last_change":"2023-03-08T15:49:39.517458+0000","last_active":"2023-03-08T15:49:40.497746+0000","last_peered":"2023-03-08T15:49:40.497746+0000","last_clean":"2023-03-08T15:49:40.497746+0000","last_became_active":"2023-03-08T15:49:39.517225+0000","last_became_peered":"2023-03-08T15:49:39.517225+0000","last_unstale":"2023-03-08T15:49:40.497746+0000","last_undegraded":"2023-03-08T15:49:40.497746+0000","last_fullsized":"2023-03-08T15:49:40.497746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498811+0000","last_change":"2023-03-08T15:49:39.518670+0000","last_active":"2023-03-08T15:49:40.498811+0000","last_peered":"2023-03-08T15:49:40.498811+0000","last_clean":"2023-03-08T15:49:40.498811+0000","last_became_active":"2023-03-08T15:49:39.518430+0000","last_became_peered":"2023-03-08T15:49:39.518430+0000","last_unstale":"2023-03-08T15:49:40.498811+0000","last_undegraded":"2023-03-08T15:49:40.498811+0000","last_fullsized":"2023-03-08T15:49:40.498811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":681731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.7060000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8052,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363788,"statfs":{"total":96636764160,"available":96628518912,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.2750000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.3369999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.976000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9084,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362756,"statfs":{"total":96636764160,"available":96627462144,"internally_reserved":0,"allocated":839680,"data_stored":680533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.18099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7924,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363916,"statfs":{"total":96636764160,"available":96628649984,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.217000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5940000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.6369999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.4190000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.185}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.6859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.3800000000000008}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":91203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":90235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-08T15:49:48.181 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-08T15:49:48.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.333+0000 7f67b9372700 1 Processor -- start 2023-03-08T15:49:48.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.333+0000 7f67b9372700 1 -- start start 2023-03-08T15:49:48.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.334+0000 7f67b9372700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67b4144a90 0x7f67b40bd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:48.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.334+0000 7f67b9372700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b40b7fa0 con 0x7f67b41446c0 2023-03-08T15:49:48.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.334+0000 7f67b9372700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b40bc030 con 0x7f67b40ba560 2023-03-08T15:49:48.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.334+0000 7f67b9372700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b40bc310 con 0x7f67b4144a90 2023-03-08T15:49:48.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.334+0000 7f67b27fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67b4144a90 0x7f67b40bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:48.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.334+0000 7f67b2ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f67b41446c0 0x7f67b40b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33614/0 (socket says 172.21.15.123:33614) 2023-03-08T15:49:48.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.334+0000 7f67b2ffd700 1 -- 172.21.15.123:0/653658775 learned_addr learned my addr 172.21.15.123:0/653658775 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:48.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.335+0000 7f67b27fc700 1 -- 172.21.15.123:0/653658775 >> v1:172.21.15.175:6789/0 conn(0x7f67b40ba560 legacy=0x7f67b4154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:48.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.335+0000 7f67b27fc700 1 -- 172.21.15.123:0/653658775 >> v1:172.21.15.123:6789/0 conn(0x7f67b41446c0 legacy=0x7f67b40b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:48.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.335+0000 7f67b27fc700 1 -- 172.21.15.123:0/653658775 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b40bc5f0 con 0x7f67b4144a90 2023-03-08T15:49:48.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.335+0000 7f67b1ffb700 1 -- 172.21.15.123:0/653658775 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499734964 0 0) 0x7f67b40b7fa0 con 0x7f67b41446c0 2023-03-08T15:49:48.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.335+0000 7f67b27fc700 1 --2- 172.21.15.123:0/653658775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b4144a90 0x7f67b40bd580 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009840 tx=0x7f67a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05a8f56b18a6ac5 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:48.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.335+0000 7f67b1ffb700 1 -- 172.21.15.123:0/653658775 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a4004230 con 0x7f67b4144a90 2023-03-08T15:49:48.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.335+0000 7f67b1ffb700 1 -- 172.21.15.123:0/653658775 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a4004390 con 0x7f67b4144a90 2023-03-08T15:49:48.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.335+0000 7f67b1ffb700 1 -- 172.21.15.123:0/653658775 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a40036a0 con 0x7f67b4144a90 2023-03-08T15:49:48.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.335+0000 7f67b9372700 1 -- 172.21.15.123:0/653658775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b4144a90 msgr2=0x7f67b40bd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:48.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.335+0000 7f67b9372700 1 --2- 172.21.15.123:0/653658775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b4144a90 0x7f67b40bd580 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009840 tx=0x7f67a4009b50 comp rx=0 tx=0).stop 2023-03-08T15:49:48.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.335+0000 7f67b9372700 1 -- 172.21.15.123:0/653658775 shutdown_connections 2023-03-08T15:49:48.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.335+0000 7f67b9372700 1 --2- 172.21.15.123:0/653658775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b4144a90 0x7f67b40bd580 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.335+0000 7f67b9372700 1 -- 172.21.15.123:0/653658775 >> 172.21.15.123:0/653658775 conn(0x7f67b4071980 msgr2=0x7f67b4071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:48.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.335+0000 7f67b9372700 1 -- 172.21.15.123:0/653658775 shutdown_connections 2023-03-08T15:49:48.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.335+0000 7f67b9372700 1 -- 172.21.15.123:0/653658775 wait complete. 2023-03-08T15:49:48.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.337+0000 7f67b9372700 1 Processor -- start 2023-03-08T15:49:48.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.337+0000 7f67b9372700 1 -- start start 2023-03-08T15:49:48.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.337+0000 7f67b9372700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b40ba560 0x7f67b413d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:48.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.337+0000 7f67b9372700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b41446c0 0x7f67b413ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:48.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.337+0000 7f67b9372700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67b4144a90 0x7f67b413f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:48.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.337+0000 7f67b9372700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b413e610 con 0x7f67b40ba560 2023-03-08T15:49:48.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.337+0000 7f67b9372700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b413b0a0 con 0x7f67b41446c0 2023-03-08T15:49:48.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.337+0000 7f67b9372700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b413b290 con 0x7f67b4144a90 2023-03-08T15:49:48.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.337+0000 7f67b2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b40ba560 0x7f67b413d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:48.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.337+0000 7f67b2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b40ba560 0x7f67b413d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36870/0 (socket says 172.21.15.123:36870) 2023-03-08T15:49:48.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.337+0000 7f67b2ffd700 1 -- 172.21.15.123:0/3674368618 learned_addr learned my addr 172.21.15.123:0/3674368618 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:48.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.337+0000 7f67b37fe700 1 --2- 172.21.15.123:0/3674368618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67b4144a90 0x7f67b413f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.337+0000 7f67b27fc700 1 --2- 172.21.15.123:0/3674368618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b41446c0 0x7f67b413ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.338+0000 7f67b2ffd700 1 -- 172.21.15.123:0/3674368618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67b4144a90 msgr2=0x7f67b413f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.338+0000 7f67b2ffd700 1 --2- 172.21.15.123:0/3674368618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67b4144a90 0x7f67b413f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.338+0000 7f67b2ffd700 1 -- 172.21.15.123:0/3674368618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b41446c0 msgr2=0x7f67b413ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.338+0000 7f67b2ffd700 1 --2- 172.21.15.123:0/3674368618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b41446c0 0x7f67b413ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.338+0000 7f67b2ffd700 1 -- 172.21.15.123:0/3674368618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a40094a0 con 0x7f67b40ba560 2023-03-08T15:49:48.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.338+0000 7f67b27fc700 1 --2- 172.21.15.123:0/3674368618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b41446c0 0x7f67b413ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.338+0000 7f67b2ffd700 1 --2- 172.21.15.123:0/3674368618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b40ba560 0x7f67b413d170 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67a800c520 tx=0x7f67a800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.338+0000 7f679b7fe700 1 -- 172.21.15.123:0/3674368618 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a8004c80 con 0x7f67b40ba560 2023-03-08T15:49:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.338+0000 7f679b7fe700 1 -- 172.21.15.123:0/3674368618 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a8004e00 con 0x7f67b40ba560 2023-03-08T15:49:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.338+0000 7f67b9372700 1 -- 172.21.15.123:0/3674368618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b414db90 con 0x7f67b40ba560 2023-03-08T15:49:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.338+0000 7f679b7fe700 1 -- 172.21.15.123:0/3674368618 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a8007310 con 0x7f67b40ba560 2023-03-08T15:49:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.338+0000 7f67b9372700 1 -- 172.21.15.123:0/3674368618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b40bdac0 con 0x7f67b40ba560 2023-03-08T15:49:48.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.339+0000 7f67b9372700 1 -- 172.21.15.123:0/3674368618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b414dd20 con 0x7f67b40ba560 2023-03-08T15:49:48.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.339+0000 7f679b7fe700 1 -- 172.21.15.123:0/3674368618 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f67a801a020 con 0x7f67b40ba560 2023-03-08T15:49:48.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.340+0000 7f679b7fe700 1 --2- 172.21.15.123:0/3674368618 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f67a00698d0 0x7f67a006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:48.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.340+0000 7f67b27fc700 1 --2- 172.21.15.123:0/3674368618 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f67a00698d0 0x7f67a006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:48.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.340+0000 7f679b7fe700 1 -- 172.21.15.123:0/3674368618 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f67a8087290 con 0x7f67b40ba560 2023-03-08T15:49:48.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.340+0000 7f67b27fc700 1 --2- 172.21.15.123:0/3674368618 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f67a00698d0 0x7f67a006bd80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f67a40090b0 tx=0x7f67a4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:48.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.344+0000 7f679b7fe700 1 -- 172.21.15.123:0/3674368618 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f67b414dd20 con 0x7f67b40ba560 2023-03-08T15:49:48.528 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.527+0000 7f67b9372700 1 -- 172.21.15.123:0/3674368618 --> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67b414dd20 con 0x7f67a00698d0 2023-03-08T15:49:48.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.534+0000 7f679b7fe700 1 -- 172.21.15.123:0/3674368618 <== mgr.4098 v2:172.21.15.123:6832/142884 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286597 (secure 0 0 0) 0x7f67b414dd20 con 0x7f67a00698d0 2023-03-08T15:49:48.538 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:48.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.538+0000 7f67b9372700 1 -- 172.21.15.123:0/3674368618 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f67a00698d0 msgr2=0x7f67a006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:48.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.538+0000 7f67b9372700 1 --2- 172.21.15.123:0/3674368618 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f67a00698d0 0x7f67a006bd80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f67a40090b0 tx=0x7f67a4008030 comp rx=0 tx=0).stop 2023-03-08T15:49:48.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.538+0000 7f67b9372700 1 -- 172.21.15.123:0/3674368618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b40ba560 msgr2=0x7f67b413d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:48.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.538+0000 7f67b9372700 1 --2- 172.21.15.123:0/3674368618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b40ba560 0x7f67b413d170 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67a800c520 tx=0x7f67a800c830 comp rx=0 tx=0).stop 2023-03-08T15:49:48.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.538+0000 7f67b9372700 1 -- 172.21.15.123:0/3674368618 shutdown_connections 2023-03-08T15:49:48.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.538+0000 7f67b9372700 1 --2- 172.21.15.123:0/3674368618 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f67a00698d0 0x7f67a006bd80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.538+0000 7f67b9372700 1 --2- 172.21.15.123:0/3674368618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67b4144a90 0x7f67b413f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.541 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.538+0000 7f67b9372700 1 --2- 172.21.15.123:0/3674368618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67b40ba560 0x7f67b413d170 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.538+0000 7f67b9372700 1 --2- 172.21.15.123:0/3674368618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67b41446c0 0x7f67b413ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.538+0000 7f67b9372700 1 -- 172.21.15.123:0/3674368618 >> 172.21.15.123:0/3674368618 conn(0x7f67b4071980 msgr2=0x7f67b414c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:48.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.538+0000 7f67b9372700 1 -- 172.21.15.123:0/3674368618 shutdown_connections 2023-03-08T15:49:48.542 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.538+0000 7f67b9372700 1 -- 172.21.15.123:0/3674368618 wait complete. 2023-03-08T15:49:48.542 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-03-08T15:49:48.551 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-03-08T15:49:47.974578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66280,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908440,"statfs":{"total":773094113280,"available":773026242560,"internally_reserved":0,"allocated":3186688,"data_stored":1902188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.483891"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515200+0000","last_change":"2023-03-08T15:49:39.500574+0000","last_active":"2023-03-08T15:49:40.515200+0000","last_peered":"2023-03-08T15:49:40.515200+0000","last_clean":"2023-03-08T15:49:40.515200+0000","last_became_active":"2023-03-08T15:49:39.500324+0000","last_became_peered":"2023-03-08T15:49:39.500324+0000","last_unstale":"2023-03-08T15:49:40.515200+0000","last_undegraded":"2023-03-08T15:49:40.515200+0000","last_fullsized":"2023-03-08T15:49:40.515200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:54.873584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516498+0000","last_change":"2023-03-08T15:49:39.510529+0000","last_active":"2023-03-08T15:49:40.516498+0000","last_peered":"2023-03-08T15:49:40.516498+0000","last_clean":"2023-03-08T15:49:40.516498+0000","last_became_active":"2023-03-08T15:49:39.510227+0000","last_became_peered":"2023-03-08T15:49:39.510227+0000","last_unstale":"2023-03-08T15:49:40.516498+0000","last_undegraded":"2023-03-08T15:49:40.516498+0000","last_fullsized":"2023-03-08T15:49:40.516498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498504+0000","last_change":"2023-03-08T15:49:39.507276+0000","last_active":"2023-03-08T15:49:40.498504+0000","last_peered":"2023-03-08T15:49:40.498504+0000","last_clean":"2023-03-08T15:49:40.498504+0000","last_became_active":"2023-03-08T15:49:39.506954+0000","last_became_peered":"2023-03-08T15:49:39.506954+0000","last_unstale":"2023-03-08T15:49:40.498504+0000","last_undegraded":"2023-03-08T15:49:40.498504+0000","last_fullsized":"2023-03-08T15:49:40.498504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516428+0000","last_change":"2023-03-08T15:49:39.511677+0000","last_active":"2023-03-08T15:49:40.516428+0000","last_peered":"2023-03-08T15:49:40.516428+0000","last_clean":"2023-03-08T15:49:40.516428+0000","last_became_active":"2023-03-08T15:49:39.508018+0000","last_became_peered":"2023-03-08T15:49:39.508018+0000","last_unstale":"2023-03-08T15:49:40.516428+0000","last_undegraded":"2023-03-08T15:49:40.516428+0000","last_fullsized":"2023-03-08T15:49:40.516428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:08:10.089458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515126+0000","last_change":"2023-03-08T15:49:39.509835+0000","last_active":"2023-03-08T15:49:40.515126+0000","last_peered":"2023-03-08T15:49:40.515126+0000","last_clean":"2023-03-08T15:49:40.515126+0000","last_became_active":"2023-03-08T15:49:39.507785+0000","last_became_peered":"2023-03-08T15:49:39.507785+0000","last_unstale":"2023-03-08T15:49:40.515126+0000","last_undegraded":"2023-03-08T15:49:40.515126+0000","last_fullsized":"2023-03-08T15:49:40.515126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:41:05.974121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498456+0000","last_change":"2023-03-08T15:49:39.514008+0000","last_active":"2023-03-08T15:49:40.498456+0000","last_peered":"2023-03-08T15:49:40.498456+0000","last_clean":"2023-03-08T15:49:40.498456+0000","last_became_active":"2023-03-08T15:49:39.508486+0000","last_became_peered":"2023-03-08T15:49:39.508486+0000","last_unstale":"2023-03-08T15:49:40.498456+0000","last_undegraded":"2023-03-08T15:49:40.498456+0000","last_fullsized":"2023-03-08T15:49:40.498456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:00:34.312638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515812+0000","last_change":"2023-03-08T15:49:39.517513+0000","last_active":"2023-03-08T15:49:40.515812+0000","last_peered":"2023-03-08T15:49:40.515812+0000","last_clean":"2023-03-08T15:49:40.515812+0000","last_became_active":"2023-03-08T15:49:39.517157+0000","last_became_peered":"2023-03-08T15:49:39.517157+0000","last_unstale":"2023-03-08T15:49:40.515812+0000","last_undegraded":"2023-03-08T15:49:40.515812+0000","last_fullsized":"2023-03-08T15:49:40.515812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515450+0000","last_change":"2023-03-08T15:49:39.515299+0000","last_active":"2023-03-08T15:49:40.515450+0000","last_peered":"2023-03-08T15:49:40.515450+0000","last_clean":"2023-03-08T15:49:40.515450+0000","last_became_active":"2023-03-08T15:49:39.515005+0000","last_became_peered":"2023-03-08T15:49:39.515005+0000","last_unstale":"2023-03-08T15:49:40.515450+0000","last_undegraded":"2023-03-08T15:49:40.515450+0000","last_fullsized":"2023-03-08T15:49:40.515450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:07:36.774920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515469+0000","last_change":"2023-03-08T15:49:39.511832+0000","last_active":"2023-03-08T15:49:40.515469+0000","last_peered":"2023-03-08T15:49:40.515469+0000","last_clean":"2023-03-08T15:49:40.515469+0000","last_became_active":"2023-03-08T15:49:39.511580+0000","last_became_peered":"2023-03-08T15:49:39.511580+0000","last_unstale":"2023-03-08T15:49:40.515469+0000","last_undegraded":"2023-03-08T15:49:40.515469+0000","last_fullsized":"2023-03-08T15:49:40.515469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516671+0000","last_change":"2023-03-08T15:49:39.509905+0000","last_active":"2023-03-08T15:49:40.516671+0000","last_peered":"2023-03-08T15:49:40.516671+0000","last_clean":"2023-03-08T15:49:40.516671+0000","last_became_active":"2023-03-08T15:49:39.509656+0000","last_became_peered":"2023-03-08T15:49:39.509656+0000","last_unstale":"2023-03-08T15:49:40.516671+0000","last_undegraded":"2023-03-08T15:49:40.516671+0000","last_fullsized":"2023-03-08T15:49:40.516671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:02:38.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498546+0000","last_change":"2023-03-08T15:49:39.512652+0000","last_active":"2023-03-08T15:49:40.498546+0000","last_peered":"2023-03-08T15:49:40.498546+0000","last_clean":"2023-03-08T15:49:40.498546+0000","last_became_active":"2023-03-08T15:49:39.512339+0000","last_became_peered":"2023-03-08T15:49:39.512339+0000","last_unstale":"2023-03-08T15:49:40.498546+0000","last_undegraded":"2023-03-08T15:49:40.498546+0000","last_fullsized":"2023-03-08T15:49:40.498546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515136+0000","last_change":"2023-03-08T15:49:39.501468+0000","last_active":"2023-03-08T15:49:40.515136+0000","last_peered":"2023-03-08T15:49:40.515136+0000","last_clean":"2023-03-08T15:49:40.515136+0000","last_became_active":"2023-03-08T15:49:39.501217+0000","last_became_peered":"2023-03-08T15:49:39.501217+0000","last_unstale":"2023-03-08T15:49:40.515136+0000","last_undegraded":"2023-03-08T15:49:40.515136+0000","last_fullsized":"2023-03-08T15:49:40.515136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:04.540991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515081+0000","last_change":"2023-03-08T15:49:39.500058+0000","last_active":"2023-03-08T15:49:40.515081+0000","last_peered":"2023-03-08T15:49:40.515081+0000","last_clean":"2023-03-08T15:49:40.515081+0000","last_became_active":"2023-03-08T15:49:39.499799+0000","last_became_peered":"2023-03-08T15:49:39.499799+0000","last_unstale":"2023-03-08T15:49:40.515081+0000","last_undegraded":"2023-03-08T15:49:40.515081+0000","last_fullsized":"2023-03-08T15:49:40.515081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:22.868366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516068+0000","last_change":"2023-03-08T15:49:39.509813+0000","last_active":"2023-03-08T15:49:40.516068+0000","last_peered":"2023-03-08T15:49:40.516068+0000","last_clean":"2023-03-08T15:49:40.516068+0000","last_became_active":"2023-03-08T15:49:39.509515+0000","last_became_peered":"2023-03-08T15:49:39.509515+0000","last_unstale":"2023-03-08T15:49:40.516068+0000","last_undegraded":"2023-03-08T15:49:40.516068+0000","last_fullsized":"2023-03-08T15:49:40.516068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516019+0000","last_change":"2023-03-08T15:49:39.517988+0000","last_active":"2023-03-08T15:49:40.516019+0000","last_peered":"2023-03-08T15:49:40.516019+0000","last_clean":"2023-03-08T15:49:40.516019+0000","last_became_active":"2023-03-08T15:49:39.517729+0000","last_became_peered":"2023-03-08T15:49:39.517729+0000","last_unstale":"2023-03-08T15:49:40.516019+0000","last_undegraded":"2023-03-08T15:49:40.516019+0000","last_fullsized":"2023-03-08T15:49:40.516019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498160+0000","last_change":"2023-03-08T15:49:39.507303+0000","last_active":"2023-03-08T15:49:40.498160+0000","last_peered":"2023-03-08T15:49:40.498160+0000","last_clean":"2023-03-08T15:49:40.498160+0000","last_became_active":"2023-03-08T15:49:39.506847+0000","last_became_peered":"2023-03-08T15:49:39.506847+0000","last_unstale":"2023-03-08T15:49:40.498160+0000","last_undegraded":"2023-03-08T15:49:40.498160+0000","last_fullsized":"2023-03-08T15:49:40.498160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:55:21.101920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515522+0000","last_change":"2023-03-08T15:49:39.511674+0000","last_active":"2023-03-08T15:49:40.515522+0000","last_peered":"2023-03-08T15:49:40.515522+0000","last_clean":"2023-03-08T15:49:40.515522+0000","last_became_active":"2023-03-08T15:49:39.511293+0000","last_became_peered":"2023-03-08T15:49:39.511293+0000","last_unstale":"2023-03-08T15:49:40.515522+0000","last_undegraded":"2023-03-08T15:49:40.515522+0000","last_fullsized":"2023-03-08T15:49:40.515522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:15:10.927104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498599+0000","last_change":"2023-03-08T15:49:39.507528+0000","last_active":"2023-03-08T15:49:40.498599+0000","last_peered":"2023-03-08T15:49:40.498599+0000","last_clean":"2023-03-08T15:49:40.498599+0000","last_became_active":"2023-03-08T15:49:39.507193+0000","last_became_peered":"2023-03-08T15:49:39.507193+0000","last_unstale":"2023-03-08T15:49:40.498599+0000","last_undegraded":"2023-03-08T15:49:40.498599+0000","last_fullsized":"2023-03-08T15:49:40.498599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:09:02.915110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515398+0000","last_change":"2023-03-08T15:49:39.503980+0000","last_active":"2023-03-08T15:49:40.515398+0000","last_peered":"2023-03-08T15:49:40.515398+0000","last_clean":"2023-03-08T15:49:40.515398+0000","last_became_active":"2023-03-08T15:49:39.503703+0000","last_became_peered":"2023-03-08T15:49:39.503703+0000","last_unstale":"2023-03-08T15:49:40.515398+0000","last_undegraded":"2023-03-08T15:49:40.515398+0000","last_fullsized":"2023-03-08T15:49:40.515398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:45.599141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498726+0000","last_change":"2023-03-08T15:49:39.505726+0000","last_active":"2023-03-08T15:49:40.498726+0000","last_peered":"2023-03-08T15:49:40.498726+0000","last_clean":"2023-03-08T15:49:40.498726+0000","last_became_active":"2023-03-08T15:49:39.505103+0000","last_became_peered":"2023-03-08T15:49:39.505103+0000","last_unstale":"2023-03-08T15:49:40.498726+0000","last_undegraded":"2023-03-08T15:49:40.498726+0000","last_fullsized":"2023-03-08T15:49:40.498726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:01:00.216256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516218+0000","last_change":"2023-03-08T15:49:39.520100+0000","last_active":"2023-03-08T15:49:40.516218+0000","last_peered":"2023-03-08T15:49:40.516218+0000","last_clean":"2023-03-08T15:49:40.516218+0000","last_became_active":"2023-03-08T15:49:39.519799+0000","last_became_peered":"2023-03-08T15:49:39.519799+0000","last_unstale":"2023-03-08T15:49:40.516218+0000","last_undegraded":"2023-03-08T15:49:40.516218+0000","last_fullsized":"2023-03-08T15:49:40.516218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515704+0000","last_change":"2023-03-08T15:49:39.513354+0000","last_active":"2023-03-08T15:49:40.515704+0000","last_peered":"2023-03-08T15:49:40.515704+0000","last_clean":"2023-03-08T15:49:40.515704+0000","last_became_active":"2023-03-08T15:49:39.513104+0000","last_became_peered":"2023-03-08T15:49:39.513104+0000","last_unstale":"2023-03-08T15:49:40.515704+0000","last_undegraded":"2023-03-08T15:49:40.515704+0000","last_fullsized":"2023-03-08T15:49:40.515704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497212+0000","last_change":"2023-03-08T15:49:39.505113+0000","last_active":"2023-03-08T15:49:40.497212+0000","last_peered":"2023-03-08T15:49:40.497212+0000","last_clean":"2023-03-08T15:49:40.497212+0000","last_became_active":"2023-03-08T15:49:39.504875+0000","last_became_peered":"2023-03-08T15:49:39.504875+0000","last_unstale":"2023-03-08T15:49:40.497212+0000","last_undegraded":"2023-03-08T15:49:40.497212+0000","last_fullsized":"2023-03-08T15:49:40.497212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:03:30.032957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516293+0000","last_change":"2023-03-08T15:49:39.520457+0000","last_active":"2023-03-08T15:49:40.516293+0000","last_peered":"2023-03-08T15:49:40.516293+0000","last_clean":"2023-03-08T15:49:40.516293+0000","last_became_active":"2023-03-08T15:49:39.520170+0000","last_became_peered":"2023-03-08T15:49:39.520170+0000","last_unstale":"2023-03-08T15:49:40.516293+0000","last_undegraded":"2023-03-08T15:49:40.516293+0000","last_fullsized":"2023-03-08T15:49:40.516293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499040+0000","last_change":"2023-03-08T15:49:39.505287+0000","last_active":"2023-03-08T15:49:40.499040+0000","last_peered":"2023-03-08T15:49:40.499040+0000","last_clean":"2023-03-08T15:49:40.499040+0000","last_became_active":"2023-03-08T15:49:39.505030+0000","last_became_peered":"2023-03-08T15:49:39.505030+0000","last_unstale":"2023-03-08T15:49:40.499040+0000","last_undegraded":"2023-03-08T15:49:40.499040+0000","last_fullsized":"2023-03-08T15:49:40.499040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:42:50.682185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499114+0000","last_change":"2023-03-08T15:49:39.509614+0000","last_active":"2023-03-08T15:49:40.499114+0000","last_peered":"2023-03-08T15:49:40.499114+0000","last_clean":"2023-03-08T15:49:40.499114+0000","last_became_active":"2023-03-08T15:49:39.509049+0000","last_became_peered":"2023-03-08T15:49:39.509049+0000","last_unstale":"2023-03-08T15:49:40.499114+0000","last_undegraded":"2023-03-08T15:49:40.499114+0000","last_fullsized":"2023-03-08T15:49:40.499114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516066+0000","last_change":"2023-03-08T15:49:39.518389+0000","last_active":"2023-03-08T15:49:40.516066+0000","last_peered":"2023-03-08T15:49:40.516066+0000","last_clean":"2023-03-08T15:49:40.516066+0000","last_became_active":"2023-03-08T15:49:39.518107+0000","last_became_peered":"2023-03-08T15:49:39.518107+0000","last_unstale":"2023-03-08T15:49:40.516066+0000","last_undegraded":"2023-03-08T15:49:40.516066+0000","last_fullsized":"2023-03-08T15:49:40.516066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498736+0000","last_change":"2023-03-08T15:49:39.076740+0000","last_active":"2023-03-08T15:49:40.498736+0000","last_peered":"2023-03-08T15:49:40.498736+0000","last_clean":"2023-03-08T15:49:40.498736+0000","last_became_active":"2023-03-08T15:49:39.075420+0000","last_became_peered":"2023-03-08T15:49:39.075420+0000","last_unstale":"2023-03-08T15:49:40.498736+0000","last_undegraded":"2023-03-08T15:49:40.498736+0000","last_fullsized":"2023-03-08T15:49:40.498736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:39:52.448950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497861+0000","last_change":"2023-03-08T15:49:39.506581+0000","last_active":"2023-03-08T15:49:40.497861+0000","last_peered":"2023-03-08T15:49:40.497861+0000","last_clean":"2023-03-08T15:49:40.497861+0000","last_became_active":"2023-03-08T15:49:39.505867+0000","last_became_peered":"2023-03-08T15:49:39.505867+0000","last_unstale":"2023-03-08T15:49:40.497861+0000","last_undegraded":"2023-03-08T15:49:40.497861+0000","last_fullsized":"2023-03-08T15:49:40.497861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:41:05.974121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498634+0000","last_change":"2023-03-08T15:49:39.064465+0000","last_active":"2023-03-08T15:49:40.498634+0000","last_peered":"2023-03-08T15:49:40.498634+0000","last_clean":"2023-03-08T15:49:40.498634+0000","last_became_active":"2023-03-08T15:49:39.064180+0000","last_became_peered":"2023-03-08T15:49:39.064180+0000","last_unstale":"2023-03-08T15:49:40.498634+0000","last_undegraded":"2023-03-08T15:49:40.498634+0000","last_fullsized":"2023-03-08T15:49:40.498634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515371+0000","last_change":"2023-03-08T15:49:39.517781+0000","last_active":"2023-03-08T15:49:40.515371+0000","last_peered":"2023-03-08T15:49:40.515371+0000","last_clean":"2023-03-08T15:49:40.515371+0000","last_became_active":"2023-03-08T15:49:39.517522+0000","last_became_peered":"2023-03-08T15:49:39.517522+0000","last_unstale":"2023-03-08T15:49:40.515371+0000","last_undegraded":"2023-03-08T15:49:40.515371+0000","last_fullsized":"2023-03-08T15:49:40.515371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:59:37.837477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497190+0000","last_change":"2023-03-08T15:49:39.073238+0000","last_active":"2023-03-08T15:49:40.497190+0000","last_peered":"2023-03-08T15:49:40.497190+0000","last_clean":"2023-03-08T15:49:40.497190+0000","last_became_active":"2023-03-08T15:49:39.072946+0000","last_became_peered":"2023-03-08T15:49:39.072946+0000","last_unstale":"2023-03-08T15:49:40.497190+0000","last_undegraded":"2023-03-08T15:49:40.497190+0000","last_fullsized":"2023-03-08T15:49:40.497190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:07:57.155564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516703+0000","last_change":"2023-03-08T15:49:39.511074+0000","last_active":"2023-03-08T15:49:40.516703+0000","last_peered":"2023-03-08T15:49:40.516703+0000","last_clean":"2023-03-08T15:49:40.516703+0000","last_became_active":"2023-03-08T15:49:39.510818+0000","last_became_peered":"2023-03-08T15:49:39.510818+0000","last_unstale":"2023-03-08T15:49:40.516703+0000","last_undegraded":"2023-03-08T15:49:40.516703+0000","last_fullsized":"2023-03-08T15:49:40.516703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:04.540991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515561+0000","last_change":"2023-03-08T15:49:39.070465+0000","last_active":"2023-03-08T15:49:40.515561+0000","last_peered":"2023-03-08T15:49:40.515561+0000","last_clean":"2023-03-08T15:49:40.515561+0000","last_became_active":"2023-03-08T15:49:39.069996+0000","last_became_peered":"2023-03-08T15:49:39.069996+0000","last_unstale":"2023-03-08T15:49:40.515561+0000","last_undegraded":"2023-03-08T15:49:40.515561+0000","last_fullsized":"2023-03-08T15:49:40.515561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:53.868715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497272+0000","last_change":"2023-03-08T15:49:39.506567+0000","last_active":"2023-03-08T15:49:40.497272+0000","last_peered":"2023-03-08T15:49:40.497272+0000","last_clean":"2023-03-08T15:49:40.497272+0000","last_became_active":"2023-03-08T15:49:39.506069+0000","last_became_peered":"2023-03-08T15:49:39.506069+0000","last_unstale":"2023-03-08T15:49:40.497272+0000","last_undegraded":"2023-03-08T15:49:40.497272+0000","last_fullsized":"2023-03-08T15:49:40.497272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:02:38.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516579+0000","last_change":"2023-03-08T15:49:39.071437+0000","last_active":"2023-03-08T15:49:40.516579+0000","last_peered":"2023-03-08T15:49:40.516579+0000","last_clean":"2023-03-08T15:49:40.516579+0000","last_became_active":"2023-03-08T15:49:39.071152+0000","last_became_peered":"2023-03-08T15:49:39.071152+0000","last_unstale":"2023-03-08T15:49:40.516579+0000","last_undegraded":"2023-03-08T15:49:40.516579+0000","last_fullsized":"2023-03-08T15:49:40.516579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:21.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497294+0000","last_change":"2023-03-08T15:49:39.517658+0000","last_active":"2023-03-08T15:49:40.497294+0000","last_peered":"2023-03-08T15:49:40.497294+0000","last_clean":"2023-03-08T15:49:40.497294+0000","last_became_active":"2023-03-08T15:49:39.517399+0000","last_became_peered":"2023-03-08T15:49:39.517399+0000","last_unstale":"2023-03-08T15:49:40.497294+0000","last_undegraded":"2023-03-08T15:49:40.497294+0000","last_fullsized":"2023-03-08T15:49:40.497294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:07:36.774920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516663+0000","last_change":"2023-03-08T15:49:39.067519+0000","last_active":"2023-03-08T15:49:40.516663+0000","last_peered":"2023-03-08T15:49:40.516663+0000","last_clean":"2023-03-08T15:49:40.516663+0000","last_became_active":"2023-03-08T15:49:39.067254+0000","last_became_peered":"2023-03-08T15:49:39.067254+0000","last_unstale":"2023-03-08T15:49:40.516663+0000","last_undegraded":"2023-03-08T15:49:40.516663+0000","last_fullsized":"2023-03-08T15:49:40.516663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498632+0000","last_change":"2023-03-08T15:49:39.504530+0000","last_active":"2023-03-08T15:49:40.498632+0000","last_peered":"2023-03-08T15:49:40.498632+0000","last_clean":"2023-03-08T15:49:40.498632+0000","last_became_active":"2023-03-08T15:49:39.504282+0000","last_became_peered":"2023-03-08T15:49:39.504282+0000","last_unstale":"2023-03-08T15:49:40.498632+0000","last_undegraded":"2023-03-08T15:49:40.498632+0000","last_fullsized":"2023-03-08T15:49:40.498632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:11:06.014260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498452+0000","last_change":"2023-03-08T15:49:39.077464+0000","last_active":"2023-03-08T15:49:40.498452+0000","last_peered":"2023-03-08T15:49:40.498452+0000","last_clean":"2023-03-08T15:49:40.498452+0000","last_became_active":"2023-03-08T15:49:39.077166+0000","last_became_peered":"2023-03-08T15:49:39.077166+0000","last_unstale":"2023-03-08T15:49:40.498452+0000","last_undegraded":"2023-03-08T15:49:40.498452+0000","last_fullsized":"2023-03-08T15:49:40.498452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498301+0000","last_change":"2023-03-08T15:49:39.503655+0000","last_active":"2023-03-08T15:49:40.498301+0000","last_peered":"2023-03-08T15:49:40.498301+0000","last_clean":"2023-03-08T15:49:40.498301+0000","last_became_active":"2023-03-08T15:49:39.503231+0000","last_became_peered":"2023-03-08T15:49:39.503231+0000","last_unstale":"2023-03-08T15:49:40.498301+0000","last_undegraded":"2023-03-08T15:49:40.498301+0000","last_fullsized":"2023-03-08T15:49:40.498301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:17:21.576214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516115+0000","last_change":"2023-03-08T15:49:39.079358+0000","last_active":"2023-03-08T15:49:40.516115+0000","last_peered":"2023-03-08T15:49:40.516115+0000","last_clean":"2023-03-08T15:49:40.516115+0000","last_became_active":"2023-03-08T15:49:39.079094+0000","last_became_peered":"2023-03-08T15:49:39.079094+0000","last_unstale":"2023-03-08T15:49:40.516115+0000","last_undegraded":"2023-03-08T15:49:40.516115+0000","last_fullsized":"2023-03-08T15:49:40.516115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:03.536123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497687+0000","last_change":"2023-03-08T15:49:39.506844+0000","last_active":"2023-03-08T15:49:40.497687+0000","last_peered":"2023-03-08T15:49:40.497687+0000","last_clean":"2023-03-08T15:49:40.497687+0000","last_became_active":"2023-03-08T15:49:39.506035+0000","last_became_peered":"2023-03-08T15:49:39.506035+0000","last_unstale":"2023-03-08T15:49:40.497687+0000","last_undegraded":"2023-03-08T15:49:40.497687+0000","last_fullsized":"2023-03-08T15:49:40.497687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515656+0000","last_change":"2023-03-08T15:49:39.072231+0000","last_active":"2023-03-08T15:49:40.515656+0000","last_peered":"2023-03-08T15:49:40.515656+0000","last_clean":"2023-03-08T15:49:40.515656+0000","last_became_active":"2023-03-08T15:49:39.071935+0000","last_became_peered":"2023-03-08T15:49:39.071935+0000","last_unstale":"2023-03-08T15:49:40.515656+0000","last_undegraded":"2023-03-08T15:49:40.515656+0000","last_fullsized":"2023-03-08T15:49:40.515656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:21.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516172+0000","last_change":"2023-03-08T15:49:39.518337+0000","last_active":"2023-03-08T15:49:40.516172+0000","last_peered":"2023-03-08T15:49:40.516172+0000","last_clean":"2023-03-08T15:49:40.516172+0000","last_became_active":"2023-03-08T15:49:39.517689+0000","last_became_peered":"2023-03-08T15:49:39.517689+0000","last_unstale":"2023-03-08T15:49:40.516172+0000","last_undegraded":"2023-03-08T15:49:40.516172+0000","last_fullsized":"2023-03-08T15:49:40.516172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515907+0000","last_change":"2023-03-08T15:49:39.076491+0000","last_active":"2023-03-08T15:49:40.515907+0000","last_peered":"2023-03-08T15:49:40.515907+0000","last_clean":"2023-03-08T15:49:40.515907+0000","last_became_active":"2023-03-08T15:49:39.076238+0000","last_became_peered":"2023-03-08T15:49:39.076238+0000","last_unstale":"2023-03-08T15:49:40.515907+0000","last_undegraded":"2023-03-08T15:49:40.515907+0000","last_fullsized":"2023-03-08T15:49:40.515907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:13:15.662118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515323+0000","last_change":"2023-03-08T15:49:39.508617+0000","last_active":"2023-03-08T15:49:40.515323+0000","last_peered":"2023-03-08T15:49:40.515323+0000","last_clean":"2023-03-08T15:49:40.515323+0000","last_became_active":"2023-03-08T15:49:39.508246+0000","last_became_peered":"2023-03-08T15:49:39.508246+0000","last_unstale":"2023-03-08T15:49:40.515323+0000","last_undegraded":"2023-03-08T15:49:40.515323+0000","last_fullsized":"2023-03-08T15:49:40.515323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:07:36.774920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515652+0000","last_change":"2023-03-08T15:49:39.072472+0000","last_active":"2023-03-08T15:49:40.515652+0000","last_peered":"2023-03-08T15:49:40.515652+0000","last_clean":"2023-03-08T15:49:40.515652+0000","last_became_active":"2023-03-08T15:49:39.072182+0000","last_became_peered":"2023-03-08T15:49:39.072182+0000","last_unstale":"2023-03-08T15:49:40.515652+0000","last_undegraded":"2023-03-08T15:49:40.515652+0000","last_fullsized":"2023-03-08T15:49:40.515652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:02:08.526616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498081+0000","last_change":"2023-03-08T15:49:39.517141+0000","last_active":"2023-03-08T15:49:40.498081+0000","last_peered":"2023-03-08T15:49:40.498081+0000","last_clean":"2023-03-08T15:49:40.498081+0000","last_became_active":"2023-03-08T15:49:39.516875+0000","last_became_peered":"2023-03-08T15:49:39.516875+0000","last_unstale":"2023-03-08T15:49:40.498081+0000","last_undegraded":"2023-03-08T15:49:40.498081+0000","last_fullsized":"2023-03-08T15:49:40.498081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515921+0000","last_change":"2023-03-08T15:49:39.072643+0000","last_active":"2023-03-08T15:49:40.515921+0000","last_peered":"2023-03-08T15:49:40.515921+0000","last_clean":"2023-03-08T15:49:40.515921+0000","last_became_active":"2023-03-08T15:49:39.072348+0000","last_became_peered":"2023-03-08T15:49:39.072348+0000","last_unstale":"2023-03-08T15:49:40.515921+0000","last_undegraded":"2023-03-08T15:49:40.515921+0000","last_fullsized":"2023-03-08T15:49:40.515921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:08:09.084589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515584+0000","last_change":"2023-03-08T15:49:39.518066+0000","last_active":"2023-03-08T15:49:40.515584+0000","last_peered":"2023-03-08T15:49:40.515584+0000","last_clean":"2023-03-08T15:49:40.515584+0000","last_became_active":"2023-03-08T15:49:39.517777+0000","last_became_peered":"2023-03-08T15:49:39.517777+0000","last_unstale":"2023-03-08T15:49:40.515584+0000","last_undegraded":"2023-03-08T15:49:40.515584+0000","last_fullsized":"2023-03-08T15:49:40.515584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516345+0000","last_change":"2023-03-08T15:49:39.078315+0000","last_active":"2023-03-08T15:49:40.516345+0000","last_peered":"2023-03-08T15:49:40.516345+0000","last_clean":"2023-03-08T15:49:40.516345+0000","last_became_active":"2023-03-08T15:49:39.078043+0000","last_became_peered":"2023-03-08T15:49:39.078043+0000","last_unstale":"2023-03-08T15:49:40.516345+0000","last_undegraded":"2023-03-08T15:49:40.516345+0000","last_fullsized":"2023-03-08T15:49:40.516345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:11:05.009391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498117+0000","last_change":"2023-03-08T15:49:39.513221+0000","last_active":"2023-03-08T15:49:40.498117+0000","last_peered":"2023-03-08T15:49:40.498117+0000","last_clean":"2023-03-08T15:49:40.498117+0000","last_became_active":"2023-03-08T15:49:39.512950+0000","last_became_peered":"2023-03-08T15:49:39.512950+0000","last_unstale":"2023-03-08T15:49:40.498117+0000","last_undegraded":"2023-03-08T15:49:40.498117+0000","last_fullsized":"2023-03-08T15:49:40.498117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:21:14.610275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516833+0000","last_change":"2023-03-08T15:49:39.068973+0000","last_active":"2023-03-08T15:49:40.516833+0000","last_peered":"2023-03-08T15:49:40.516833+0000","last_clean":"2023-03-08T15:49:40.516833+0000","last_became_active":"2023-03-08T15:49:39.068694+0000","last_became_peered":"2023-03-08T15:49:39.068694+0000","last_unstale":"2023-03-08T15:49:40.516833+0000","last_undegraded":"2023-03-08T15:49:40.516833+0000","last_fullsized":"2023-03-08T15:49:40.516833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:55:20.097052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515855+0000","last_change":"2023-03-08T15:49:39.510470+0000","last_active":"2023-03-08T15:49:40.515855+0000","last_peered":"2023-03-08T15:49:40.515855+0000","last_clean":"2023-03-08T15:49:40.515855+0000","last_became_active":"2023-03-08T15:49:39.510205+0000","last_became_peered":"2023-03-08T15:49:39.510205+0000","last_unstale":"2023-03-08T15:49:40.515855+0000","last_undegraded":"2023-03-08T15:49:40.515855+0000","last_fullsized":"2023-03-08T15:49:40.515855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:45.599141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515854+0000","last_change":"2023-03-08T15:49:39.067592+0000","last_active":"2023-03-08T15:49:40.515854+0000","last_peered":"2023-03-08T15:49:40.515854+0000","last_clean":"2023-03-08T15:49:40.515854+0000","last_became_active":"2023-03-08T15:49:39.067309+0000","last_became_peered":"2023-03-08T15:49:39.067309+0000","last_unstale":"2023-03-08T15:49:40.515854+0000","last_undegraded":"2023-03-08T15:49:40.515854+0000","last_fullsized":"2023-03-08T15:49:40.515854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:53.868715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.514896+0000","last_change":"2023-03-08T15:49:39.510190+0000","last_active":"2023-03-08T15:49:40.514896+0000","last_peered":"2023-03-08T15:49:40.514896+0000","last_clean":"2023-03-08T15:49:40.514896+0000","last_became_active":"2023-03-08T15:49:39.509892+0000","last_became_peered":"2023-03-08T15:49:39.509892+0000","last_unstale":"2023-03-08T15:49:40.514896+0000","last_undegraded":"2023-03-08T15:49:40.514896+0000","last_fullsized":"2023-03-08T15:49:40.514896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:09:32.633312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497690+0000","last_change":"2023-03-08T15:49:39.073755+0000","last_active":"2023-03-08T15:49:40.497690+0000","last_peered":"2023-03-08T15:49:40.497690+0000","last_clean":"2023-03-08T15:49:40.497690+0000","last_became_active":"2023-03-08T15:49:39.073472+0000","last_became_peered":"2023-03-08T15:49:39.073472+0000","last_unstale":"2023-03-08T15:49:40.497690+0000","last_undegraded":"2023-03-08T15:49:40.497690+0000","last_fullsized":"2023-03-08T15:49:40.497690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:03:53.868715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498326+0000","last_change":"2023-03-08T15:49:39.505358+0000","last_active":"2023-03-08T15:49:40.498326+0000","last_peered":"2023-03-08T15:49:40.498326+0000","last_clean":"2023-03-08T15:49:40.498326+0000","last_became_active":"2023-03-08T15:49:39.504755+0000","last_became_peered":"2023-03-08T15:49:39.504755+0000","last_unstale":"2023-03-08T15:49:40.498326+0000","last_undegraded":"2023-03-08T15:49:40.498326+0000","last_fullsized":"2023-03-08T15:49:40.498326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:03:30.032957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515748+0000","last_change":"2023-03-08T15:49:39.076072+0000","last_active":"2023-03-08T15:49:40.515748+0000","last_peered":"2023-03-08T15:49:40.515748+0000","last_clean":"2023-03-08T15:49:40.515748+0000","last_became_active":"2023-03-08T15:49:39.075810+0000","last_became_peered":"2023-03-08T15:49:39.075810+0000","last_unstale":"2023-03-08T15:49:40.515748+0000","last_undegraded":"2023-03-08T15:49:40.515748+0000","last_fullsized":"2023-03-08T15:49:40.515748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498686+0000","last_change":"2023-03-08T15:49:39.505109+0000","last_active":"2023-03-08T15:49:40.498686+0000","last_peered":"2023-03-08T15:49:40.498686+0000","last_clean":"2023-03-08T15:49:40.498686+0000","last_became_active":"2023-03-08T15:49:39.504889+0000","last_became_peered":"2023-03-08T15:49:39.504889+0000","last_unstale":"2023-03-08T15:49:40.498686+0000","last_undegraded":"2023-03-08T15:49:40.498686+0000","last_fullsized":"2023-03-08T15:49:40.498686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:43:09.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498254+0000","last_change":"2023-03-08T15:49:39.077380+0000","last_active":"2023-03-08T15:49:40.498254+0000","last_peered":"2023-03-08T15:49:40.498254+0000","last_clean":"2023-03-08T15:49:40.498254+0000","last_became_active":"2023-03-08T15:49:39.077041+0000","last_became_peered":"2023-03-08T15:49:39.077041+0000","last_unstale":"2023-03-08T15:49:40.498254+0000","last_undegraded":"2023-03-08T15:49:40.498254+0000","last_fullsized":"2023-03-08T15:49:40.498254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:02:08.526616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498825+0000","last_change":"2023-03-08T15:49:39.512506+0000","last_active":"2023-03-08T15:49:40.498825+0000","last_peered":"2023-03-08T15:49:40.498825+0000","last_clean":"2023-03-08T15:49:40.498825+0000","last_became_active":"2023-03-08T15:49:39.512103+0000","last_became_peered":"2023-03-08T15:49:39.512103+0000","last_unstale":"2023-03-08T15:49:40.498825+0000","last_undegraded":"2023-03-08T15:49:40.498825+0000","last_fullsized":"2023-03-08T15:49:40.498825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:09:32.633312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497106+0000","last_change":"2023-03-08T15:49:39.065317+0000","last_active":"2023-03-08T15:49:40.497106+0000","last_peered":"2023-03-08T15:49:40.497106+0000","last_clean":"2023-03-08T15:49:40.497106+0000","last_became_active":"2023-03-08T15:49:39.065033+0000","last_became_peered":"2023-03-08T15:49:39.065033+0000","last_unstale":"2023-03-08T15:49:40.497106+0000","last_undegraded":"2023-03-08T15:49:40.497106+0000","last_fullsized":"2023-03-08T15:49:40.497106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:46:42.325651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499131+0000","last_change":"2023-03-08T15:49:39.508113+0000","last_active":"2023-03-08T15:49:40.499131+0000","last_peered":"2023-03-08T15:49:40.499131+0000","last_clean":"2023-03-08T15:49:40.499131+0000","last_became_active":"2023-03-08T15:49:39.507782+0000","last_became_peered":"2023-03-08T15:49:39.507782+0000","last_unstale":"2023-03-08T15:49:40.499131+0000","last_undegraded":"2023-03-08T15:49:40.499131+0000","last_fullsized":"2023-03-08T15:49:40.499131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:17:16.405869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.497607+0000","last_change":"2023-03-08T15:49:34.914364+0000","last_active":"2023-03-08T15:49:39.497607+0000","last_peered":"2023-03-08T15:49:39.497607+0000","last_clean":"2023-03-08T15:49:39.497607+0000","last_became_active":"2023-03-08T15:49:34.914037+0000","last_became_peered":"2023-03-08T15:49:34.914037+0000","last_unstale":"2023-03-08T15:49:39.497607+0000","last_undegraded":"2023-03-08T15:49:39.497607+0000","last_fullsized":"2023-03-08T15:49:39.497607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:55:29.151326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516267+0000","last_change":"2023-03-08T15:49:39.071150+0000","last_active":"2023-03-08T15:49:40.516267+0000","last_peered":"2023-03-08T15:49:40.516267+0000","last_clean":"2023-03-08T15:49:40.516267+0000","last_became_active":"2023-03-08T15:49:39.070851+0000","last_became_peered":"2023-03-08T15:49:39.070851+0000","last_unstale":"2023-03-08T15:49:40.516267+0000","last_undegraded":"2023-03-08T15:49:40.516267+0000","last_fullsized":"2023-03-08T15:49:40.516267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498773+0000","last_change":"2023-03-08T15:49:39.513676+0000","last_active":"2023-03-08T15:49:40.498773+0000","last_peered":"2023-03-08T15:49:40.498773+0000","last_clean":"2023-03-08T15:49:40.498773+0000","last_became_active":"2023-03-08T15:49:39.513236+0000","last_became_peered":"2023-03-08T15:49:39.513236+0000","last_unstale":"2023-03-08T15:49:40.498773+0000","last_undegraded":"2023-03-08T15:49:40.498773+0000","last_fullsized":"2023-03-08T15:49:40.498773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:15:10.927104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.500443+0000","last_change":"2023-03-08T15:49:34.036801+0000","last_active":"2023-03-08T15:49:39.500443+0000","last_peered":"2023-03-08T15:49:39.500443+0000","last_clean":"2023-03-08T15:49:39.500443+0000","last_became_active":"2023-03-08T15:49:34.036484+0000","last_became_peered":"2023-03-08T15:49:34.036484+0000","last_unstale":"2023-03-08T15:49:39.500443+0000","last_undegraded":"2023-03-08T15:49:39.500443+0000","last_fullsized":"2023-03-08T15:49:39.500443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498573+0000","last_change":"2023-03-08T15:49:39.077024+0000","last_active":"2023-03-08T15:49:40.498573+0000","last_peered":"2023-03-08T15:49:40.498573+0000","last_clean":"2023-03-08T15:49:40.498573+0000","last_became_active":"2023-03-08T15:49:39.075919+0000","last_became_peered":"2023-03-08T15:49:39.075919+0000","last_unstale":"2023-03-08T15:49:40.498573+0000","last_undegraded":"2023-03-08T15:49:40.498573+0000","last_fullsized":"2023-03-08T15:49:40.498573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:53:57.255123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498923+0000","last_change":"2023-03-08T15:49:39.506861+0000","last_active":"2023-03-08T15:49:40.498923+0000","last_peered":"2023-03-08T15:49:40.498923+0000","last_clean":"2023-03-08T15:49:40.498923+0000","last_became_active":"2023-03-08T15:49:39.506532+0000","last_became_peered":"2023-03-08T15:49:39.506532+0000","last_unstale":"2023-03-08T15:49:40.498923+0000","last_undegraded":"2023-03-08T15:49:40.498923+0000","last_fullsized":"2023-03-08T15:49:40.498923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:00:21.073657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.494252+0000","last_change":"2023-03-08T15:49:34.968598+0000","last_active":"2023-03-08T15:49:39.494252+0000","last_peered":"2023-03-08T15:49:39.494252+0000","last_clean":"2023-03-08T15:49:39.494252+0000","last_became_active":"2023-03-08T15:49:34.968300+0000","last_became_peered":"2023-03-08T15:49:34.968300+0000","last_unstale":"2023-03-08T15:49:39.494252+0000","last_undegraded":"2023-03-08T15:49:39.494252+0000","last_fullsized":"2023-03-08T15:49:39.494252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:39:14.985725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498575+0000","last_change":"2023-03-08T15:49:39.069250+0000","last_active":"2023-03-08T15:49:40.498575+0000","last_peered":"2023-03-08T15:49:40.498575+0000","last_clean":"2023-03-08T15:49:40.498575+0000","last_became_active":"2023-03-08T15:49:39.068876+0000","last_became_peered":"2023-03-08T15:49:39.068876+0000","last_unstale":"2023-03-08T15:49:40.498575+0000","last_undegraded":"2023-03-08T15:49:40.498575+0000","last_fullsized":"2023-03-08T15:49:40.498575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:53:57.255123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.499084+0000","last_change":"2023-03-08T15:49:39.510119+0000","last_active":"2023-03-08T15:49:40.499084+0000","last_peered":"2023-03-08T15:49:40.499084+0000","last_clean":"2023-03-08T15:49:40.499084+0000","last_became_active":"2023-03-08T15:49:39.509867+0000","last_became_peered":"2023-03-08T15:49:39.509867+0000","last_unstale":"2023-03-08T15:49:40.499084+0000","last_undegraded":"2023-03-08T15:49:40.499084+0000","last_fullsized":"2023-03-08T15:49:40.499084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:59:37.837477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.497279+0000","last_change":"2023-03-08T15:49:34.042076+0000","last_active":"2023-03-08T15:49:39.497279+0000","last_peered":"2023-03-08T15:49:39.497279+0000","last_clean":"2023-03-08T15:49:39.497279+0000","last_became_active":"2023-03-08T15:49:34.041670+0000","last_became_peered":"2023-03-08T15:49:34.041670+0000","last_unstale":"2023-03-08T15:49:39.497279+0000","last_undegraded":"2023-03-08T15:49:39.497279+0000","last_fullsized":"2023-03-08T15:49:39.497279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:46:37.870016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.509020+0000","last_change":"2023-03-08T15:49:27.814075+0000","last_active":"2023-03-08T15:49:39.509020+0000","last_peered":"2023-03-08T15:49:39.509020+0000","last_clean":"2023-03-08T15:49:39.509020+0000","last_became_active":"2023-03-08T15:49:27.813798+0000","last_became_peered":"2023-03-08T15:49:27.813798+0000","last_unstale":"2023-03-08T15:49:39.509020+0000","last_undegraded":"2023-03-08T15:49:39.509020+0000","last_fullsized":"2023-03-08T15:49:39.509020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_clean_scrub_stamp":"2023-03-08T15:49:26.430262+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:31:30.865216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497255+0000","last_change":"2023-03-08T15:49:39.067474+0000","last_active":"2023-03-08T15:49:40.497255+0000","last_peered":"2023-03-08T15:49:40.497255+0000","last_clean":"2023-03-08T15:49:40.497255+0000","last_became_active":"2023-03-08T15:49:39.067137+0000","last_became_peered":"2023-03-08T15:49:39.067137+0000","last_unstale":"2023-03-08T15:49:40.497255+0000","last_undegraded":"2023-03-08T15:49:40.497255+0000","last_fullsized":"2023-03-08T15:49:40.497255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:31:20.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516821+0000","last_change":"2023-03-08T15:49:39.514869+0000","last_active":"2023-03-08T15:49:40.516821+0000","last_peered":"2023-03-08T15:49:40.516821+0000","last_clean":"2023-03-08T15:49:40.516821+0000","last_became_active":"2023-03-08T15:49:39.514600+0000","last_became_peered":"2023-03-08T15:49:39.514600+0000","last_unstale":"2023-03-08T15:49:40.516821+0000","last_undegraded":"2023-03-08T15:49:40.516821+0000","last_fullsized":"2023-03-08T15:49:40.516821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:11:06.014260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.509646+0000","last_change":"2023-03-08T15:49:34.042085+0000","last_active":"2023-03-08T15:49:39.509646+0000","last_peered":"2023-03-08T15:49:39.509646+0000","last_clean":"2023-03-08T15:49:39.509646+0000","last_became_active":"2023-03-08T15:49:34.041754+0000","last_became_peered":"2023-03-08T15:49:34.041754+0000","last_unstale":"2023-03-08T15:49:39.509646+0000","last_undegraded":"2023-03-08T15:49:39.509646+0000","last_fullsized":"2023-03-08T15:49:39.509646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.514893+0000","last_change":"2023-03-08T15:49:39.072478+0000","last_active":"2023-03-08T15:49:40.514893+0000","last_peered":"2023-03-08T15:49:40.514893+0000","last_clean":"2023-03-08T15:49:40.514893+0000","last_became_active":"2023-03-08T15:49:39.072186+0000","last_became_peered":"2023-03-08T15:49:39.072186+0000","last_unstale":"2023-03-08T15:49:40.514893+0000","last_undegraded":"2023-03-08T15:49:40.514893+0000","last_fullsized":"2023-03-08T15:49:40.514893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:07:57.155564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515455+0000","last_change":"2023-03-08T15:49:39.511543+0000","last_active":"2023-03-08T15:49:40.515455+0000","last_peered":"2023-03-08T15:49:40.515455+0000","last_clean":"2023-03-08T15:49:40.515455+0000","last_became_active":"2023-03-08T15:49:39.511257+0000","last_became_peered":"2023-03-08T15:49:39.511257+0000","last_unstale":"2023-03-08T15:49:40.515455+0000","last_undegraded":"2023-03-08T15:49:40.515455+0000","last_fullsized":"2023-03-08T15:49:40.515455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:02:38.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.510687+0000","last_change":"2023-03-08T15:49:34.914757+0000","last_active":"2023-03-08T15:49:39.510687+0000","last_peered":"2023-03-08T15:49:39.510687+0000","last_clean":"2023-03-08T15:49:39.510687+0000","last_became_active":"2023-03-08T15:49:34.914391+0000","last_became_peered":"2023-03-08T15:49:34.914391+0000","last_unstale":"2023-03-08T15:49:39.510687+0000","last_undegraded":"2023-03-08T15:49:39.510687+0000","last_fullsized":"2023-03-08T15:49:39.510687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:09:02.620210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498918+0000","last_change":"2023-03-08T15:49:39.069904+0000","last_active":"2023-03-08T15:49:40.498918+0000","last_peered":"2023-03-08T15:49:40.498918+0000","last_clean":"2023-03-08T15:49:40.498918+0000","last_became_active":"2023-03-08T15:49:39.069513+0000","last_became_peered":"2023-03-08T15:49:39.069513+0000","last_unstale":"2023-03-08T15:49:40.498918+0000","last_undegraded":"2023-03-08T15:49:40.498918+0000","last_fullsized":"2023-03-08T15:49:40.498918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:29:04.866450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515223+0000","last_change":"2023-03-08T15:49:39.512846+0000","last_active":"2023-03-08T15:49:40.515223+0000","last_peered":"2023-03-08T15:49:40.515223+0000","last_clean":"2023-03-08T15:49:40.515223+0000","last_became_active":"2023-03-08T15:49:39.512561+0000","last_became_peered":"2023-03-08T15:49:39.512561+0000","last_unstale":"2023-03-08T15:49:40.515223+0000","last_undegraded":"2023-03-08T15:49:40.515223+0000","last_fullsized":"2023-03-08T15:49:40.515223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498020+0000","last_change":"2023-03-08T15:49:39.067777+0000","last_active":"2023-03-08T15:49:40.498020+0000","last_peered":"2023-03-08T15:49:40.498020+0000","last_clean":"2023-03-08T15:49:40.498020+0000","last_became_active":"2023-03-08T15:49:39.067461+0000","last_became_peered":"2023-03-08T15:49:39.067461+0000","last_unstale":"2023-03-08T15:49:40.498020+0000","last_undegraded":"2023-03-08T15:49:40.498020+0000","last_fullsized":"2023-03-08T15:49:40.498020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:22:21.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.498744+0000","last_change":"2023-03-08T15:49:34.039636+0000","last_active":"2023-03-08T15:49:39.498744+0000","last_peered":"2023-03-08T15:49:39.498744+0000","last_clean":"2023-03-08T15:49:39.498744+0000","last_became_active":"2023-03-08T15:49:34.039383+0000","last_became_peered":"2023-03-08T15:49:34.039383+0000","last_unstale":"2023-03-08T15:49:39.498744+0000","last_undegraded":"2023-03-08T15:49:39.498744+0000","last_fullsized":"2023-03-08T15:49:39.498744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:27:38.358539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497091+0000","last_change":"2023-03-08T15:49:39.518195+0000","last_active":"2023-03-08T15:49:40.497091+0000","last_peered":"2023-03-08T15:49:40.497091+0000","last_clean":"2023-03-08T15:49:40.497091+0000","last_became_active":"2023-03-08T15:49:39.517992+0000","last_became_peered":"2023-03-08T15:49:39.517992+0000","last_unstale":"2023-03-08T15:49:40.497091+0000","last_undegraded":"2023-03-08T15:49:40.497091+0000","last_fullsized":"2023-03-08T15:49:40.497091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-08T15:49:39.498866+0000","last_change":"2023-03-08T15:49:34.040711+0000","last_active":"2023-03-08T15:49:39.498866+0000","last_peered":"2023-03-08T15:49:39.498866+0000","last_clean":"2023-03-08T15:49:39.498866+0000","last_became_active":"2023-03-08T15:49:34.040328+0000","last_became_peered":"2023-03-08T15:49:34.040328+0000","last_unstale":"2023-03-08T15:49:39.498866+0000","last_undegraded":"2023-03-08T15:49:39.498866+0000","last_fullsized":"2023-03-08T15:49:39.498866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:34:43.169713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:41.038333+0000","last_change":"2023-03-08T15:49:39.073837+0000","last_active":"2023-03-08T15:49:41.038333+0000","last_peered":"2023-03-08T15:49:41.038333+0000","last_clean":"2023-03-08T15:49:41.038333+0000","last_became_active":"2023-03-08T15:49:39.073103+0000","last_became_peered":"2023-03-08T15:49:39.073103+0000","last_unstale":"2023-03-08T15:49:41.038333+0000","last_undegraded":"2023-03-08T15:49:41.038333+0000","last_fullsized":"2023-03-08T15:49:41.038333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:53:57.255123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498138+0000","last_change":"2023-03-08T15:49:39.506282+0000","last_active":"2023-03-08T15:49:40.498138+0000","last_peered":"2023-03-08T15:49:40.498138+0000","last_clean":"2023-03-08T15:49:40.498138+0000","last_became_active":"2023-03-08T15:49:39.505963+0000","last_became_peered":"2023-03-08T15:49:39.505963+0000","last_unstale":"2023-03-08T15:49:40.498138+0000","last_undegraded":"2023-03-08T15:49:40.498138+0000","last_fullsized":"2023-03-08T15:49:40.498138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:18:53.422253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515312+0000","last_change":"2023-03-08T15:49:39.077529+0000","last_active":"2023-03-08T15:49:40.515312+0000","last_peered":"2023-03-08T15:49:40.515312+0000","last_clean":"2023-03-08T15:49:40.515312+0000","last_became_active":"2023-03-08T15:49:39.077214+0000","last_became_peered":"2023-03-08T15:49:39.077214+0000","last_unstale":"2023-03-08T15:49:40.515312+0000","last_undegraded":"2023-03-08T15:49:40.515312+0000","last_fullsized":"2023-03-08T15:49:40.515312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:31:20.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515304+0000","last_change":"2023-03-08T15:49:39.505582+0000","last_active":"2023-03-08T15:49:40.515304+0000","last_peered":"2023-03-08T15:49:40.515304+0000","last_clean":"2023-03-08T15:49:40.515304+0000","last_became_active":"2023-03-08T15:49:39.505317+0000","last_became_peered":"2023-03-08T15:49:39.505317+0000","last_unstale":"2023-03-08T15:49:40.515304+0000","last_undegraded":"2023-03-08T15:49:40.515304+0000","last_fullsized":"2023-03-08T15:49:40.515304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:31:21.040757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515757+0000","last_change":"2023-03-08T15:49:39.074108+0000","last_active":"2023-03-08T15:49:40.515757+0000","last_peered":"2023-03-08T15:49:40.515757+0000","last_clean":"2023-03-08T15:49:40.515757+0000","last_became_active":"2023-03-08T15:49:39.073843+0000","last_became_peered":"2023-03-08T15:49:39.073843+0000","last_unstale":"2023-03-08T15:49:40.515757+0000","last_undegraded":"2023-03-08T15:49:40.515757+0000","last_fullsized":"2023-03-08T15:49:40.515757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:13:15.662118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498719+0000","last_change":"2023-03-08T15:49:39.506927+0000","last_active":"2023-03-08T15:49:40.498719+0000","last_peered":"2023-03-08T15:49:40.498719+0000","last_clean":"2023-03-08T15:49:40.498719+0000","last_became_active":"2023-03-08T15:49:39.505636+0000","last_became_peered":"2023-03-08T15:49:39.505636+0000","last_unstale":"2023-03-08T15:49:40.498719+0000","last_undegraded":"2023-03-08T15:49:40.498719+0000","last_fullsized":"2023-03-08T15:49:40.498719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:21:33.395756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.516368+0000","last_change":"2023-03-08T15:49:39.073044+0000","last_active":"2023-03-08T15:49:40.516368+0000","last_peered":"2023-03-08T15:49:40.516368+0000","last_clean":"2023-03-08T15:49:40.516368+0000","last_became_active":"2023-03-08T15:49:39.072756+0000","last_became_peered":"2023-03-08T15:49:39.072756+0000","last_unstale":"2023-03-08T15:49:40.516368+0000","last_undegraded":"2023-03-08T15:49:40.516368+0000","last_fullsized":"2023-03-08T15:49:40.516368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:28:03.536123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498753+0000","last_change":"2023-03-08T15:49:39.500630+0000","last_active":"2023-03-08T15:49:40.498753+0000","last_peered":"2023-03-08T15:49:40.498753+0000","last_clean":"2023-03-08T15:49:40.498753+0000","last_became_active":"2023-03-08T15:49:39.500345+0000","last_became_peered":"2023-03-08T15:49:39.500345+0000","last_unstale":"2023-03-08T15:49:40.498753+0000","last_undegraded":"2023-03-08T15:49:40.498753+0000","last_fullsized":"2023-03-08T15:49:40.498753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:41:05.974121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497768+0000","last_change":"2023-03-08T15:49:39.066336+0000","last_active":"2023-03-08T15:49:40.497768+0000","last_peered":"2023-03-08T15:49:40.497768+0000","last_clean":"2023-03-08T15:49:40.497768+0000","last_became_active":"2023-03-08T15:49:39.066086+0000","last_became_peered":"2023-03-08T15:49:39.066086+0000","last_unstale":"2023-03-08T15:49:40.497768+0000","last_undegraded":"2023-03-08T15:49:40.497768+0000","last_fullsized":"2023-03-08T15:49:40.497768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497183+0000","last_change":"2023-03-08T15:49:39.501364+0000","last_active":"2023-03-08T15:49:40.497183+0000","last_peered":"2023-03-08T15:49:40.497183+0000","last_clean":"2023-03-08T15:49:40.497183+0000","last_became_active":"2023-03-08T15:49:39.501117+0000","last_became_peered":"2023-03-08T15:49:39.501117+0000","last_unstale":"2023-03-08T15:49:40.497183+0000","last_undegraded":"2023-03-08T15:49:40.497183+0000","last_fullsized":"2023-03-08T15:49:40.497183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:09:32.633312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515603+0000","last_change":"2023-03-08T15:49:39.070288+0000","last_active":"2023-03-08T15:49:40.515603+0000","last_peered":"2023-03-08T15:49:40.515603+0000","last_clean":"2023-03-08T15:49:40.515603+0000","last_became_active":"2023-03-08T15:49:39.069630+0000","last_became_peered":"2023-03-08T15:49:39.069630+0000","last_unstale":"2023-03-08T15:49:40.515603+0000","last_undegraded":"2023-03-08T15:49:40.515603+0000","last_fullsized":"2023-03-08T15:49:40.515603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:38.045950+0000","last_clean_scrub_stamp":"2023-03-08T15:49:38.045950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:52:44.594272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498057+0000","last_change":"2023-03-08T15:49:39.504481+0000","last_active":"2023-03-08T15:49:40.498057+0000","last_peered":"2023-03-08T15:49:40.498057+0000","last_clean":"2023-03-08T15:49:40.498057+0000","last_became_active":"2023-03-08T15:49:39.504153+0000","last_became_peered":"2023-03-08T15:49:39.504153+0000","last_unstale":"2023-03-08T15:49:40.498057+0000","last_undegraded":"2023-03-08T15:49:40.498057+0000","last_fullsized":"2023-03-08T15:49:40.498057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:35:39.586275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.515765+0000","last_change":"2023-03-08T15:49:39.512615+0000","last_active":"2023-03-08T15:49:40.515765+0000","last_peered":"2023-03-08T15:49:40.515765+0000","last_clean":"2023-03-08T15:49:40.515765+0000","last_became_active":"2023-03-08T15:49:39.511936+0000","last_became_peered":"2023-03-08T15:49:39.511936+0000","last_unstale":"2023-03-08T15:49:40.515765+0000","last_undegraded":"2023-03-08T15:49:40.515765+0000","last_fullsized":"2023-03-08T15:49:40.515765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:13:16.666986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497118+0000","last_change":"2023-03-08T15:49:39.506060+0000","last_active":"2023-03-08T15:49:40.497118+0000","last_peered":"2023-03-08T15:49:40.497118+0000","last_clean":"2023-03-08T15:49:40.497118+0000","last_became_active":"2023-03-08T15:49:39.505789+0000","last_became_peered":"2023-03-08T15:49:39.505789+0000","last_unstale":"2023-03-08T15:49:40.497118+0000","last_undegraded":"2023-03-08T15:49:40.497118+0000","last_fullsized":"2023-03-08T15:49:40.497118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:09:02.915110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498616+0000","last_change":"2023-03-08T15:49:39.504399+0000","last_active":"2023-03-08T15:49:40.498616+0000","last_peered":"2023-03-08T15:49:40.498616+0000","last_clean":"2023-03-08T15:49:40.498616+0000","last_became_active":"2023-03-08T15:49:39.504110+0000","last_became_peered":"2023-03-08T15:49:39.504110+0000","last_unstale":"2023-03-08T15:49:40.498616+0000","last_undegraded":"2023-03-08T15:49:40.498616+0000","last_fullsized":"2023-03-08T15:49:40.498616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:31:20.377122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.497746+0000","last_change":"2023-03-08T15:49:39.517458+0000","last_active":"2023-03-08T15:49:40.497746+0000","last_peered":"2023-03-08T15:49:40.497746+0000","last_clean":"2023-03-08T15:49:40.497746+0000","last_became_active":"2023-03-08T15:49:39.517225+0000","last_became_peered":"2023-03-08T15:49:39.517225+0000","last_unstale":"2023-03-08T15:49:40.497746+0000","last_undegraded":"2023-03-08T15:49:40.497746+0000","last_fullsized":"2023-03-08T15:49:40.497746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:50:03.036243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-08T15:49:40.498811+0000","last_change":"2023-03-08T15:49:39.518670+0000","last_active":"2023-03-08T15:49:40.498811+0000","last_peered":"2023-03-08T15:49:40.498811+0000","last_clean":"2023-03-08T15:49:40.498811+0000","last_became_active":"2023-03-08T15:49:39.518430+0000","last_became_peered":"2023-03-08T15:49:39.518430+0000","last_unstale":"2023-03-08T15:49:40.498811+0000","last_undegraded":"2023-03-08T15:49:40.498811+0000","last_fullsized":"2023-03-08T15:49:40.498811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:39.050818+0000","last_clean_scrub_stamp":"2023-03-08T15:49:39.050818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:05:33.965643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":681731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.7060000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8052,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363788,"statfs":{"total":96636764160,"available":96628518912,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.2750000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.3369999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.976000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9084,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362756,"statfs":{"total":96636764160,"available":96627462144,"internally_reserved":0,"allocated":839680,"data_stored":680533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.18099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7924,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363916,"statfs":{"total":96636764160,"available":96628649984,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.217000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5940000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.6369999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.4190000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.185}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.6859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.3800000000000008}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":91203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":90235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-08T15:49:48.560 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-03-08T15:49:48.560 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-03-08T15:49:48.561 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-03-08T15:49:48.561 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-03-08T15:49:48.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.708+0000 7f99007e0700 1 Processor -- start 2023-03-08T15:49:48.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.708+0000 7f99007e0700 1 -- start start 2023-03-08T15:49:48.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.709+0000 7f99007e0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f80bb350 0x7f98f81446b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:48.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.709+0000 7f99007e0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f814dc00 con 0x7f98f814e090 2023-03-08T15:49:48.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.709+0000 7f99007e0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f806bb70 con 0x7f98f8144bf0 2023-03-08T15:49:48.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.709+0000 7f99007e0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f80b9fc0 con 0x7f98f80bb350 2023-03-08T15:49:48.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.709+0000 7f98fed7d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f98f814e090 0x7f98f814e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33622/0 (socket says 172.21.15.123:33622) 2023-03-08T15:49:48.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.709+0000 7f98fed7d700 1 -- 172.21.15.123:0/3287755505 learned_addr learned my addr 172.21.15.123:0/3287755505 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:48.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.709+0000 7f98fe57c700 1 --2- 172.21.15.123:0/3287755505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f80bb350 0x7f98f81446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:48.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 -- 172.21.15.123:0/3287755505 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576385408 0 0) 0x7f98f814dc00 con 0x7f98f814e090 2023-03-08T15:49:48.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 -- 172.21.15.123:0/3287755505 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98e40035b0 con 0x7f98f814e090 2023-03-08T15:49:48.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 -- 172.21.15.123:0/3287755505 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1638243110 0 0) 0x7f98e40035b0 con 0x7f98f814e090 2023-03-08T15:49:48.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 -- 172.21.15.123:0/3287755505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f80bb350 msgr2=0x7f98f81446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:48.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 --2- 172.21.15.123:0/3287755505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f80bb350 0x7f98f81446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 -- 172.21.15.123:0/3287755505 >> v1:172.21.15.175:6789/0 conn(0x7f98f8144bf0 legacy=0x7f98f80bdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:48.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 -- 172.21.15.123:0/3287755505 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f80ba2a0 con 0x7f98f814e090 2023-03-08T15:49:48.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 -- 172.21.15.123:0/3287755505 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f98f00019f0 con 0x7f98f814e090 2023-03-08T15:49:48.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 -- 172.21.15.123:0/3287755505 >> v1:172.21.15.123:6789/0 conn(0x7f98f814e090 legacy=0x7f98f814e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:48.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 --2- 172.21.15.123:0/3287755505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f80bb350 0x7f98e4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:48.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 --2- 172.21.15.123:0/3287755505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98e4003f70 0x7f98e4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:48.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 --2- 172.21.15.123:0/3287755505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98e4004d90 0x7f98e4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:48.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 -- 172.21.15.123:0/3287755505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f80b9fc0 con 0x7f98e4004d90 2023-03-08T15:49:48.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 -- 172.21.15.123:0/3287755505 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e400ba40 con 0x7f98e4003f70 2023-03-08T15:49:48.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 -- 172.21.15.123:0/3287755505 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e400bc00 con 0x7f98f80bb350 2023-03-08T15:49:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fed7d700 1 --2- 172.21.15.123:0/3287755505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98e4004d90 0x7f98e4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fe57c700 1 --2- 172.21.15.123:0/3287755505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f80bb350 0x7f98e4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fdd7b700 1 --2- 172.21.15.123:0/3287755505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98e4003f70 0x7f98e4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fed7d700 1 -- 172.21.15.123:0/3287755505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f80bb350 msgr2=0x7f98e4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fed7d700 1 --2- 172.21.15.123:0/3287755505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f80bb350 0x7f98e4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fed7d700 1 -- 172.21.15.123:0/3287755505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98e4003f70 msgr2=0x7f98e4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fed7d700 1 --2- 172.21.15.123:0/3287755505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98e4003f70 0x7f98e4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fed7d700 1 -- 172.21.15.123:0/3287755505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e40035b0 con 0x7f98e4004d90 2023-03-08T15:49:48.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fed7d700 1 --2- 172.21.15.123:0/3287755505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98e4004d90 0x7f98e4005200 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f98f000a830 tx=0x7f98e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9e3a3bb38d5d94 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:48.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 -- 172.21.15.123:0/3287755505 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0012600 con 0x7f98e4004d90 2023-03-08T15:49:48.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 -- 172.21.15.123:0/3287755505 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f0012780 con 0x7f98e4004d90 2023-03-08T15:49:48.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.710+0000 7f98fd57a700 1 -- 172.21.15.123:0/3287755505 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0012b30 con 0x7f98e4004d90 2023-03-08T15:49:48.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.711+0000 7f99007e0700 1 -- 172.21.15.123:0/3287755505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98e4004d90 msgr2=0x7f98e4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:48.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.711+0000 7f99007e0700 1 --2- 172.21.15.123:0/3287755505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98e4004d90 0x7f98e4005200 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f98f000a830 tx=0x7f98e4005880 comp rx=0 tx=0).stop 2023-03-08T15:49:48.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.711+0000 7f98fed7d700 1 -- 172.21.15.123:0/3287755505 reap_dead start 2023-03-08T15:49:48.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.711+0000 7f99007e0700 1 -- 172.21.15.123:0/3287755505 shutdown_connections 2023-03-08T15:49:48.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.711+0000 7f99007e0700 1 -- 172.21.15.123:0/3287755505 >> 172.21.15.123:0/3287755505 conn(0x7f98f806a250 msgr2=0x7f98f806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:48.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.711+0000 7f99007e0700 1 -- 172.21.15.123:0/3287755505 shutdown_connections 2023-03-08T15:49:48.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.711+0000 7f99007e0700 1 -- 172.21.15.123:0/3287755505 wait complete. 2023-03-08T15:49:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.712+0000 7f99007e0700 1 Processor -- start 2023-03-08T15:49:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.712+0000 7f99007e0700 1 -- start start 2023-03-08T15:49:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f99007e0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98e4004d90 0x7f98f80b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f99007e0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f80b7600 0x7f98f8142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f99007e0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f8141940 0x7f98f8137790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f99007e0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f80b86a0 con 0x7f98e4004d90 2023-03-08T15:49:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f99007e0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f80b6110 con 0x7f98f8141940 2023-03-08T15:49:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f99007e0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f80b7170 con 0x7f98f80b7600 2023-03-08T15:49:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f98fe57c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98e4004d90 0x7f98f80b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f98fe57c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98e4004d90 0x7f98f80b5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36876/0 (socket says 172.21.15.123:36876) 2023-03-08T15:49:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f98fe57c700 1 -- 172.21.15.123:0/831512566 learned_addr learned my addr 172.21.15.123:0/831512566 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:48.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f98fed7d700 1 --2- 172.21.15.123:0/831512566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f8141940 0x7f98f8137790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:48.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f98fdd7b700 1 --2- 172.21.15.123:0/831512566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f80b7600 0x7f98f8142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:48.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f98fe57c700 1 -- 172.21.15.123:0/831512566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f80b7600 msgr2=0x7f98f8142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:48.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f98fe57c700 1 --2- 172.21.15.123:0/831512566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f80b7600 0x7f98f8142140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f98fe57c700 1 -- 172.21.15.123:0/831512566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f8141940 msgr2=0x7f98f8137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:48.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f98fe57c700 1 --2- 172.21.15.123:0/831512566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f8141940 0x7f98f8137790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.722 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f98fe57c700 1 -- 172.21.15.123:0/831512566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f80bb720 con 0x7f98e4004d90 2023-03-08T15:49:48.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f98fdd7b700 1 --2- 172.21.15.123:0/831512566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f80b7600 0x7f98f8142140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:48.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f98fe57c700 1 --2- 172.21.15.123:0/831512566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98e4004d90 0x7f98f80b5bd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f98e8011ad0 tx=0x7f98e8011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:48.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f98eeffd700 1 -- 172.21.15.123:0/831512566 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e800f940 con 0x7f98e4004d90 2023-03-08T15:49:48.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f98eeffd700 1 -- 172.21.15.123:0/831512566 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e800faa0 con 0x7f98e4004d90 2023-03-08T15:49:48.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f99007e0700 1 -- 172.21.15.123:0/831512566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f80ba580 con 0x7f98e4004d90 2023-03-08T15:49:48.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f98eeffd700 1 -- 172.21.15.123:0/831512566 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e800fe50 con 0x7f98e4004d90 2023-03-08T15:49:48.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.713+0000 7f99007e0700 1 -- 172.21.15.123:0/831512566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f80be3c0 con 0x7f98e4004d90 2023-03-08T15:49:48.723 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.714+0000 7f99007e0700 1 -- 172.21.15.123:0/831512566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f8144a10 con 0x7f98e4004d90 2023-03-08T15:49:48.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.715+0000 7f98eeffd700 1 -- 172.21.15.123:0/831512566 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f98e8014440 con 0x7f98e4004d90 2023-03-08T15:49:48.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.715+0000 7f98eeffd700 1 --2- 172.21.15.123:0/831512566 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f98dc069900 0x7f98dc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:48.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.715+0000 7f98eeffd700 1 -- 172.21.15.123:0/831512566 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f98e8087f80 con 0x7f98e4004d90 2023-03-08T15:49:48.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.715+0000 7f98fdd7b700 1 --2- 172.21.15.123:0/831512566 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f98dc069900 0x7f98dc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:48.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.715+0000 7f98fdd7b700 1 --2- 172.21.15.123:0/831512566 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f98dc069900 0x7f98dc06bdb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f98f80721a0 tx=0x7f98f4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:48.724 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.719+0000 7f98eeffd700 1 -- 172.21.15.123:0/831512566 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f98e8053d20 con 0x7f98e4004d90 2023-03-08T15:49:48.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.945+0000 7f99007e0700 1 -- 172.21.15.123:0/831512566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f98f80744c0 con 0x7f98e4004d90 2023-03-08T15:49:48.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.945+0000 7f98eeffd700 1 -- 172.21.15.123:0/831512566 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f98e8057340 con 0x7f98e4004d90 2023-03-08T15:49:48.947 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:48.948 INFO:teuthology.orchestra.run.smithi123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-03-08T15:49:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.947+0000 7f99007e0700 1 -- 172.21.15.123:0/831512566 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f98dc069900 msgr2=0x7f98dc06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.947+0000 7f99007e0700 1 --2- 172.21.15.123:0/831512566 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f98dc069900 0x7f98dc06bdb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f98f80721a0 tx=0x7f98f4009040 comp rx=0 tx=0).stop 2023-03-08T15:49:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.947+0000 7f99007e0700 1 -- 172.21.15.123:0/831512566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98e4004d90 msgr2=0x7f98f80b5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.947+0000 7f99007e0700 1 --2- 172.21.15.123:0/831512566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98e4004d90 0x7f98f80b5bd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f98e8011ad0 tx=0x7f98e8011de0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.947+0000 7f99007e0700 1 -- 172.21.15.123:0/831512566 shutdown_connections 2023-03-08T15:49:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.947+0000 7f99007e0700 1 --2- 172.21.15.123:0/831512566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f8141940 0x7f98f8137790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.947+0000 7f99007e0700 1 --2- 172.21.15.123:0/831512566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98e4004d90 0x7f98f80b5bd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.947+0000 7f99007e0700 1 --2- 172.21.15.123:0/831512566 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f98dc069900 0x7f98dc06bdb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.947+0000 7f99007e0700 1 --2- 172.21.15.123:0/831512566 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f80b7600 0x7f98f8142140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.948+0000 7f99007e0700 1 -- 172.21.15.123:0/831512566 >> 172.21.15.123:0/831512566 conn(0x7f98f806a250 msgr2=0x7f98f80bd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.948+0000 7f99007e0700 1 -- 172.21.15.123:0/831512566 shutdown_connections 2023-03-08T15:49:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:48.948+0000 7f99007e0700 1 -- 172.21.15.123:0/831512566 wait complete. 2023-03-08T15:49:48.960 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-03-08T15:49:48.961 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:49:49.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.078+0000 7f745276a700 1 Processor -- start 2023-03-08T15:49:49.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.078+0000 7f745276a700 1 -- start start 2023-03-08T15:49:49.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.079+0000 7f745276a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744c06fef0 0x7f744c14ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.079+0000 7f745276a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f744c14b250 0x7f744c155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.079+0000 7f745276a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744c06a960 con 0x7f744c147e50 2023-03-08T15:49:49.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.079+0000 7f745276a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744c14b6c0 con 0x7f744c14b250 2023-03-08T15:49:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.079+0000 7f745276a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c14a810 con 0x7f744c06fef0 2023-03-08T15:49:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.079+0000 7f7450d07700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f744c14b250 0x7f744c155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.079+0000 7f7450d07700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f744c14b250 0x7f744c155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36884/0 (socket says 172.21.15.123:36884) 2023-03-08T15:49:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.079+0000 7f7450d07700 1 -- 172.21.15.123:0/37425597 learned_addr learned my addr 172.21.15.123:0/37425597 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.079+0000 7f744b7fe700 1 --2- 172.21.15.123:0/37425597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744c06fef0 0x7f744c14ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f7450d07700 1 -- 172.21.15.123:0/37425597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744c06fef0 msgr2=0x7f744c14ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f7450d07700 1 --2- 172.21.15.123:0/37425597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744c06fef0 0x7f744c14ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f7450d07700 1 -- 172.21.15.123:0/37425597 >> v1:172.21.15.175:6789/0 conn(0x7f744c147e50 legacy=0x7f744c06a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f7450d07700 1 -- 172.21.15.123:0/37425597 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c071a40 con 0x7f744c14b250 2023-03-08T15:49:49.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f744b7fe700 1 --2- 172.21.15.123:0/37425597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744c06fef0 0x7f744c14ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:49.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f7450d07700 1 --2- 172.21.15.123:0/37425597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f744c14b250 0x7f744c155040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7444009e50 tx=0x7f744400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69628141dec9a42 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:49.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f744affd700 1 -- 172.21.15.123:0/37425597 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744400e070 con 0x7f744c14b250 2023-03-08T15:49:49.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f744affd700 1 -- 172.21.15.123:0/37425597 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744400b9c0 con 0x7f744c14b250 2023-03-08T15:49:49.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f744affd700 1 -- 172.21.15.123:0/37425597 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744400bd70 con 0x7f744c14b250 2023-03-08T15:49:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f745276a700 1 -- 172.21.15.123:0/37425597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f744c14b250 msgr2=0x7f744c155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f745276a700 1 --2- 172.21.15.123:0/37425597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f744c14b250 0x7f744c155040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7444009e50 tx=0x7f744400b330 comp rx=0 tx=0).stop 2023-03-08T15:49:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f745276a700 1 -- 172.21.15.123:0/37425597 shutdown_connections 2023-03-08T15:49:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f745276a700 1 --2- 172.21.15.123:0/37425597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f744c14b250 0x7f744c155040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f745276a700 1 --2- 172.21.15.123:0/37425597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744c06fef0 0x7f744c14ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f745276a700 1 -- 172.21.15.123:0/37425597 >> 172.21.15.123:0/37425597 conn(0x7f744c06b360 msgr2=0x7f744c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f745276a700 1 -- 172.21.15.123:0/37425597 shutdown_connections 2023-03-08T15:49:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.080+0000 7f745276a700 1 -- 172.21.15.123:0/37425597 wait complete. 2023-03-08T15:49:49.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.082+0000 7f745276a700 1 Processor -- start 2023-03-08T15:49:49.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.082+0000 7f745276a700 1 -- start start 2023-03-08T15:49:49.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f745276a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744c06fef0 0x7f744c14bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f745276a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f744c147e50 0x7f744c1e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f745276a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f744c14b250 0x7f744c145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f745276a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c1e3a20 con 0x7f744c147e50 2023-03-08T15:49:49.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f745276a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c14c410 con 0x7f744c14b250 2023-03-08T15:49:49.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f745276a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c1e36b0 con 0x7f744c06fef0 2023-03-08T15:49:49.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f744b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f744c147e50 0x7f744c1e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f744b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f744c147e50 0x7f744c1e3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36894/0 (socket says 172.21.15.123:36894) 2023-03-08T15:49:49.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f744b7fe700 1 -- 172.21.15.123:0/2139359903 learned_addr learned my addr 172.21.15.123:0/2139359903 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:49.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f744bfff700 1 --2- 172.21.15.123:0/2139359903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744c06fef0 0x7f744c14bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f7450d07700 1 --2- 172.21.15.123:0/2139359903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f744c14b250 0x7f744c145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f744b7fe700 1 -- 172.21.15.123:0/2139359903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744c06fef0 msgr2=0x7f744c14bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f744b7fe700 1 --2- 172.21.15.123:0/2139359903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744c06fef0 0x7f744c14bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f744b7fe700 1 -- 172.21.15.123:0/2139359903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f744c14b250 msgr2=0x7f744c145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f744b7fe700 1 --2- 172.21.15.123:0/2139359903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f744c14b250 0x7f744c145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f744b7fe700 1 -- 172.21.15.123:0/2139359903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7444009b30 con 0x7f744c147e50 2023-03-08T15:49:49.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f744b7fe700 1 --2- 172.21.15.123:0/2139359903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f744c147e50 0x7f744c1e3eb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f743c00e810 tx=0x7f743c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:49.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f7448ff9700 1 -- 172.21.15.123:0/2139359903 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c00c070 con 0x7f744c147e50 2023-03-08T15:49:49.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f7448ff9700 1 -- 172.21.15.123:0/2139359903 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c013610 con 0x7f744c147e50 2023-03-08T15:49:49.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f745276a700 1 -- 172.21.15.123:0/2139359903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744c072000 con 0x7f744c147e50 2023-03-08T15:49:49.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f7448ff9700 1 -- 172.21.15.123:0/2139359903 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c0139c0 con 0x7f744c147e50 2023-03-08T15:49:49.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.083+0000 7f745276a700 1 -- 172.21.15.123:0/2139359903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744c071d20 con 0x7f744c147e50 2023-03-08T15:49:49.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.084+0000 7f745276a700 1 -- 172.21.15.123:0/2139359903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744c148220 con 0x7f744c147e50 2023-03-08T15:49:49.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.085+0000 7f7448ff9700 1 -- 172.21.15.123:0/2139359903 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f743c023070 con 0x7f744c147e50 2023-03-08T15:49:49.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.085+0000 7f7448ff9700 1 --2- 172.21.15.123:0/2139359903 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f74380698d0 0x7f743806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.085+0000 7f7448ff9700 1 -- 172.21.15.123:0/2139359903 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f743c0873b0 con 0x7f744c147e50 2023-03-08T15:49:49.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.085+0000 7f744bfff700 1 --2- 172.21.15.123:0/2139359903 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f74380698d0 0x7f743806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.085+0000 7f744bfff700 1 --2- 172.21.15.123:0/2139359903 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f74380698d0 0x7f743806bd80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f74400018a0 tx=0x7f7440009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:49.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.089+0000 7f7448ff9700 1 -- 172.21.15.123:0/2139359903 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f743c053100 con 0x7f744c147e50 2023-03-08T15:49:49.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.274+0000 7f745276a700 1 -- 172.21.15.123:0/2139359903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f744c0744c0 con 0x7f744c147e50 2023-03-08T15:49:49.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.275+0000 7f7448ff9700 1 -- 172.21.15.123:0/2139359903 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f743c00f040 con 0x7f744c147e50 2023-03-08T15:49:49.277 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:49.277 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:40.490671+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:49:37.104720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-08T15:49:38.431537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:49:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.277+0000 7f745276a700 1 -- 172.21.15.123:0/2139359903 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f74380698d0 msgr2=0x7f743806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.277+0000 7f745276a700 1 --2- 172.21.15.123:0/2139359903 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f74380698d0 0x7f743806bd80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f74400018a0 tx=0x7f7440009040 comp rx=0 tx=0).stop 2023-03-08T15:49:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.277+0000 7f745276a700 1 -- 172.21.15.123:0/2139359903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f744c147e50 msgr2=0x7f744c1e3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.277+0000 7f745276a700 1 --2- 172.21.15.123:0/2139359903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f744c147e50 0x7f744c1e3eb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f743c00e810 tx=0x7f743c00eb20 comp rx=0 tx=0).stop 2023-03-08T15:49:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.277+0000 7f745276a700 1 -- 172.21.15.123:0/2139359903 shutdown_connections 2023-03-08T15:49:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.277+0000 7f745276a700 1 --2- 172.21.15.123:0/2139359903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f744c14b250 0x7f744c145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.277+0000 7f745276a700 1 --2- 172.21.15.123:0/2139359903 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f74380698d0 0x7f743806bd80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.277+0000 7f745276a700 1 --2- 172.21.15.123:0/2139359903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f744c06fef0 0x7f744c14bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.277+0000 7f745276a700 1 --2- 172.21.15.123:0/2139359903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f744c147e50 0x7f744c1e3eb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.277+0000 7f745276a700 1 -- 172.21.15.123:0/2139359903 >> 172.21.15.123:0/2139359903 conn(0x7f744c06b360 msgr2=0x7f744c149b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:49.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.277+0000 7f745276a700 1 -- 172.21.15.123:0/2139359903 shutdown_connections 2023-03-08T15:49:49.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.277+0000 7f745276a700 1 -- 172.21.15.123:0/2139359903 wait complete. 2023-03-08T15:49:49.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-08T15:49:26.011228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-08T15:49:32.528343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-08T15:49:37.104720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-08T15:49:38.431537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-08T15:49:49.291 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-08T15:49:49.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.412+0000 7f3f7a37f700 1 Processor -- start 2023-03-08T15:49:49.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.412+0000 7f3f7a37f700 1 -- start start 2023-03-08T15:49:49.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.412+0000 7f3f7a37f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f741446c0 0x7f3f740b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.415 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f7a37f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f740b7fa0 con 0x7f3f74144a90 2023-03-08T15:49:49.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f7a37f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f740b7130 con 0x7f3f740ba560 2023-03-08T15:49:49.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f7a37f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f740bdc90 con 0x7f3f741446c0 2023-03-08T15:49:49.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f737fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3f74144a90 0x7f3f740bd580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33636/0 (socket says 172.21.15.123:33636) 2023-03-08T15:49:49.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f737fe700 1 -- 172.21.15.123:0/4246010130 learned_addr learned my addr 172.21.15.123:0/4246010130 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:49.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f73fff700 1 --2- 172.21.15.123:0/4246010130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f741446c0 0x7f3f740b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f72ffd700 1 -- 172.21.15.123:0/4246010130 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946542753 0 0) 0x7f3f740b7fa0 con 0x7f3f74144a90 2023-03-08T15:49:49.416 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f72ffd700 1 -- 172.21.15.123:0/4246010130 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f5c0035b0 con 0x7f3f74144a90 2023-03-08T15:49:49.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f72ffd700 1 -- 172.21.15.123:0/4246010130 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894023595 0 0) 0x7f3f740b7130 con 0x7f3f740ba560 2023-03-08T15:49:49.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f72ffd700 1 -- 172.21.15.123:0/4246010130 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f740b7fa0 con 0x7f3f740ba560 2023-03-08T15:49:49.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f73fff700 1 -- 172.21.15.123:0/4246010130 >> v1:172.21.15.175:6789/0 conn(0x7f3f740ba560 legacy=0x7f3f74154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f73fff700 1 -- 172.21.15.123:0/4246010130 >> v1:172.21.15.123:6789/0 conn(0x7f3f74144a90 legacy=0x7f3f740bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f72ffd700 1 -- 172.21.15.123:0/4246010130 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4156076243 0 0) 0x7f3f5c0035b0 con 0x7f3f74144a90 2023-03-08T15:49:49.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f73fff700 1 -- 172.21.15.123:0/4246010130 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f740bc030 con 0x7f3f741446c0 2023-03-08T15:49:49.417 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f73fff700 1 --2- 172.21.15.123:0/4246010130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f741446c0 0x7f3f740b6bf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009870 tx=0x7f3f64009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f92aa25b576b92ab server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:49.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f72ffd700 1 -- 172.21.15.123:0/4246010130 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68001670 con 0x7f3f741446c0 2023-03-08T15:49:49.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f72ffd700 1 -- 172.21.15.123:0/4246010130 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f64004030 con 0x7f3f741446c0 2023-03-08T15:49:49.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.413+0000 7f3f72ffd700 1 -- 172.21.15.123:0/4246010130 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f640043c0 con 0x7f3f741446c0 2023-03-08T15:49:49.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.414+0000 7f3f7a37f700 1 -- 172.21.15.123:0/4246010130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f741446c0 msgr2=0x7f3f740b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.414+0000 7f3f7a37f700 1 --2- 172.21.15.123:0/4246010130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f741446c0 0x7f3f740b6bf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009870 tx=0x7f3f64009b80 comp rx=0 tx=0).stop 2023-03-08T15:49:49.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.414+0000 7f3f7a37f700 1 -- 172.21.15.123:0/4246010130 shutdown_connections 2023-03-08T15:49:49.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.414+0000 7f3f7a37f700 1 --2- 172.21.15.123:0/4246010130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f741446c0 0x7f3f740b6bf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.414+0000 7f3f7a37f700 1 -- 172.21.15.123:0/4246010130 >> 172.21.15.123:0/4246010130 conn(0x7f3f74071980 msgr2=0x7f3f74071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:49.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.414+0000 7f3f7a37f700 1 -- 172.21.15.123:0/4246010130 shutdown_connections 2023-03-08T15:49:49.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.414+0000 7f3f7a37f700 1 -- 172.21.15.123:0/4246010130 wait complete. 2023-03-08T15:49:49.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.415+0000 7f3f7a37f700 1 Processor -- start 2023-03-08T15:49:49.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.415+0000 7f3f7a37f700 1 -- start start 2023-03-08T15:49:49.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f7a37f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f740ba560 0x7f3f741d5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f7a37f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f741446c0 0x7f3f7413f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f7a37f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f74144a90 0x7f3f7413a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f7a37f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f741d64d0 con 0x7f3f74144a90 2023-03-08T15:49:49.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f7a37f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7413ddf0 con 0x7f3f740ba560 2023-03-08T15:49:49.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f7a37f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7413b4e0 con 0x7f3f741446c0 2023-03-08T15:49:49.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f7891c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f74144a90 0x7f3f7413a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f73fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f740ba560 0x7f3f741d5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f737fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f741446c0 0x7f3f7413f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f7891c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f74144a90 0x7f3f7413a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36906/0 (socket says 172.21.15.123:36906) 2023-03-08T15:49:49.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f73fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f740ba560 0x7f3f741d5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:37084/0 (socket says 172.21.15.123:37084) 2023-03-08T15:49:49.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f7891c700 1 -- 172.21.15.123:0/22261621 learned_addr learned my addr 172.21.15.123:0/22261621 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:49.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f7891c700 1 -- 172.21.15.123:0/22261621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f741446c0 msgr2=0x7f3f7413f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f7891c700 1 --2- 172.21.15.123:0/22261621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f741446c0 0x7f3f7413f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f7891c700 1 -- 172.21.15.123:0/22261621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f740ba560 msgr2=0x7f3f741d5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f7891c700 1 --2- 172.21.15.123:0/22261621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f740ba560 0x7f3f741d5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f7891c700 1 -- 172.21.15.123:0/22261621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f640094a0 con 0x7f3f74144a90 2023-03-08T15:49:49.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f7891c700 1 --2- 172.21.15.123:0/22261621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f74144a90 0x7f3f7413a150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00cc20 tx=0x7f3f6c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:49.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.416+0000 7f3f70ff9700 1 -- 172.21.15.123:0/22261621 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c003c00 con 0x7f3f74144a90 2023-03-08T15:49:49.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.417+0000 7f3f70ff9700 1 -- 172.21.15.123:0/22261621 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c003d60 con 0x7f3f74144a90 2023-03-08T15:49:49.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.417+0000 7f3f7a37f700 1 -- 172.21.15.123:0/22261621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f740bc5f0 con 0x7f3f74144a90 2023-03-08T15:49:49.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.417+0000 7f3f70ff9700 1 -- 172.21.15.123:0/22261621 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00aae0 con 0x7f3f74144a90 2023-03-08T15:49:49.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.417+0000 7f3f7a37f700 1 -- 172.21.15.123:0/22261621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f740bc310 con 0x7f3f74144a90 2023-03-08T15:49:49.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.417+0000 7f3f7a37f700 1 -- 172.21.15.123:0/22261621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7414db90 con 0x7f3f74144a90 2023-03-08T15:49:49.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.418+0000 7f3f70ff9700 1 -- 172.21.15.123:0/22261621 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f3f6c010050 con 0x7f3f74144a90 2023-03-08T15:49:49.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.418+0000 7f3f70ff9700 1 --2- 172.21.15.123:0/22261621 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3f600698d0 0x7f3f6006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.418+0000 7f3f70ff9700 1 -- 172.21.15.123:0/22261621 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3f6c087500 con 0x7f3f74144a90 2023-03-08T15:49:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.418+0000 7f3f73fff700 1 --2- 172.21.15.123:0/22261621 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3f600698d0 0x7f3f6006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.419+0000 7f3f73fff700 1 --2- 172.21.15.123:0/22261621 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3f600698d0 0x7f3f6006bd80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f640097c0 tx=0x7f3f64008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.422+0000 7f3f70ff9700 1 -- 172.21.15.123:0/22261621 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f3f6c0532d0 con 0x7f3f74144a90 2023-03-08T15:49:49.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.609+0000 7f3f7a37f700 1 -- 172.21.15.123:0/22261621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f740744c0 con 0x7f3f74144a90 2023-03-08T15:49:49.610 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.609+0000 7f3f70ff9700 1 -- 172.21.15.123:0/22261621 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f6c0568f0 con 0x7f3f74144a90 2023-03-08T15:49:49.611 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-03-08T15:49:49.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.611+0000 7f3f7a37f700 1 -- 172.21.15.123:0/22261621 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3f600698d0 msgr2=0x7f3f6006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.612 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.611+0000 7f3f7a37f700 1 --2- 172.21.15.123:0/22261621 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3f600698d0 0x7f3f6006bd80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f640097c0 tx=0x7f3f64008030 comp rx=0 tx=0).stop 2023-03-08T15:49:49.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.611+0000 7f3f7a37f700 1 -- 172.21.15.123:0/22261621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f74144a90 msgr2=0x7f3f7413a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.611+0000 7f3f7a37f700 1 --2- 172.21.15.123:0/22261621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f74144a90 0x7f3f7413a150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00cc20 tx=0x7f3f6c00cf30 comp rx=0 tx=0).stop 2023-03-08T15:49:49.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.611+0000 7f3f7a37f700 1 -- 172.21.15.123:0/22261621 shutdown_connections 2023-03-08T15:49:49.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.611+0000 7f3f7a37f700 1 --2- 172.21.15.123:0/22261621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f74144a90 0x7f3f7413a150 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.611+0000 7f3f7a37f700 1 --2- 172.21.15.123:0/22261621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f740ba560 0x7f3f741d5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.611+0000 7f3f7a37f700 1 --2- 172.21.15.123:0/22261621 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3f600698d0 0x7f3f6006bd80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.613 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.611+0000 7f3f7a37f700 1 --2- 172.21.15.123:0/22261621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3f741446c0 0x7f3f7413f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.611+0000 7f3f7a37f700 1 -- 172.21.15.123:0/22261621 >> 172.21.15.123:0/22261621 conn(0x7f3f74071980 msgr2=0x7f3f74071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:49.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.611+0000 7f3f7a37f700 1 -- 172.21.15.123:0/22261621 shutdown_connections 2023-03-08T15:49:49.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.611+0000 7f3f7a37f700 1 -- 172.21.15.123:0/22261621 wait complete. 2023-03-08T15:49:49.624 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-08T15:49:49.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.745+0000 7f3957fdf700 1 Processor -- start 2023-03-08T15:49:49.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.745+0000 7f3957fdf700 1 -- start start 2023-03-08T15:49:49.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.746+0000 7f3957fdf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3950147e50 0x7f395006a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.746+0000 7f3957fdf700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f395014b420 0x7f3950155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.746+0000 7f3957fdf700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395014a810 con 0x7f395006fef0 2023-03-08T15:49:49.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.746+0000 7f3957fdf700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3950071a40 con 0x7f395014b420 2023-03-08T15:49:49.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.746+0000 7f3957fdf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3950071d20 con 0x7f3950147e50 2023-03-08T15:49:49.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.746+0000 7f395557a700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f395006fef0 0x7f395014ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33652/0 (socket says 172.21.15.123:33652) 2023-03-08T15:49:49.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.746+0000 7f395557a700 1 -- 172.21.15.123:0/2609486920 learned_addr learned my addr 172.21.15.123:0/2609486920 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:49.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.746+0000 7f395657c700 1 --2- 172.21.15.123:0/2609486920 >> v2:172.21.15.175:3300/0 conn(0x7f395014b420 0x7f3950155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.746+0000 7f3955d7b700 1 --2- 172.21.15.123:0/2609486920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3950147e50 0x7f395006a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.746+0000 7f3954d79700 1 -- 172.21.15.123:0/2609486920 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945605616 0 0) 0x7f395014a810 con 0x7f395006fef0 2023-03-08T15:49:49.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.746+0000 7f3954d79700 1 -- 172.21.15.123:0/2609486920 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f393c0035b0 con 0x7f395006fef0 2023-03-08T15:49:49.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.746+0000 7f3954d79700 1 -- 172.21.15.123:0/2609486920 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3863289596 0 0) 0x7f393c0035b0 con 0x7f395006fef0 2023-03-08T15:49:49.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.746+0000 7f3954d79700 1 -- 172.21.15.123:0/2609486920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3950147e50 msgr2=0x7f395006a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:49.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.746+0000 7f3954d79700 1 --2- 172.21.15.123:0/2609486920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3950147e50 0x7f395006a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3954d79700 1 -- 172.21.15.123:0/2609486920 >> v2:172.21.15.175:3300/0 conn(0x7f395014b420 msgr2=0x7f3950155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:49.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3954d79700 1 --2- 172.21.15.123:0/2609486920 >> v2:172.21.15.175:3300/0 conn(0x7f395014b420 0x7f3950155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3954d79700 1 -- 172.21.15.123:0/2609486920 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3950072000 con 0x7f395006fef0 2023-03-08T15:49:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3954d79700 1 -- 172.21.15.123:0/2609486920 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f394c001670 con 0x7f395006fef0 2023-03-08T15:49:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3955d7b700 1 --2- 172.21.15.123:0/2609486920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3950147e50 0x7f395006a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3954d79700 1 -- 172.21.15.123:0/2609486920 >> v1:172.21.15.123:6789/0 conn(0x7f395006fef0 legacy=0x7f395014ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3954d79700 1 --2- 172.21.15.123:0/2609486920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f393c003a00 0x7f393c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3954d79700 1 --2- 172.21.15.123:0/2609486920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f393c004430 0x7f393c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3954d79700 1 --2- 172.21.15.123:0/2609486920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3950147e50 0x7f393c005030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3954d79700 1 -- 172.21.15.123:0/2609486920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3950071a40 con 0x7f393c004430 2023-03-08T15:49:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3954d79700 1 -- 172.21.15.123:0/2609486920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3950071d20 con 0x7f393c003a00 2023-03-08T15:49:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3954d79700 1 -- 172.21.15.123:0/2609486920 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393c00ba10 con 0x7f3950147e50 2023-03-08T15:49:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f395557a700 1 --2- 172.21.15.123:0/2609486920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f393c004430 0x7f393c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3955d7b700 1 --2- 172.21.15.123:0/2609486920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f393c003a00 0x7f393c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f395657c700 1 --2- 172.21.15.123:0/2609486920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3950147e50 0x7f393c005030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f395557a700 1 -- 172.21.15.123:0/2609486920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3950147e50 msgr2=0x7f393c005030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f395557a700 1 --2- 172.21.15.123:0/2609486920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3950147e50 0x7f393c005030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f395557a700 1 -- 172.21.15.123:0/2609486920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f393c003a00 msgr2=0x7f393c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:49.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f395557a700 1 --2- 172.21.15.123:0/2609486920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f393c003a00 0x7f393c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f395557a700 1 -- 172.21.15.123:0/2609486920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c0035b0 con 0x7f393c004430 2023-03-08T15:49:49.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f395557a700 1 --2- 172.21.15.123:0/2609486920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f393c004430 0x7f393c0048f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f394c00c2f0 tx=0x7f393c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76495c76bb8760fa server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:49.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3954d79700 1 -- 172.21.15.123:0/2609486920 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c00ce30 con 0x7f393c004430 2023-03-08T15:49:49.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3954d79700 1 -- 172.21.15.123:0/2609486920 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394c005960 con 0x7f393c004430 2023-03-08T15:49:49.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.747+0000 7f3954d79700 1 -- 172.21.15.123:0/2609486920 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c005d10 con 0x7f393c004430 2023-03-08T15:49:49.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.748+0000 7f3957fdf700 1 -- 172.21.15.123:0/2609486920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f393c004430 msgr2=0x7f393c0048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.748+0000 7f3957fdf700 1 --2- 172.21.15.123:0/2609486920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f393c004430 0x7f393c0048f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f394c00c2f0 tx=0x7f393c005880 comp rx=0 tx=0).stop 2023-03-08T15:49:49.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.748+0000 7f395657c700 1 -- 172.21.15.123:0/2609486920 reap_dead start 2023-03-08T15:49:49.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.748+0000 7f3957fdf700 1 -- 172.21.15.123:0/2609486920 shutdown_connections 2023-03-08T15:49:49.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.748+0000 7f3957fdf700 1 -- 172.21.15.123:0/2609486920 >> 172.21.15.123:0/2609486920 conn(0x7f395006b360 msgr2=0x7f395006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:49.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.748+0000 7f3957fdf700 1 -- 172.21.15.123:0/2609486920 shutdown_connections 2023-03-08T15:49:49.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.748+0000 7f3957fdf700 1 -- 172.21.15.123:0/2609486920 wait complete. 2023-03-08T15:49:49.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.749+0000 7f3957fdf700 1 Processor -- start 2023-03-08T15:49:49.757 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.749+0000 7f3957fdf700 1 -- start start 2023-03-08T15:49:49.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.750+0000 7f3957fdf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f393c004430 0x7f39500b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.750+0000 7f3957fdf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3950149e10 0x7f39500b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.750+0000 7f3957fdf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39500b71a0 0x7f3950140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.750+0000 7f3957fdf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39500b4fe0 con 0x7f393c004430 2023-03-08T15:49:49.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.750+0000 7f3957fdf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39500b5420 con 0x7f3950149e10 2023-03-08T15:49:49.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.750+0000 7f3957fdf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39500b67d0 con 0x7f39500b71a0 2023-03-08T15:49:49.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.750+0000 7f3955d7b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f393c004430 0x7f39500b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.750+0000 7f3955d7b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f393c004430 0x7f39500b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36924/0 (socket says 172.21.15.123:36924) 2023-03-08T15:49:49.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.750+0000 7f3955d7b700 1 -- 172.21.15.123:0/4091992124 learned_addr learned my addr 172.21.15.123:0/4091992124 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:49.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.750+0000 7f3955d7b700 1 -- 172.21.15.123:0/4091992124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39500b71a0 msgr2=0x7f3950140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.750+0000 7f3955d7b700 1 --2- 172.21.15.123:0/4091992124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39500b71a0 0x7f3950140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.750+0000 7f3955d7b700 1 -- 172.21.15.123:0/4091992124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3950149e10 msgr2=0x7f39500b6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.750+0000 7f3955d7b700 1 --2- 172.21.15.123:0/4091992124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3950149e10 0x7f39500b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.750+0000 7f3955d7b700 1 -- 172.21.15.123:0/4091992124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39500728f0 con 0x7f393c004430 2023-03-08T15:49:49.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.751+0000 7f3955d7b700 1 --2- 172.21.15.123:0/4091992124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f393c004430 0x7f39500b4aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3940009630 tx=0x7f39400099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:49.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.751+0000 7f39467fc700 1 -- 172.21.15.123:0/4091992124 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940014610 con 0x7f393c004430 2023-03-08T15:49:49.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.751+0000 7f39467fc700 1 -- 172.21.15.123:0/4091992124 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3940014770 con 0x7f393c004430 2023-03-08T15:49:49.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.751+0000 7f3957fdf700 1 -- 172.21.15.123:0/4091992124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3950148220 con 0x7f393c004430 2023-03-08T15:49:49.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.751+0000 7f39467fc700 1 -- 172.21.15.123:0/4091992124 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940014b00 con 0x7f393c004430 2023-03-08T15:49:49.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.751+0000 7f3957fdf700 1 -- 172.21.15.123:0/4091992124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39500b45f0 con 0x7f393c004430 2023-03-08T15:49:49.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.752+0000 7f3957fdf700 1 -- 172.21.15.123:0/4091992124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39500b6580 con 0x7f393c004430 2023-03-08T15:49:49.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.752+0000 7f39467fc700 1 -- 172.21.15.123:0/4091992124 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f3940024070 con 0x7f393c004430 2023-03-08T15:49:49.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.753+0000 7f39467fc700 1 --2- 172.21.15.123:0/4091992124 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f39340698d0 0x7f393406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:49.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.753+0000 7f395557a700 1 --2- 172.21.15.123:0/4091992124 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f39340698d0 0x7f393406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:49.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.753+0000 7f39467fc700 1 -- 172.21.15.123:0/4091992124 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39400877b0 con 0x7f393c004430 2023-03-08T15:49:49.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.753+0000 7f395557a700 1 --2- 172.21.15.123:0/4091992124 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f39340698d0 0x7f393406bd80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f39501467f0 tx=0x7f394c00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:49.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.757+0000 7f39467fc700 1 -- 172.21.15.123:0/4091992124 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f3940053580 con 0x7f393c004430 2023-03-08T15:49:49.944 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.943+0000 7f3957fdf700 1 -- 172.21.15.123:0/4091992124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3950148e00 con 0x7f393c004430 2023-03-08T15:49:49.945 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.943+0000 7f39467fc700 1 -- 172.21.15.123:0/4091992124 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3940056ba0 con 0x7f393c004430 2023-03-08T15:49:49.945 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-03-08T15:49:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.945+0000 7f3957fdf700 1 -- 172.21.15.123:0/4091992124 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f39340698d0 msgr2=0x7f393406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.945+0000 7f3957fdf700 1 --2- 172.21.15.123:0/4091992124 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f39340698d0 0x7f393406bd80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f39501467f0 tx=0x7f394c00f000 comp rx=0 tx=0).stop 2023-03-08T15:49:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.945+0000 7f3957fdf700 1 -- 172.21.15.123:0/4091992124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f393c004430 msgr2=0x7f39500b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.945+0000 7f3957fdf700 1 --2- 172.21.15.123:0/4091992124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f393c004430 0x7f39500b4aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3940009630 tx=0x7f39400099f0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.945+0000 7f3957fdf700 1 -- 172.21.15.123:0/4091992124 shutdown_connections 2023-03-08T15:49:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.945+0000 7f3957fdf700 1 --2- 172.21.15.123:0/4091992124 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f39340698d0 0x7f393406bd80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.945+0000 7f3957fdf700 1 --2- 172.21.15.123:0/4091992124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39500b71a0 0x7f3950140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.945+0000 7f3957fdf700 1 --2- 172.21.15.123:0/4091992124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f393c004430 0x7f39500b4aa0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.945+0000 7f3957fdf700 1 --2- 172.21.15.123:0/4091992124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3950149e10 0x7f39500b6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.945+0000 7f3957fdf700 1 -- 172.21.15.123:0/4091992124 >> 172.21.15.123:0/4091992124 conn(0x7f395006b360 msgr2=0x7f39500b86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.945+0000 7f3957fdf700 1 -- 172.21.15.123:0/4091992124 shutdown_connections 2023-03-08T15:49:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:49.945+0000 7f3957fdf700 1 -- 172.21.15.123:0/4091992124 wait complete. 2023-03-08T15:49:49.959 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-08T15:49:50.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.081+0000 7fb938d88700 1 Processor -- start 2023-03-08T15:49:50.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.081+0000 7fb938d88700 1 -- start start 2023-03-08T15:49:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb938d88700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb9340ba280 0x7fb93406fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb938d88700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb934071df0 0x7fb93414aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb938d88700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb934070670 con 0x7fb934072760 2023-03-08T15:49:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb938d88700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb934070a40 con 0x7fb9340ba280 2023-03-08T15:49:50.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb938d88700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb934070c50 con 0x7fb934071df0 2023-03-08T15:49:50.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb931d9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb934072760 0x7fb934141480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33662/0 (socket says 172.21.15.123:33662) 2023-03-08T15:49:50.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb931d9b700 1 -- 172.21.15.123:0/2635665413 learned_addr learned my addr 172.21.15.123:0/2635665413 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:50.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb93259c700 1 --2- 172.21.15.123:0/2635665413 >> v2:172.21.15.175:3300/0 conn(0x7fb9340ba280 0x7fb93406fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb932d9d700 1 --2- 172.21.15.123:0/2635665413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb934071df0 0x7fb93414aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb93159a700 1 -- 172.21.15.123:0/2635665413 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101336615 0 0) 0x7fb934070670 con 0x7fb934072760 2023-03-08T15:49:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb93159a700 1 -- 172.21.15.123:0/2635665413 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9200035b0 con 0x7fb934072760 2023-03-08T15:49:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb93159a700 1 -- 172.21.15.123:0/2635665413 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2709345776 0 0) 0x7fb9200035b0 con 0x7fb934072760 2023-03-08T15:49:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb93159a700 1 -- 172.21.15.123:0/2635665413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb934071df0 msgr2=0x7fb93414aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb93159a700 1 --2- 172.21.15.123:0/2635665413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb934071df0 0x7fb93414aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb93159a700 1 -- 172.21.15.123:0/2635665413 >> v2:172.21.15.175:3300/0 conn(0x7fb9340ba280 msgr2=0x7fb93406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb93159a700 1 --2- 172.21.15.123:0/2635665413 >> v2:172.21.15.175:3300/0 conn(0x7fb9340ba280 0x7fb93406fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb93159a700 1 -- 172.21.15.123:0/2635665413 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9340ba650 con 0x7fb934072760 2023-03-08T15:49:50.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb93159a700 1 -- 172.21.15.123:0/2635665413 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7fb91c001670 con 0x7fb934072760 2023-03-08T15:49:50.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb93159a700 1 -- 172.21.15.123:0/2635665413 >> v1:172.21.15.123:6789/0 conn(0x7fb934072760 legacy=0x7fb934141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb93159a700 1 --2- 172.21.15.123:0/2635665413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb920003a00 0x7fb920003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb93159a700 1 --2- 172.21.15.123:0/2635665413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb920004430 0x7fb9200048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb93159a700 1 --2- 172.21.15.123:0/2635665413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb934071df0 0x7fb920004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.082+0000 7fb93159a700 1 -- 172.21.15.123:0/2635665413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb934070a40 con 0x7fb920003a00 2023-03-08T15:49:50.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb93159a700 1 -- 172.21.15.123:0/2635665413 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb934070c50 con 0x7fb920004430 2023-03-08T15:49:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb93159a700 1 -- 172.21.15.123:0/2635665413 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92000ba10 con 0x7fb934071df0 2023-03-08T15:49:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb93259c700 1 --2- 172.21.15.123:0/2635665413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb920003a00 0x7fb920003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb931d9b700 1 --2- 172.21.15.123:0/2635665413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb920004430 0x7fb9200048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb932d9d700 1 --2- 172.21.15.123:0/2635665413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb934071df0 0x7fb920004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb93259c700 1 -- 172.21.15.123:0/2635665413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb934071df0 msgr2=0x7fb920004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb93259c700 1 --2- 172.21.15.123:0/2635665413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb934071df0 0x7fb920004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb93259c700 1 -- 172.21.15.123:0/2635665413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb920004430 msgr2=0x7fb9200048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb93259c700 1 --2- 172.21.15.123:0/2635665413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb920004430 0x7fb9200048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb93259c700 1 -- 172.21.15.123:0/2635665413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9200035b0 con 0x7fb920003a00 2023-03-08T15:49:50.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb931d9b700 1 --2- 172.21.15.123:0/2635665413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb920004430 0x7fb9200048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:50.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb93259c700 1 --2- 172.21.15.123:0/2635665413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb920003a00 0x7fb920003e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009fc0 tx=0x7fb920005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1e04e95134becb server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:50.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb93159a700 1 -- 172.21.15.123:0/2635665413 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c00ec30 con 0x7fb920003a00 2023-03-08T15:49:50.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb93159a700 1 -- 172.21.15.123:0/2635665413 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c00f040 con 0x7fb920003a00 2023-03-08T15:49:50.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb93159a700 1 -- 172.21.15.123:0/2635665413 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c014480 con 0x7fb920003a00 2023-03-08T15:49:50.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb938d88700 1 -- 172.21.15.123:0/2635665413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb920003a00 msgr2=0x7fb920003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb938d88700 1 --2- 172.21.15.123:0/2635665413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb920003a00 0x7fb920003e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009fc0 tx=0x7fb920005880 comp rx=0 tx=0).stop 2023-03-08T15:49:50.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.083+0000 7fb932d9d700 1 -- 172.21.15.123:0/2635665413 reap_dead start 2023-03-08T15:49:50.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.084+0000 7fb938d88700 1 -- 172.21.15.123:0/2635665413 shutdown_connections 2023-03-08T15:49:50.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.084+0000 7fb938d88700 1 -- 172.21.15.123:0/2635665413 >> 172.21.15.123:0/2635665413 conn(0x7fb93406b360 msgr2=0x7fb93406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:50.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.084+0000 7fb938d88700 1 -- 172.21.15.123:0/2635665413 shutdown_connections 2023-03-08T15:49:50.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.084+0000 7fb938d88700 1 -- 172.21.15.123:0/2635665413 wait complete. 2023-03-08T15:49:50.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.085+0000 7fb938d88700 1 Processor -- start 2023-03-08T15:49:50.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.085+0000 7fb938d88700 1 -- start start 2023-03-08T15:49:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.085+0000 7fb938d88700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb920003a00 0x7fb9340bcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.085+0000 7fb938d88700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb93406af20 0x7fb93413d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.085+0000 7fb938d88700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb93413d820 0x7fb934136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.085+0000 7fb938d88700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340b6300 con 0x7fb920003a00 2023-03-08T15:49:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.085+0000 7fb938d88700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340bd220 con 0x7fb93413d820 2023-03-08T15:49:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.085+0000 7fb938d88700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9341475c0 con 0x7fb93406af20 2023-03-08T15:49:50.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb93259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb920003a00 0x7fb9340bcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb93259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb920003a00 0x7fb9340bcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36954/0 (socket says 172.21.15.123:36954) 2023-03-08T15:49:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb93259c700 1 -- 172.21.15.123:0/209258067 learned_addr learned my addr 172.21.15.123:0/209258067 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb931d9b700 1 --2- 172.21.15.123:0/209258067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb93406af20 0x7fb93413d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb932d9d700 1 --2- 172.21.15.123:0/209258067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb93413d820 0x7fb934136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb93259c700 1 -- 172.21.15.123:0/209258067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb93406af20 msgr2=0x7fb93413d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb93259c700 1 --2- 172.21.15.123:0/209258067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb93406af20 0x7fb93413d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb93259c700 1 -- 172.21.15.123:0/209258067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb93413d820 msgr2=0x7fb934136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb93259c700 1 --2- 172.21.15.123:0/209258067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb93413d820 0x7fb934136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb93259c700 1 -- 172.21.15.123:0/209258067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb934141d20 con 0x7fb920003a00 2023-03-08T15:49:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb93259c700 1 --2- 172.21.15.123:0/209258067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb920003a00 0x7fb9340bcce0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00e700 tx=0x7fb92c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb92affd700 1 -- 172.21.15.123:0/209258067 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c004450 con 0x7fb920003a00 2023-03-08T15:49:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb92affd700 1 -- 172.21.15.123:0/209258067 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c004610 con 0x7fb920003a00 2023-03-08T15:49:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb938d88700 1 -- 172.21.15.123:0/209258067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb934141b90 con 0x7fb920003a00 2023-03-08T15:49:50.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb92affd700 1 -- 172.21.15.123:0/209258067 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c014480 con 0x7fb920003a00 2023-03-08T15:49:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.086+0000 7fb938d88700 1 -- 172.21.15.123:0/209258067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93414aab0 con 0x7fb920003a00 2023-03-08T15:49:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.087+0000 7fb938d88700 1 -- 172.21.15.123:0/209258067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9340b6870 con 0x7fb920003a00 2023-03-08T15:49:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.087+0000 7fb92affd700 1 -- 172.21.15.123:0/209258067 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fb92c02d020 con 0x7fb920003a00 2023-03-08T15:49:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.088+0000 7fb92affd700 1 --2- 172.21.15.123:0/209258067 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb9140698d0 0x7fb91406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.088+0000 7fb931d9b700 1 --2- 172.21.15.123:0/209258067 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb9140698d0 0x7fb91406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.088+0000 7fb92affd700 1 -- 172.21.15.123:0/209258067 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb92c0892a0 con 0x7fb920003a00 2023-03-08T15:49:50.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.088+0000 7fb931d9b700 1 --2- 172.21.15.123:0/209258067 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb9140698d0 0x7fb91406bd80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb9340b71c0 tx=0x7fb91c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:50.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.092+0000 7fb92affd700 1 -- 172.21.15.123:0/209258067 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fb92c055070 con 0x7fb920003a00 2023-03-08T15:49:50.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.280+0000 7fb938d88700 1 -- 172.21.15.123:0/209258067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9340744c0 con 0x7fb920003a00 2023-03-08T15:49:50.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.280+0000 7fb92affd700 1 -- 172.21.15.123:0/209258067 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb92c058690 con 0x7fb920003a00 2023-03-08T15:49:50.282 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-03-08T15:49:50.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.282+0000 7fb938d88700 1 -- 172.21.15.123:0/209258067 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb9140698d0 msgr2=0x7fb91406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.282+0000 7fb938d88700 1 --2- 172.21.15.123:0/209258067 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb9140698d0 0x7fb91406bd80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb9340b71c0 tx=0x7fb91c009040 comp rx=0 tx=0).stop 2023-03-08T15:49:50.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.282+0000 7fb938d88700 1 -- 172.21.15.123:0/209258067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb920003a00 msgr2=0x7fb9340bcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.282+0000 7fb938d88700 1 --2- 172.21.15.123:0/209258067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb920003a00 0x7fb9340bcce0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00e700 tx=0x7fb92c009750 comp rx=0 tx=0).stop 2023-03-08T15:49:50.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.282+0000 7fb938d88700 1 -- 172.21.15.123:0/209258067 shutdown_connections 2023-03-08T15:49:50.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.282+0000 7fb938d88700 1 --2- 172.21.15.123:0/209258067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb93413d820 0x7fb934136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.282+0000 7fb938d88700 1 --2- 172.21.15.123:0/209258067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb920003a00 0x7fb9340bcce0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.282+0000 7fb938d88700 1 --2- 172.21.15.123:0/209258067 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb9140698d0 0x7fb91406bd80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.282+0000 7fb938d88700 1 --2- 172.21.15.123:0/209258067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb93406af20 0x7fb93413d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.282+0000 7fb938d88700 1 -- 172.21.15.123:0/209258067 >> 172.21.15.123:0/209258067 conn(0x7fb93406b360 msgr2=0x7fb9340b8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.282+0000 7fb938d88700 1 -- 172.21.15.123:0/209258067 shutdown_connections 2023-03-08T15:49:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.282+0000 7fb938d88700 1 -- 172.21.15.123:0/209258067 wait complete. 2023-03-08T15:49:50.296 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-08T15:49:50.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.418+0000 7f673f454700 1 Processor -- start 2023-03-08T15:49:50.419 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.418+0000 7f673f454700 1 -- start start 2023-03-08T15:49:50.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.418+0000 7f673f454700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f673806b530 0x7f67380b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.421 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f673f454700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6738071280 con 0x7f673806f8d0 2023-03-08T15:49:50.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f673f454700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673814a720 con 0x7f6738140980 2023-03-08T15:49:50.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f673f454700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6738071630 con 0x7f673806b530 2023-03-08T15:49:50.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f673c9ef700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f673806f8d0 0x7f673814a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33664/0 (socket says 172.21.15.123:33664) 2023-03-08T15:49:50.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f673c9ef700 1 -- 172.21.15.123:0/523946589 learned_addr learned my addr 172.21.15.123:0/523946589 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:50.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f673d1f0700 1 --2- 172.21.15.123:0/523946589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f673806b530 0x7f67380b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f672ffff700 1 -- 172.21.15.123:0/523946589 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554686426 0 0) 0x7f6738071280 con 0x7f673806f8d0 2023-03-08T15:49:50.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f672ffff700 1 -- 172.21.15.123:0/523946589 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67240035b0 con 0x7f673806f8d0 2023-03-08T15:49:50.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f673d1f0700 1 -- 172.21.15.123:0/523946589 >> v1:172.21.15.175:6789/0 conn(0x7f6738140980 legacy=0x7f67381513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f672ffff700 1 -- 172.21.15.123:0/523946589 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 740742088 0 0) 0x7f67240035b0 con 0x7f673806f8d0 2023-03-08T15:49:50.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f673d1f0700 1 -- 172.21.15.123:0/523946589 >> v1:172.21.15.123:6789/0 conn(0x7f673806f8d0 legacy=0x7f673814a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f673d1f0700 1 -- 172.21.15.123:0/523946589 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6738072020 con 0x7f673806b530 2023-03-08T15:49:50.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f673d1f0700 1 --2- 172.21.15.123:0/523946589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f673806b530 0x7f67380b3ab0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6734009870 tx=0x7f6734009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ff304adf7a6c37f server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:50.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f672ffff700 1 -- 172.21.15.123:0/523946589 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728001670 con 0x7f673806b530 2023-03-08T15:49:50.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f672ffff700 1 -- 172.21.15.123:0/523946589 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6734004030 con 0x7f673806b530 2023-03-08T15:49:50.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.419+0000 7f672ffff700 1 -- 172.21.15.123:0/523946589 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67340043a0 con 0x7f673806b530 2023-03-08T15:49:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.420+0000 7f673f454700 1 -- 172.21.15.123:0/523946589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f673806b530 msgr2=0x7f67380b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.420+0000 7f673f454700 1 --2- 172.21.15.123:0/523946589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f673806b530 0x7f67380b3ab0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6734009870 tx=0x7f6734009b80 comp rx=0 tx=0).stop 2023-03-08T15:49:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.420+0000 7f673f454700 1 -- 172.21.15.123:0/523946589 shutdown_connections 2023-03-08T15:49:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.420+0000 7f673f454700 1 --2- 172.21.15.123:0/523946589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f673806b530 0x7f67380b3ab0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.420+0000 7f673f454700 1 -- 172.21.15.123:0/523946589 >> 172.21.15.123:0/523946589 conn(0x7f67380ba3c0 msgr2=0x7f67380bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.420+0000 7f673f454700 1 -- 172.21.15.123:0/523946589 shutdown_connections 2023-03-08T15:49:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.420+0000 7f673f454700 1 -- 172.21.15.123:0/523946589 wait complete. 2023-03-08T15:49:50.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.421+0000 7f673f454700 1 Processor -- start 2023-03-08T15:49:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.421+0000 7f673f454700 1 -- start start 2023-03-08T15:49:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673f454700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f673806b530 0x7f67380b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673f454700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f673806f8d0 0x7f673812c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673f454700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6738140980 0x7f67380bbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673f454700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67380b6010 con 0x7f6738140980 2023-03-08T15:49:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673f454700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67380b85e0 con 0x7f673806f8d0 2023-03-08T15:49:50.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673f454700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67380b88c0 con 0x7f673806b530 2023-03-08T15:49:50.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673d9f1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6738140980 0x7f67380bbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673d9f1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6738140980 0x7f67380bbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36956/0 (socket says 172.21.15.123:36956) 2023-03-08T15:49:50.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673d9f1700 1 -- 172.21.15.123:0/3089645577 learned_addr learned my addr 172.21.15.123:0/3089645577 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:50.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673d1f0700 1 --2- 172.21.15.123:0/3089645577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f673806b530 0x7f67380b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673c9ef700 1 --2- 172.21.15.123:0/3089645577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f673806f8d0 0x7f673812c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673d9f1700 1 -- 172.21.15.123:0/3089645577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f673806b530 msgr2=0x7f67380b69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673d9f1700 1 --2- 172.21.15.123:0/3089645577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f673806b530 0x7f67380b69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673d9f1700 1 -- 172.21.15.123:0/3089645577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f673806f8d0 msgr2=0x7f673812c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673d9f1700 1 --2- 172.21.15.123:0/3089645577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f673806f8d0 0x7f673812c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673d9f1700 1 -- 172.21.15.123:0/3089645577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67340094a0 con 0x7f6738140980 2023-03-08T15:49:50.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673d9f1700 1 --2- 172.21.15.123:0/3089645577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6738140980 0x7f67380bbb60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f673000c7f0 tx=0x7f673000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:50.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f672dffb700 1 -- 172.21.15.123:0/3089645577 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730003e30 con 0x7f6738140980 2023-03-08T15:49:50.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f672dffb700 1 -- 172.21.15.123:0/3089645577 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6730005070 con 0x7f6738140980 2023-03-08T15:49:50.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f673f454700 1 -- 172.21.15.123:0/3089645577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6738071820 con 0x7f6738140980 2023-03-08T15:49:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.422+0000 7f672dffb700 1 -- 172.21.15.123:0/3089645577 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730005400 con 0x7f6738140980 2023-03-08T15:49:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.423+0000 7f673f454700 1 -- 172.21.15.123:0/3089645577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673806fe60 con 0x7f6738140980 2023-03-08T15:49:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.423+0000 7f673f454700 1 -- 172.21.15.123:0/3089645577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6738071b00 con 0x7f6738140980 2023-03-08T15:49:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.424+0000 7f672dffb700 1 -- 172.21.15.123:0/3089645577 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f6730010070 con 0x7f6738140980 2023-03-08T15:49:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.424+0000 7f672dffb700 1 --2- 172.21.15.123:0/3089645577 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f671c0698d0 0x7f671c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.424+0000 7f672dffb700 1 -- 172.21.15.123:0/3089645577 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f67300870d0 con 0x7f6738140980 2023-03-08T15:49:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.424+0000 7f673d1f0700 1 --2- 172.21.15.123:0/3089645577 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f671c0698d0 0x7f671c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.425+0000 7f673d1f0700 1 --2- 172.21.15.123:0/3089645577 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f671c0698d0 0x7f671c06bd80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6734000c00 tx=0x7f6734008000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.428+0000 7f672dffb700 1 -- 172.21.15.123:0/3089645577 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f6730052ea0 con 0x7f6738140980 2023-03-08T15:49:50.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.613+0000 7f673f454700 1 -- 172.21.15.123:0/3089645577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67380744c0 con 0x7f6738140980 2023-03-08T15:49:50.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.614+0000 7f672dffb700 1 -- 172.21.15.123:0/3089645577 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f67300564c0 con 0x7f6738140980 2023-03-08T15:49:50.615 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-03-08T15:49:50.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.616+0000 7f673f454700 1 -- 172.21.15.123:0/3089645577 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f671c0698d0 msgr2=0x7f671c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.616+0000 7f673f454700 1 --2- 172.21.15.123:0/3089645577 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f671c0698d0 0x7f671c06bd80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6734000c00 tx=0x7f6734008000 comp rx=0 tx=0).stop 2023-03-08T15:49:50.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.616+0000 7f673f454700 1 -- 172.21.15.123:0/3089645577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6738140980 msgr2=0x7f67380bbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.616+0000 7f673f454700 1 --2- 172.21.15.123:0/3089645577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6738140980 0x7f67380bbb60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f673000c7f0 tx=0x7f673000cb00 comp rx=0 tx=0).stop 2023-03-08T15:49:50.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.616+0000 7f673f454700 1 -- 172.21.15.123:0/3089645577 shutdown_connections 2023-03-08T15:49:50.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.616+0000 7f673f454700 1 --2- 172.21.15.123:0/3089645577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6738140980 0x7f67380bbb60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.616+0000 7f673f454700 1 --2- 172.21.15.123:0/3089645577 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f671c0698d0 0x7f671c06bd80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.616+0000 7f673f454700 1 --2- 172.21.15.123:0/3089645577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f673806b530 0x7f67380b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.616+0000 7f673f454700 1 --2- 172.21.15.123:0/3089645577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f673806f8d0 0x7f673812c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.616+0000 7f673f454700 1 -- 172.21.15.123:0/3089645577 >> 172.21.15.123:0/3089645577 conn(0x7f67380ba3c0 msgr2=0x7f673813eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:50.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.616+0000 7f673f454700 1 -- 172.21.15.123:0/3089645577 shutdown_connections 2023-03-08T15:49:50.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.616+0000 7f673f454700 1 -- 172.21.15.123:0/3089645577 wait complete. 2023-03-08T15:49:50.629 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-08T15:49:50.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.747+0000 7fac4263e700 1 Processor -- start 2023-03-08T15:49:50.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.747+0000 7fac4263e700 1 -- start start 2023-03-08T15:49:50.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.747+0000 7fac4263e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c14ad30 0x7fac3c0b8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.747+0000 7fac4263e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3c0b9b50 con 0x7fac3c144b40 2023-03-08T15:49:50.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.747+0000 7fac4263e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3c14dbf0 con 0x7fac3c0b8c90 2023-03-08T15:49:50.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.747+0000 7fac4263e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c14e870 con 0x7fac3c14ad30 2023-03-08T15:49:50.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fac3c144b40 0x7fac3c14a620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33678/0 (socket says 172.21.15.123:33678) 2023-03-08T15:49:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3bfff700 1 -- 172.21.15.123:0/3223511005 learned_addr learned my addr 172.21.15.123:0/3223511005 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3affd700 1 -- 172.21.15.123:0/3223511005 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452419130 0 0) 0x7fac3c0b9b50 con 0x7fac3c144b40 2023-03-08T15:49:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3affd700 1 -- 172.21.15.123:0/3223511005 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac240035b0 con 0x7fac3c144b40 2023-03-08T15:49:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3b7fe700 1 --2- 172.21.15.123:0/3223511005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c14ad30 0x7fac3c0b8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3affd700 1 -- 172.21.15.123:0/3223511005 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2588276594 0 0) 0x7fac240035b0 con 0x7fac3c144b40 2023-03-08T15:49:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3affd700 1 -- 172.21.15.123:0/3223511005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c14ad30 msgr2=0x7fac3c0b8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3affd700 1 --2- 172.21.15.123:0/3223511005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c14ad30 0x7fac3c0b8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3affd700 1 -- 172.21.15.123:0/3223511005 >> v1:172.21.15.175:6789/0 conn(0x7fac3c0b8c90 legacy=0x7fac3c154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3affd700 1 -- 172.21.15.123:0/3223511005 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c14ded0 con 0x7fac3c144b40 2023-03-08T15:49:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3affd700 1 -- 172.21.15.123:0/3223511005 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7fac2c001670 con 0x7fac3c144b40 2023-03-08T15:49:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3affd700 1 -- 172.21.15.123:0/3223511005 >> v1:172.21.15.123:6789/0 conn(0x7fac3c144b40 legacy=0x7fac3c14a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3affd700 1 --2- 172.21.15.123:0/3223511005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c14ad30 0x7fac24003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3affd700 1 --2- 172.21.15.123:0/3223511005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac24004060 0x7fac24004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3affd700 1 --2- 172.21.15.123:0/3223511005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac24004d90 0x7fac24005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3affd700 1 -- 172.21.15.123:0/3223511005 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c14e870 con 0x7fac24004060 2023-03-08T15:49:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3affd700 1 -- 172.21.15.123:0/3223511005 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2400bba0 con 0x7fac24004d90 2023-03-08T15:49:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3affd700 1 -- 172.21.15.123:0/3223511005 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2400bd60 con 0x7fac3c14ad30 2023-03-08T15:49:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3b7fe700 1 --2- 172.21.15.123:0/3223511005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac24004060 0x7fac24004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3bfff700 1 --2- 172.21.15.123:0/3223511005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c14ad30 0x7fac24003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac40bdb700 1 --2- 172.21.15.123:0/3223511005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac24004d90 0x7fac24005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.748+0000 7fac3b7fe700 1 -- 172.21.15.123:0/3223511005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c14ad30 msgr2=0x7fac24003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.749+0000 7fac3b7fe700 1 --2- 172.21.15.123:0/3223511005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c14ad30 0x7fac24003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.749+0000 7fac3b7fe700 1 -- 172.21.15.123:0/3223511005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac24004d90 msgr2=0x7fac24005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:50.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.749+0000 7fac3b7fe700 1 --2- 172.21.15.123:0/3223511005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac24004d90 0x7fac24005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.749+0000 7fac3b7fe700 1 -- 172.21.15.123:0/3223511005 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240035b0 con 0x7fac24004060 2023-03-08T15:49:50.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.749+0000 7fac3b7fe700 1 --2- 172.21.15.123:0/3223511005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac24004060 0x7fac24004850 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fac30009890 tx=0x7fac24005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ad16ff76cf14e5 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:50.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.749+0000 7fac3affd700 1 -- 172.21.15.123:0/3223511005 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3000c070 con 0x7fac24004060 2023-03-08T15:49:50.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.749+0000 7fac3affd700 1 -- 172.21.15.123:0/3223511005 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac30013610 con 0x7fac24004060 2023-03-08T15:49:50.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.749+0000 7fac3affd700 1 -- 172.21.15.123:0/3223511005 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac300139a0 con 0x7fac24004060 2023-03-08T15:49:50.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.749+0000 7fac4263e700 1 -- 172.21.15.123:0/3223511005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac24004060 msgr2=0x7fac24004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.749+0000 7fac4263e700 1 --2- 172.21.15.123:0/3223511005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac24004060 0x7fac24004850 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fac30009890 tx=0x7fac24005880 comp rx=0 tx=0).stop 2023-03-08T15:49:50.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.749+0000 7fac40bdb700 1 -- 172.21.15.123:0/3223511005 reap_dead start 2023-03-08T15:49:50.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.749+0000 7fac4263e700 1 -- 172.21.15.123:0/3223511005 shutdown_connections 2023-03-08T15:49:50.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.749+0000 7fac4263e700 1 -- 172.21.15.123:0/3223511005 >> 172.21.15.123:0/3223511005 conn(0x7fac3c071980 msgr2=0x7fac3c071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:50.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.749+0000 7fac4263e700 1 -- 172.21.15.123:0/3223511005 shutdown_connections 2023-03-08T15:49:50.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.749+0000 7fac4263e700 1 -- 172.21.15.123:0/3223511005 wait complete. 2023-03-08T15:49:50.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.750+0000 7fac4263e700 1 Processor -- start 2023-03-08T15:49:50.758 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.751+0000 7fac4263e700 1 -- start start 2023-03-08T15:49:50.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.751+0000 7fac4263e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac24004060 0x7fac3c1d5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.751+0000 7fac4263e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c149860 0x7fac3c1dfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.751+0000 7fac4263e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac3c1e33e0 0x7fac3c1e3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.751+0000 7fac4263e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c1d6910 con 0x7fac24004060 2023-03-08T15:49:50.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.751+0000 7fac4263e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c147d10 con 0x7fac3c1e33e0 2023-03-08T15:49:50.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.751+0000 7fac4263e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c147f60 con 0x7fac3c149860 2023-03-08T15:49:50.759 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.751+0000 7fac3bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac24004060 0x7fac3c1d5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.751+0000 7fac3bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac24004060 0x7fac3c1d5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36982/0 (socket says 172.21.15.123:36982) 2023-03-08T15:49:50.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.751+0000 7fac3bfff700 1 -- 172.21.15.123:0/2144538231 learned_addr learned my addr 172.21.15.123:0/2144538231 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:50.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.751+0000 7fac40bdb700 1 --2- 172.21.15.123:0/2144538231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac3c1e33e0 0x7fac3c1e3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.751+0000 7fac3b7fe700 1 --2- 172.21.15.123:0/2144538231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c149860 0x7fac3c1dfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.752+0000 7fac3bfff700 1 -- 172.21.15.123:0/2144538231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c149860 msgr2=0x7fac3c1dfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.752+0000 7fac3bfff700 1 --2- 172.21.15.123:0/2144538231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c149860 0x7fac3c1dfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.752+0000 7fac3bfff700 1 -- 172.21.15.123:0/2144538231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac3c1e33e0 msgr2=0x7fac3c1e3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.760 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.752+0000 7fac3bfff700 1 --2- 172.21.15.123:0/2144538231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac3c1e33e0 0x7fac3c1e3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.752+0000 7fac3bfff700 1 -- 172.21.15.123:0/2144538231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c14e490 con 0x7fac24004060 2023-03-08T15:49:50.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.752+0000 7fac3bfff700 1 --2- 172.21.15.123:0/2144538231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac24004060 0x7fac3c1d5e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fac2c007290 tx=0x7fac2c007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:50.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.752+0000 7fac38ff9700 1 -- 172.21.15.123:0/2144538231 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c007830 con 0x7fac24004060 2023-03-08T15:49:50.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.752+0000 7fac38ff9700 1 -- 172.21.15.123:0/2144538231 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c00f8d0 con 0x7fac24004060 2023-03-08T15:49:50.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.752+0000 7fac38ff9700 1 -- 172.21.15.123:0/2144538231 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c00fca0 con 0x7fac24004060 2023-03-08T15:49:50.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.752+0000 7fac4263e700 1 -- 172.21.15.123:0/2144538231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3c14e1b0 con 0x7fac24004060 2023-03-08T15:49:50.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.752+0000 7fac4263e700 1 -- 172.21.15.123:0/2144538231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3c0b7d40 con 0x7fac24004060 2023-03-08T15:49:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.753+0000 7fac4263e700 1 -- 172.21.15.123:0/2144538231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3c1d7190 con 0x7fac24004060 2023-03-08T15:49:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.753+0000 7fac38ff9700 1 -- 172.21.15.123:0/2144538231 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fac2c01d460 con 0x7fac24004060 2023-03-08T15:49:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.753+0000 7fac38ff9700 1 --2- 172.21.15.123:0/2144538231 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fac280698d0 0x7fac2806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.754+0000 7fac3b7fe700 1 --2- 172.21.15.123:0/2144538231 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fac280698d0 0x7fac2806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.754+0000 7fac38ff9700 1 -- 172.21.15.123:0/2144538231 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac2c087890 con 0x7fac24004060 2023-03-08T15:49:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.754+0000 7fac3b7fe700 1 --2- 172.21.15.123:0/2144538231 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fac280698d0 0x7fac2806bd80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fac300097b0 tx=0x7fac3001e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.758+0000 7fac38ff9700 1 -- 172.21.15.123:0/2144538231 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fac2c053600 con 0x7fac24004060 2023-03-08T15:49:50.992 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.990+0000 7fac4263e700 1 -- 172.21.15.123:0/2144538231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac3c0744c0 con 0x7fac24004060 2023-03-08T15:49:50.992 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.991+0000 7fac38ff9700 1 -- 172.21.15.123:0/2144538231 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3915 (secure 0 0 0) 0x7fac2c056c20 con 0x7fac24004060 2023-03-08T15:49:50.993 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:50.993 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/108043707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":108043707},{"type":"v1","addr":"172.21.15.123:6835","nonce":108043707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1787308526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1787308526},{"type":"v1","addr":"172.21.15.123:6837","nonce":1787308526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-08T15:49:39.489034+0000","modified":"2023-03-08T15:49:42.501407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6833/1018957090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1018957090},{"type":"v1","addr":"172.21.15.175:6833","nonce":1018957090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-08T15:49:50.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.993+0000 7fac4263e700 1 -- 172.21.15.123:0/2144538231 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fac280698d0 msgr2=0x7fac2806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.994 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.993+0000 7fac4263e700 1 --2- 172.21.15.123:0/2144538231 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fac280698d0 0x7fac2806bd80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fac300097b0 tx=0x7fac3001e040 comp rx=0 tx=0).stop 2023-03-08T15:49:50.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.993+0000 7fac4263e700 1 -- 172.21.15.123:0/2144538231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac24004060 msgr2=0x7fac3c1d5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:50.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.993+0000 7fac4263e700 1 --2- 172.21.15.123:0/2144538231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac24004060 0x7fac3c1d5e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fac2c007290 tx=0x7fac2c007650 comp rx=0 tx=0).stop 2023-03-08T15:49:50.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.993+0000 7fac4263e700 1 -- 172.21.15.123:0/2144538231 shutdown_connections 2023-03-08T15:49:50.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.993+0000 7fac4263e700 1 --2- 172.21.15.123:0/2144538231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac3c1e33e0 0x7fac3c1e3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.993+0000 7fac4263e700 1 --2- 172.21.15.123:0/2144538231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac24004060 0x7fac3c1d5e10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.993+0000 7fac4263e700 1 --2- 172.21.15.123:0/2144538231 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fac280698d0 0x7fac2806bd80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.995 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.993+0000 7fac4263e700 1 --2- 172.21.15.123:0/2144538231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c149860 0x7fac3c1dfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:50.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.993+0000 7fac4263e700 1 -- 172.21.15.123:0/2144538231 >> 172.21.15.123:0/2144538231 conn(0x7fac3c071980 msgr2=0x7fac3c0bb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:50.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.993+0000 7fac4263e700 1 -- 172.21.15.123:0/2144538231 shutdown_connections 2023-03-08T15:49:50.996 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:50.993+0000 7fac4263e700 1 -- 172.21.15.123:0/2144538231 wait complete. 2023-03-08T15:49:50.996 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2023-03-08T15:49:51.308 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-08T15:49:39.489034+0000', 'modified': '2023-03-08T15:49:42.501407+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6833/1018957090', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 1018957090}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 1018957090}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-08T15:49:51.308 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-08T15:49:51.308 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-03-08T15:49:51.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.428+0000 7fa446d73700 1 Processor -- start 2023-03-08T15:49:51.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.428+0000 7fa446d73700 1 -- start start 2023-03-08T15:49:51.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.428+0000 7fa446d73700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4400b7900 0x7fa440140990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.428+0000 7fa446d73700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa44006aee0 0x7fa440140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.428+0000 7fa446d73700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4400b59c0 con 0x7fa4400b8320 2023-03-08T15:49:51.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.428+0000 7fa446d73700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4400b8b10 con 0x7fa44006aee0 2023-03-08T15:49:51.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.429+0000 7fa446d73700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4400b56e0 con 0x7fa4400b7900 2023-03-08T15:49:51.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.429+0000 7fa444b0f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4400b7900 0x7fa440140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.429+0000 7fa43ffff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa44006aee0 0x7fa440140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.429+0000 7fa444b0f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4400b7900 0x7fa440140990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:50278/0 (socket says 172.21.15.123:50278) 2023-03-08T15:49:51.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.429+0000 7fa444b0f700 1 -- 172.21.15.123:0/2526565923 learned_addr learned my addr 172.21.15.123:0/2526565923 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:51.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.429+0000 7fa445310700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa4400b8320 0x7fa440146fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.123:38802/0 (socket says 172.21.15.123:38802) 2023-03-08T15:49:51.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.429+0000 7fa444b0f700 1 -- 172.21.15.123:0/2526565923 >> v2:172.21.15.175:3300/0 conn(0x7fa44006aee0 msgr2=0x7fa440140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:51.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.429+0000 7fa444b0f700 1 --2- 172.21.15.123:0/2526565923 >> v2:172.21.15.175:3300/0 conn(0x7fa44006aee0 0x7fa440140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.429+0000 7fa444b0f700 1 -- 172.21.15.123:0/2526565923 >> v1:172.21.15.175:6789/0 conn(0x7fa4400b8320 legacy=0x7fa440146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:51.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.429+0000 7fa43f7fe700 1 -- 172.21.15.123:0/2526565923 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182716968 0 0) 0x7fa4400b59c0 con 0x7fa4400b8320 2023-03-08T15:49:51.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.429+0000 7fa444b0f700 1 -- 172.21.15.123:0/2526565923 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4400b7cd0 con 0x7fa4400b7900 2023-03-08T15:49:51.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.429+0000 7fa444b0f700 1 --2- 172.21.15.123:0/2526565923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4400b7900 0x7fa440140990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa4340098f0 tx=0x7fa434009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76da9f92badc1ba7 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:51.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.429+0000 7fa43f7fe700 1 -- 172.21.15.123:0/2526565923 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434011830 con 0x7fa4400b7900 2023-03-08T15:49:51.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.430+0000 7fa43f7fe700 1 -- 172.21.15.123:0/2526565923 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa434011990 con 0x7fa4400b7900 2023-03-08T15:49:51.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.430+0000 7fa43f7fe700 1 -- 172.21.15.123:0/2526565923 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434011d20 con 0x7fa4400b7900 2023-03-08T15:49:51.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.430+0000 7fa446d73700 1 -- 172.21.15.123:0/2526565923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4400b7900 msgr2=0x7fa440140990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:51.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.430+0000 7fa446d73700 1 --2- 172.21.15.123:0/2526565923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4400b7900 0x7fa440140990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa4340098f0 tx=0x7fa434009c00 comp rx=0 tx=0).stop 2023-03-08T15:49:51.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.430+0000 7fa446d73700 1 -- 172.21.15.123:0/2526565923 shutdown_connections 2023-03-08T15:49:51.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.430+0000 7fa446d73700 1 --2- 172.21.15.123:0/2526565923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4400b7900 0x7fa440140990 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.430+0000 7fa446d73700 1 --2- 172.21.15.123:0/2526565923 >> v2:172.21.15.175:3300/0 conn(0x7fa44006aee0 0x7fa440140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.430+0000 7fa446d73700 1 -- 172.21.15.123:0/2526565923 >> 172.21.15.123:0/2526565923 conn(0x7fa4400bc480 msgr2=0x7fa4400bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:51.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.430+0000 7fa446d73700 1 -- 172.21.15.123:0/2526565923 shutdown_connections 2023-03-08T15:49:51.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.430+0000 7fa446d73700 1 -- 172.21.15.123:0/2526565923 wait complete. 2023-03-08T15:49:51.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.431+0000 7fa446d73700 1 Processor -- start 2023-03-08T15:49:51.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.431+0000 7fa446d73700 1 -- start start 2023-03-08T15:49:51.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa446d73700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa44006aee0 0x7fa440070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa446d73700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4400b7900 0x7fa440135c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa446d73700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400b8320 0x7fa44006f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa446d73700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4400713e0 con 0x7fa4400b8320 2023-03-08T15:49:51.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa446d73700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4401dc060 con 0x7fa44006aee0 2023-03-08T15:49:51.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa446d73700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4401dc310 con 0x7fa4400b7900 2023-03-08T15:49:51.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa445310700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400b8320 0x7fa44006f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa445310700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400b8320 0x7fa44006f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36990/0 (socket says 172.21.15.123:36990) 2023-03-08T15:49:51.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa445310700 1 -- 172.21.15.123:0/1635898460 learned_addr learned my addr 172.21.15.123:0/1635898460 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:51.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa43ffff700 1 --2- 172.21.15.123:0/1635898460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4400b7900 0x7fa440135c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa444b0f700 1 --2- 172.21.15.123:0/1635898460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa44006aee0 0x7fa440070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa445310700 1 -- 172.21.15.123:0/1635898460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4400b7900 msgr2=0x7fa440135c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:51.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa445310700 1 --2- 172.21.15.123:0/1635898460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4400b7900 0x7fa440135c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa445310700 1 -- 172.21.15.123:0/1635898460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa44006aee0 msgr2=0x7fa440070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:51.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa445310700 1 --2- 172.21.15.123:0/1635898460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa44006aee0 0x7fa440070e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa445310700 1 -- 172.21.15.123:0/1635898460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa434009550 con 0x7fa4400b8320 2023-03-08T15:49:51.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa444b0f700 1 --2- 172.21.15.123:0/1635898460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa44006aee0 0x7fa440070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:51.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa445310700 1 --2- 172.21.15.123:0/1635898460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400b8320 0x7fa44006f940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa43800cb60 tx=0x7fa43800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:51.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.432+0000 7fa43d7fa700 1 -- 172.21.15.123:0/1635898460 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43800a980 con 0x7fa4400b8320 2023-03-08T15:49:51.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.433+0000 7fa43d7fa700 1 -- 172.21.15.123:0/1635898460 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43800aae0 con 0x7fa4400b8320 2023-03-08T15:49:51.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.433+0000 7fa446d73700 1 -- 172.21.15.123:0/1635898460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4400bd360 con 0x7fa4400b8320 2023-03-08T15:49:51.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.433+0000 7fa43d7fa700 1 -- 172.21.15.123:0/1635898460 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43800ae90 con 0x7fa4400b8320 2023-03-08T15:49:51.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.433+0000 7fa446d73700 1 -- 172.21.15.123:0/1635898460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4400bd1d0 con 0x7fa4400b8320 2023-03-08T15:49:51.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.434+0000 7fa43d7fa700 1 -- 172.21.15.123:0/1635898460 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fa438019030 con 0x7fa4400b8320 2023-03-08T15:49:51.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.434+0000 7fa43d7fa700 1 --2- 172.21.15.123:0/1635898460 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4240698d0 0x7fa42406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.434+0000 7fa444b0f700 1 --2- 172.21.15.123:0/1635898460 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4240698d0 0x7fa42406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.434+0000 7fa43d7fa700 1 -- 172.21.15.123:0/1635898460 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa438087060 con 0x7fa4400b8320 2023-03-08T15:49:51.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.435+0000 7fa444b0f700 1 --2- 172.21.15.123:0/1635898460 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4240698d0 0x7fa42406bd80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa434009c40 tx=0x7fa434008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:51.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.436+0000 7fa452f0cb80 1 Processor -- start 2023-03-08T15:49:51.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.436+0000 7fa452f0cb80 1 -- start start 2023-03-08T15:49:51.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa452f0cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad671610 0x563fad6a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa452f0cb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad66cdc0 0x563fad66d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa452f0cb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad69ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa452f0cb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fad5dcc70 con 0x563fad69a7b0 2023-03-08T15:49:51.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa452f0cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fad55bc90 con 0x563fad671610 2023-03-08T15:49:51.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa452f0cb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fad5cae50 con 0x563fad66cdc0 2023-03-08T15:49:51.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa445310700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad69ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa445310700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad69ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36996/0 (socket says 172.21.15.123:36996) 2023-03-08T15:49:51.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa445310700 1 -- 172.21.15.123:0/2925493727 learned_addr learned my addr 172.21.15.123:0/2925493727 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:51.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa444b0f700 1 --2- 172.21.15.123:0/2925493727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad671610 0x563fad6a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa43ffff700 1 --2- 172.21.15.123:0/2925493727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad66cdc0 0x563fad66d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa445310700 1 -- 172.21.15.123:0/2925493727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad66cdc0 msgr2=0x563fad66d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:51.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa445310700 1 --2- 172.21.15.123:0/2925493727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad66cdc0 0x563fad66d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa445310700 1 -- 172.21.15.123:0/2925493727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad671610 msgr2=0x563fad6a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:51.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa445310700 1 --2- 172.21.15.123:0/2925493727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad671610 0x563fad6a4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa445310700 1 -- 172.21.15.123:0/2925493727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fad3b8540 con 0x563fad69a7b0 2023-03-08T15:49:51.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa445310700 1 --2- 172.21.15.123:0/2925493727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad69ac20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa438056670 tx=0x7fa43805ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83793c730b29852 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:51.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa42a7fc700 1 -- 172.21.15.123:0/2925493727 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43805e800 con 0x563fad69a7b0 2023-03-08T15:49:51.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa42a7fc700 1 -- 172.21.15.123:0/2925493727 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43806b070 con 0x563fad69a7b0 2023-03-08T15:49:51.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.437+0000 7fa42a7fc700 1 -- 172.21.15.123:0/2925493727 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa438052a10 con 0x563fad69a7b0 2023-03-08T15:49:51.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.438+0000 7fa452f0cb80 1 -- 172.21.15.123:0/2925493727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 msgr2=0x563fad69ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:51.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.438+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/2925493727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad69ac20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa438056670 tx=0x7fa43805ea90 comp rx=0 tx=0).stop 2023-03-08T15:49:51.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.438+0000 7fa452f0cb80 1 -- 172.21.15.123:0/2925493727 shutdown_connections 2023-03-08T15:49:51.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.438+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/2925493727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad69ac20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.438+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/2925493727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad671610 0x563fad6a4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.438+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/2925493727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad66cdc0 0x563fad66d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.438+0000 7fa452f0cb80 1 -- 172.21.15.123:0/2925493727 >> 172.21.15.123:0/2925493727 conn(0x563fad667290 msgr2=0x563fad670d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:51.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.438+0000 7fa452f0cb80 1 -- 172.21.15.123:0/2925493727 shutdown_connections 2023-03-08T15:49:51.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.438+0000 7fa452f0cb80 1 -- 172.21.15.123:0/2925493727 wait complete. 2023-03-08T15:49:51.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.439+0000 7fa452f0cb80 1 -- start start 2023-03-08T15:49:51.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.439+0000 7fa452f0cb80 1 Processor -- start 2023-03-08T15:49:51.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa452f0cb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad66cdc0 0x563fad69e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa452f0cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad671610 0x563fad69d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa452f0cb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad68d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa452f0cb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fad5c41c0 con 0x563fad69a7b0 2023-03-08T15:49:51.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa452f0cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fad3b9140 con 0x563fad671610 2023-03-08T15:49:51.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa452f0cb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fad69c860 con 0x563fad66cdc0 2023-03-08T15:49:51.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa452f0cb80 10 client.0 _ll_register_callbacks cb 0x563fad56a2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-08T15:49:51.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa445310700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad68d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa445310700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad68d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37004/0 (socket says 172.21.15.123:37004) 2023-03-08T15:49:51.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa445310700 1 -- 172.21.15.123:0/2366784058 learned_addr learned my addr 172.21.15.123:0/2366784058 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:51.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa444b0f700 1 --2- 172.21.15.123:0/2366784058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad66cdc0 0x563fad69e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa43ffff700 1 --2- 172.21.15.123:0/2366784058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad671610 0x563fad69d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa445310700 1 -- 172.21.15.123:0/2366784058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad66cdc0 msgr2=0x563fad69e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:51.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa445310700 1 --2- 172.21.15.123:0/2366784058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad66cdc0 0x563fad69e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa445310700 1 -- 172.21.15.123:0/2366784058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad671610 msgr2=0x563fad69d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:51.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa445310700 1 --2- 172.21.15.123:0/2366784058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad671610 0x563fad69d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa445310700 1 -- 172.21.15.123:0/2366784058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4400bd1d0 con 0x563fad69a7b0 2023-03-08T15:49:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa445310700 1 --2- 172.21.15.123:0/2366784058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad68d670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa438056930 tx=0x7fa4380013a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2061c7c965803f9d server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.440+0000 7fa41f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2023-03-08T15:49:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.441+0000 7fa41f7fe700 1 -- 172.21.15.123:0/2366784058 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4380529f0 con 0x563fad69a7b0 2023-03-08T15:49:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.441+0000 7fa41f7fe700 1 -- 172.21.15.123:0/2366784058 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa438052b50 con 0x563fad69a7b0 2023-03-08T15:49:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.441+0000 7fa452f0cb80 1 -- 172.21.15.123:0/2366784058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fad6648a0 con 0x563fad69a7b0 2023-03-08T15:49:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.441+0000 7fa41f7fe700 1 -- 172.21.15.123:0/2366784058 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa438055960 con 0x563fad69a7b0 2023-03-08T15:49:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.441+0000 7fa452f0cb80 10 client.4593 fetch_fsmap learned FSMap version 8 2023-03-08T15:49:51.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.441+0000 7fa452f0cb80 1 -- 172.21.15.123:0/2366784058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x563fad3f2b10 con 0x563fad69a7b0 2023-03-08T15:49:51.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.441+0000 7fa41f7fe700 1 -- 172.21.15.123:0/2366784058 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563fad6648a0 con 0x563fad69a7b0 2023-03-08T15:49:51.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.441+0000 7fa41f7fe700 1 -- 172.21.15.123:0/2366784058 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 8) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fa438055ac0 con 0x563fad69a7b0 2023-03-08T15:49:51.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.441+0000 7fa452f0cb80 10 client.4593 fetch_fsmap finished waiting for FSMap version 8 2023-03-08T15:49:51.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.441+0000 7fa452f0cb80 10 client.4593 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-08T15:49:51.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.441+0000 7fa452f0cb80 20 client.4593 populate_metadata read hostname 'smithi123' 2023-03-08T15:49:51.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.441+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/2366784058 >> [v2:172.21.15.175:6832/1018957090,v1:172.21.15.175:6833/1018957090] conn(0x563fad6b76c0 0x563fad6b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.441+0000 7fa452f0cb80 4 client.4593 mds_command: new command op to 4294 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-08T15:49:51.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.441+0000 7fa452f0cb80 1 -- 172.21.15.123:0/2366784058 --> [v2:172.21.15.175:6832/1018957090,v1:172.21.15.175:6833/1018957090] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563fad5bd300 con 0x563fad6b76c0 2023-03-08T15:49:51.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.441+0000 7fa444b0f700 1 --2- 172.21.15.123:0/2366784058 >> [v2:172.21.15.175:6832/1018957090,v1:172.21.15.175:6833/1018957090] conn(0x563fad6b76c0 0x563fad6b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.442+0000 7fa41f7fe700 10 client.4593 ms_handle_connect on v2:172.21.15.175:6832/1018957090 2023-03-08T15:49:51.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.442+0000 7fa444b0f700 1 --2- 172.21.15.123:0/2366784058 >> [v2:172.21.15.175:6832/1018957090,v1:172.21.15.175:6833/1018957090] conn(0x563fad6b76c0 0x563fad6b7a90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6f1a76f6a8c33c2 server_cookie=91476a728a1fbd29 in_seq=0 out_seq=0 2023-03-08T15:49:51.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.442+0000 7fa41f7fe700 1 -- 172.21.15.123:0/2366784058 <== mds.0 v2:172.21.15.175:6832/1018957090 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563fad5bd300 con 0x563fad6b76c0 2023-03-08T15:49:51.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.442+0000 7fa41f7fe700 10 client.4593 handle_command_reply: tid=0 2023-03-08T15:49:51.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.442+0000 7fa452f0cb80 1 client.4593 shutdown 2023-03-08T15:49:51.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.442+0000 7fa452f0cb80 1 -- 172.21.15.123:0/2366784058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 msgr2=0x563fad68d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:51.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.442+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/2366784058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad68d670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa438056930 tx=0x7fa4380013a0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.442+0000 7fa452f0cb80 1 -- 172.21.15.123:0/2366784058 shutdown_connections 2023-03-08T15:49:51.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.442+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/2366784058 >> [v2:172.21.15.175:6832/1018957090,v1:172.21.15.175:6833/1018957090] conn(0x563fad6b76c0 0x563fad6b7a90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.442+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/2366784058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad68d670 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.442+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/2366784058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad66cdc0 0x563fad69e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.442+0000 7fa41f7fe700 0 client.4593 ms_handle_reset on v2:172.21.15.175:6832/1018957090 2023-03-08T15:49:51.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.442+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/2366784058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad671610 0x563fad69d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.443+0000 7fa452f0cb80 1 -- 172.21.15.123:0/2366784058 >> 172.21.15.123:0/2366784058 conn(0x563fad667290 msgr2=0x563fad66d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:51.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.443+0000 7fa452f0cb80 1 -- 172.21.15.123:0/2366784058 shutdown_connections 2023-03-08T15:49:51.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.443+0000 7fa452f0cb80 1 -- 172.21.15.123:0/2366784058 wait complete. 2023-03-08T15:49:51.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.443+0000 7fa452f0cb80 20 client.4593 trim_cache size 0 max 16384 2023-03-08T15:49:51.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.460+0000 7fa452f0cb80 1 Processor -- start 2023-03-08T15:49:51.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.460+0000 7fa452f0cb80 1 -- start start 2023-03-08T15:49:51.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa452f0cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad66cdc0 0x563fad6a20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa452f0cb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad671610 0x563fad6a0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa452f0cb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad6ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa452f0cb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fad6738c0 con 0x563fad69a7b0 2023-03-08T15:49:51.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa452f0cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fad6a51a0 con 0x563fad66cdc0 2023-03-08T15:49:51.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa452f0cb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fad6a5f40 con 0x563fad671610 2023-03-08T15:49:51.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa445310700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad6ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa445310700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad6ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37016/0 (socket says 172.21.15.123:37016) 2023-03-08T15:49:51.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa445310700 1 -- 172.21.15.123:0/3101701360 learned_addr learned my addr 172.21.15.123:0/3101701360 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:51.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa444b0f700 1 --2- 172.21.15.123:0/3101701360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad66cdc0 0x563fad6a20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa43ffff700 1 --2- 172.21.15.123:0/3101701360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad671610 0x563fad6a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa445310700 1 -- 172.21.15.123:0/3101701360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad671610 msgr2=0x563fad6a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:51.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa445310700 1 --2- 172.21.15.123:0/3101701360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad671610 0x563fad6a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa445310700 1 -- 172.21.15.123:0/3101701360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad66cdc0 msgr2=0x563fad6a20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:51.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa445310700 1 --2- 172.21.15.123:0/3101701360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad66cdc0 0x563fad6a20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.465 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa445310700 1 -- 172.21.15.123:0/3101701360 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fad58b230 con 0x563fad69a7b0 2023-03-08T15:49:51.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa43ffff700 1 --2- 172.21.15.123:0/3101701360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad671610 0x563fad6a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:51.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa445310700 1 --2- 172.21.15.123:0/3101701360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad6ae1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa438001750 tx=0x7fa438081040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e59396fee3051c0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:51.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa42affd700 1 -- 172.21.15.123:0/3101701360 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa438055b60 con 0x563fad69a7b0 2023-03-08T15:49:51.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa42affd700 1 -- 172.21.15.123:0/3101701360 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4380527f0 con 0x563fad69a7b0 2023-03-08T15:49:51.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.461+0000 7fa42affd700 1 -- 172.21.15.123:0/3101701360 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa438052ba0 con 0x563fad69a7b0 2023-03-08T15:49:51.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.462+0000 7fa452f0cb80 1 -- 172.21.15.123:0/3101701360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 msgr2=0x563fad6ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:51.466 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.462+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/3101701360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad6ae1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa438001750 tx=0x7fa438081040 comp rx=0 tx=0).stop 2023-03-08T15:49:51.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.462+0000 7fa452f0cb80 1 -- 172.21.15.123:0/3101701360 shutdown_connections 2023-03-08T15:49:51.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.462+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/3101701360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad69a7b0 0x563fad6ae1a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.462+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/3101701360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad66cdc0 0x563fad6a20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.462+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/3101701360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad671610 0x563fad6a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.462+0000 7fa452f0cb80 1 -- 172.21.15.123:0/3101701360 >> 172.21.15.123:0/3101701360 conn(0x563fad667290 msgr2=0x563fad69c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:51.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.462+0000 7fa452f0cb80 1 -- 172.21.15.123:0/3101701360 shutdown_connections 2023-03-08T15:49:51.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.462+0000 7fa452f0cb80 1 -- 172.21.15.123:0/3101701360 wait complete. 2023-03-08T15:49:51.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.462+0000 7fa452f0cb80 1 -- start start 2023-03-08T15:49:51.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.463+0000 7fa452f0cb80 1 Processor -- start 2023-03-08T15:49:51.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa452f0cb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad66cdc0 0x563fad6b7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa452f0cb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad671610 0x563fad708f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa452f0cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad69a7b0 0x563fad7094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa452f0cb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fad670ee0 con 0x563fad66cdc0 2023-03-08T15:49:51.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa452f0cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fad7127d0 con 0x563fad69a7b0 2023-03-08T15:49:51.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa452f0cb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fad6b1a90 con 0x563fad671610 2023-03-08T15:49:51.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa444b0f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad66cdc0 0x563fad6b7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa452f0cb80 10 client.0 _ll_register_callbacks cb 0x563fad56a2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-08T15:49:51.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa444b0f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad66cdc0 0x563fad6b7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37030/0 (socket says 172.21.15.123:37030) 2023-03-08T15:49:51.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa444b0f700 1 -- 172.21.15.123:0/1926503805 learned_addr learned my addr 172.21.15.123:0/1926503805 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:51.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa445310700 1 --2- 172.21.15.123:0/1926503805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad69a7b0 0x563fad7094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.472 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa43ffff700 1 --2- 172.21.15.123:0/1926503805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad671610 0x563fad708f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa444b0f700 1 -- 172.21.15.123:0/1926503805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad671610 msgr2=0x563fad708f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:51.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa444b0f700 1 --2- 172.21.15.123:0/1926503805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad671610 0x563fad708f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa444b0f700 1 -- 172.21.15.123:0/1926503805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad69a7b0 msgr2=0x563fad7094d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:51.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa444b0f700 1 --2- 172.21.15.123:0/1926503805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad69a7b0 0x563fad7094d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa444b0f700 1 -- 172.21.15.123:0/1926503805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563fad3f2b10 con 0x563fad66cdc0 2023-03-08T15:49:51.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa445310700 1 --2- 172.21.15.123:0/1926503805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad69a7b0 0x563fad7094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:51.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa43ffff700 1 --2- 172.21.15.123:0/1926503805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad671610 0x563fad708f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:51.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa444b0f700 1 --2- 172.21.15.123:0/1926503805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad66cdc0 0x563fad6b7dd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa434013000 tx=0x7fa43400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ded6f294685d5da server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:51.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa41f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2023-03-08T15:49:51.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa41f7fe700 1 -- 172.21.15.123:0/1926503805 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434034e40 con 0x563fad66cdc0 2023-03-08T15:49:51.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa41f7fe700 1 -- 172.21.15.123:0/1926503805 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa4340036a0 con 0x563fad66cdc0 2023-03-08T15:49:51.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa452f0cb80 1 -- 172.21.15.123:0/1926503805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa43806b070 con 0x563fad66cdc0 2023-03-08T15:49:51.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa41f7fe700 1 -- 172.21.15.123:0/1926503805 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa434003860 con 0x563fad66cdc0 2023-03-08T15:49:51.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa452f0cb80 10 client.4599 fetch_fsmap learned FSMap version 8 2023-03-08T15:49:51.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.464+0000 7fa452f0cb80 1 -- 172.21.15.123:0/1926503805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x563fad3db990 con 0x563fad66cdc0 2023-03-08T15:49:51.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.465+0000 7fa41f7fe700 1 -- 172.21.15.123:0/1926503805 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43806b070 con 0x563fad66cdc0 2023-03-08T15:49:51.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.465+0000 7fa41f7fe700 1 -- 172.21.15.123:0/1926503805 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 8) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fa4340039c0 con 0x563fad66cdc0 2023-03-08T15:49:51.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.465+0000 7fa452f0cb80 10 client.4599 fetch_fsmap finished waiting for FSMap version 8 2023-03-08T15:49:51.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.465+0000 7fa452f0cb80 10 client.4599 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-08T15:49:51.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.465+0000 7fa452f0cb80 20 client.4599 populate_metadata read hostname 'smithi123' 2023-03-08T15:49:51.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.465+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/1926503805 >> [v2:172.21.15.175:6832/1018957090,v1:172.21.15.175:6833/1018957090] conn(0x563fad6b76c0 0x563fad6b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.465+0000 7fa452f0cb80 4 client.4599 mds_command: new command op to 4294 tid=0[{"prefix": "status"}] 2023-03-08T15:49:51.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.465+0000 7fa452f0cb80 1 -- 172.21.15.123:0/1926503805 --> [v2:172.21.15.175:6832/1018957090,v1:172.21.15.175:6833/1018957090] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563fad413ca0 con 0x563fad6b76c0 2023-03-08T15:49:51.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.465+0000 7fa43ffff700 1 --2- 172.21.15.123:0/1926503805 >> [v2:172.21.15.175:6832/1018957090,v1:172.21.15.175:6833/1018957090] conn(0x563fad6b76c0 0x563fad6b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.465+0000 7fa41f7fe700 10 client.4599 ms_handle_connect on v2:172.21.15.175:6832/1018957090 2023-03-08T15:49:51.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.465+0000 7fa43ffff700 1 --2- 172.21.15.123:0/1926503805 >> [v2:172.21.15.175:6832/1018957090,v1:172.21.15.175:6833/1018957090] conn(0x563fad6b76c0 0x563fad6b6160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=687939dd3ba8844a server_cookie=a9308e22c0c77835 in_seq=0 out_seq=0 2023-03-08T15:49:51.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.465+0000 7fa41f7fe700 1 -- 172.21.15.123:0/1926503805 <== mds.0 v2:172.21.15.175:6832/1018957090 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x563fad413ca0 con 0x563fad6b76c0 2023-03-08T15:49:51.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.465+0000 7fa41f7fe700 10 client.4599 handle_command_reply: tid=0 2023-03-08T15:49:51.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.465+0000 7fa452f0cb80 1 client.4599 shutdown 2023-03-08T15:49:51.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa452f0cb80 1 -- 172.21.15.123:0/1926503805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad66cdc0 msgr2=0x563fad6b7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:51.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/1926503805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad66cdc0 0x563fad6b7dd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa434013000 tx=0x7fa43400e000 comp rx=0 tx=0).stop 2023-03-08T15:49:51.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa452f0cb80 1 -- 172.21.15.123:0/1926503805 shutdown_connections 2023-03-08T15:49:51.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/1926503805 >> [v2:172.21.15.175:6832/1018957090,v1:172.21.15.175:6833/1018957090] conn(0x563fad6b76c0 0x563fad6b6160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/1926503805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fad69a7b0 0x563fad7094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/1926503805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563fad66cdc0 0x563fad6b7dd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa41f7fe700 0 client.4599 ms_handle_reset on v2:172.21.15.175:6832/1018957090 2023-03-08T15:49:51.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa452f0cb80 1 --2- 172.21.15.123:0/1926503805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x563fad671610 0x563fad708f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa452f0cb80 1 -- 172.21.15.123:0/1926503805 >> 172.21.15.123:0/1926503805 conn(0x563fad667290 msgr2=0x563fad69c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:51.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa452f0cb80 1 -- 172.21.15.123:0/1926503805 shutdown_connections 2023-03-08T15:49:51.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa452f0cb80 1 -- 172.21.15.123:0/1926503805 wait complete. 2023-03-08T15:49:51.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa452f0cb80 20 client.4599 trim_cache size 0 max 16384 2023-03-08T15:49:51.478 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2023-03-08T15:49:51.478 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "1b15c317-0b05-4434-b72b-9beacb9cbd31", 2023-03-08T15:49:51.479 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2023-03-08T15:49:51.479 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4294, 2023-03-08T15:49:51.479 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2023-03-08T15:49:51.479 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2023-03-08T15:49:51.479 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2023-03-08T15:49:51.479 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 11.975494713, 2023-03-08T15:49:51.479 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 8, 2023-03-08T15:49:51.479 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 23, 2023-03-08T15:49:51.480 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 23, 2023-03-08T15:49:51.480 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 17.321058807 2023-03-08T15:49:51.480 INFO:teuthology.orchestra.run.smithi123.stdout:} 2023-03-08T15:49:51.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa446d73700 1 -- 172.21.15.123:0/1635898460 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4240698d0 msgr2=0x7fa42406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:51.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa446d73700 1 --2- 172.21.15.123:0/1635898460 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4240698d0 0x7fa42406bd80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa434009c40 tx=0x7fa434008030 comp rx=0 tx=0).stop 2023-03-08T15:49:51.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa446d73700 1 -- 172.21.15.123:0/1635898460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400b8320 msgr2=0x7fa44006f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:51.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa446d73700 1 --2- 172.21.15.123:0/1635898460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400b8320 0x7fa44006f940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa43800cb60 tx=0x7fa43800cc40 comp rx=0 tx=0).stop 2023-03-08T15:49:51.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa446d73700 1 -- 172.21.15.123:0/1635898460 shutdown_connections 2023-03-08T15:49:51.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa446d73700 1 --2- 172.21.15.123:0/1635898460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4400b8320 0x7fa44006f940 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa446d73700 1 --2- 172.21.15.123:0/1635898460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa44006aee0 0x7fa440070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa446d73700 1 --2- 172.21.15.123:0/1635898460 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4240698d0 0x7fa42406bd80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa446d73700 1 --2- 172.21.15.123:0/1635898460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4400b7900 0x7fa440135c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa446d73700 1 -- 172.21.15.123:0/1635898460 >> 172.21.15.123:0/1635898460 conn(0x7fa4400bc480 msgr2=0x7fa4400b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:51.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa446d73700 1 -- 172.21.15.123:0/1635898460 shutdown_connections 2023-03-08T15:49:51.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.466+0000 7fa446d73700 1 -- 172.21.15.123:0/1635898460 wait complete. 2023-03-08T15:49:51.483 INFO:teuthology.run_tasks:Running task kclient... 2023-03-08T15:49:51.506 INFO:tasks.kclient:Mounting kernel clients... 2023-03-08T15:49:51.506 INFO:tasks.kclient:config is {'client.0': {}} 2023-03-08T15:49:51.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:51.507 DEBUG:teuthology.orchestra.run.smithi182:> ip netns list 2023-03-08T15:49:51.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:51.580 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link delete ceph-brx 2023-03-08T15:49:51.685 INFO:teuthology.orchestra.run.smithi182.stderr:Cannot find device "ceph-brx" 2023-03-08T15:49:51.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-08T15:49:51.690 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-03-08T15:49:51.690 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-08T15:49:51.690 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-08T15:49:51.691 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-08T15:49:51.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.810+0000 7f56d4bff700 1 Processor -- start 2023-03-08T15:49:51.812 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.810+0000 7f56d4bff700 1 -- start start 2023-03-08T15:49:51.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.811+0000 7f56d4bff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56d00bdf70 0x7f56d006ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.811+0000 7f56d4bff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f56d014dd70 0x7f56d0144870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.811+0000 7f56d4bff700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d014a870 con 0x7f56d014ad00 2023-03-08T15:49:51.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.811+0000 7f56d4bff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d0070760 con 0x7f56d00bdf70 2023-03-08T15:49:51.814 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.811+0000 7f56d4bff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d014e530 con 0x7f56d014dd70 2023-03-08T15:49:51.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.811+0000 7f56ce59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56d00bdf70 0x7f56d006ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.811+0000 7f56ce59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56d00bdf70 0x7f56d006ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37042/0 (socket says 172.21.15.123:37042) 2023-03-08T15:49:51.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.811+0000 7f56ce59c700 1 -- 172.21.15.123:0/1817324217 learned_addr learned my addr 172.21.15.123:0/1817324217 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:51.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.811+0000 7f56cdd9b700 1 --2- 172.21.15.123:0/1817324217 >> v2:172.21.15.175:3300/0 conn(0x7f56d014dd70 0x7f56d0144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.811+0000 7f56ce59c700 1 -- 172.21.15.123:0/1817324217 >> v2:172.21.15.175:3300/0 conn(0x7f56d014dd70 msgr2=0x7f56d0144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:51.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.812+0000 7f56ce59c700 1 --2- 172.21.15.123:0/1817324217 >> v2:172.21.15.175:3300/0 conn(0x7f56d014dd70 0x7f56d0144870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.812+0000 7f56ce59c700 1 -- 172.21.15.123:0/1817324217 >> v1:172.21.15.175:6789/0 conn(0x7f56d014ad00 legacy=0x7f56d014b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:51.815 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.812+0000 7f56ce59c700 1 -- 172.21.15.123:0/1817324217 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d014e810 con 0x7f56d00bdf70 2023-03-08T15:49:51.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.812+0000 7f56ce59c700 1 --2- 172.21.15.123:0/1817324217 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56d00bdf70 0x7f56d006ff30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f56d00709d0 tx=0x7f56c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309465fb7b15e254 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:51.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.812+0000 7f56cd59a700 1 -- 172.21.15.123:0/1817324217 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4011830 con 0x7f56d00bdf70 2023-03-08T15:49:51.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.812+0000 7f56cd59a700 1 -- 172.21.15.123:0/1817324217 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c4011990 con 0x7f56d00bdf70 2023-03-08T15:49:51.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.812+0000 7f56cd59a700 1 -- 172.21.15.123:0/1817324217 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4011d20 con 0x7f56d00bdf70 2023-03-08T15:49:51.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.812+0000 7f56d4bff700 1 -- 172.21.15.123:0/1817324217 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56d00bdf70 msgr2=0x7f56d006ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:51.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.812+0000 7f56d4bff700 1 --2- 172.21.15.123:0/1817324217 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56d00bdf70 0x7f56d006ff30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f56d00709d0 tx=0x7f56c4009bd0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.816 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.812+0000 7f56d4bff700 1 -- 172.21.15.123:0/1817324217 shutdown_connections 2023-03-08T15:49:51.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.812+0000 7f56d4bff700 1 --2- 172.21.15.123:0/1817324217 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56d00bdf70 0x7f56d006ff30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.812+0000 7f56d4bff700 1 --2- 172.21.15.123:0/1817324217 >> v2:172.21.15.175:3300/0 conn(0x7f56d014dd70 0x7f56d0144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.812+0000 7f56d4bff700 1 -- 172.21.15.123:0/1817324217 >> 172.21.15.123:0/1817324217 conn(0x7f56d006e170 msgr2=0x7f56d00bd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:51.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.812+0000 7f56d4bff700 1 -- 172.21.15.123:0/1817324217 shutdown_connections 2023-03-08T15:49:51.817 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.812+0000 7f56d4bff700 1 -- 172.21.15.123:0/1817324217 wait complete. 2023-03-08T15:49:51.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.814+0000 7f56d4bff700 1 Processor -- start 2023-03-08T15:49:51.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.814+0000 7f56d4bff700 1 -- start start 2023-03-08T15:49:51.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.814+0000 7f56d4bff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56d00bdf70 0x7f56d0143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.814+0000 7f56d4bff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56d014ad00 0x7f56d014cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.814+0000 7f56d4bff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56d014dd70 0x7f56d01363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.814+0000 7f56d4bff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d0143340 con 0x7f56d014dd70 2023-03-08T15:49:51.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.814+0000 7f56d4bff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d01e0640 con 0x7f56d014ad00 2023-03-08T15:49:51.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.814+0000 7f56d4bff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d01e08e0 con 0x7f56d00bdf70 2023-03-08T15:49:51.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.814+0000 7f56ced9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56d014dd70 0x7f56d01363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.814+0000 7f56ced9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56d014dd70 0x7f56d01363d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37050/0 (socket says 172.21.15.123:37050) 2023-03-08T15:49:51.821 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.814+0000 7f56ced9d700 1 -- 172.21.15.123:0/527531865 learned_addr learned my addr 172.21.15.123:0/527531865 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:51.821 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.814+0000 7f56cdd9b700 1 --2- 172.21.15.123:0/527531865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56d014ad00 0x7f56d014cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.821 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.814+0000 7f56ce59c700 1 --2- 172.21.15.123:0/527531865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56d00bdf70 0x7f56d0143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.821 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.815+0000 7f56ced9d700 1 -- 172.21.15.123:0/527531865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56d00bdf70 msgr2=0x7f56d0143c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:51.821 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.815+0000 7f56ced9d700 1 --2- 172.21.15.123:0/527531865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56d00bdf70 0x7f56d0143c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.821 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.815+0000 7f56ced9d700 1 -- 172.21.15.123:0/527531865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56d014ad00 msgr2=0x7f56d014cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:51.821 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.815+0000 7f56ced9d700 1 --2- 172.21.15.123:0/527531865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56d014ad00 0x7f56d014cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:51.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.815+0000 7f56ced9d700 1 -- 172.21.15.123:0/527531865 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c4009550 con 0x7f56d014dd70 2023-03-08T15:49:51.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.815+0000 7f56ced9d700 1 --2- 172.21.15.123:0/527531865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56d014dd70 0x7f56d01363d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f56c800cc50 tx=0x7f56c800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:51.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.815+0000 7f56beffd700 1 -- 172.21.15.123:0/527531865 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8003c00 con 0x7f56d014dd70 2023-03-08T15:49:51.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.815+0000 7f56beffd700 1 -- 172.21.15.123:0/527531865 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c8003d60 con 0x7f56d014dd70 2023-03-08T15:49:51.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.815+0000 7f56beffd700 1 -- 172.21.15.123:0/527531865 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c800aab0 con 0x7f56d014dd70 2023-03-08T15:49:51.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.815+0000 7f56d4bff700 1 -- 172.21.15.123:0/527531865 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d014e1a0 con 0x7f56d014dd70 2023-03-08T15:49:51.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.815+0000 7f56d4bff700 1 -- 172.21.15.123:0/527531865 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d014eaf0 con 0x7f56d014dd70 2023-03-08T15:49:51.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.816+0000 7f56d4bff700 1 -- 172.21.15.123:0/527531865 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d00be340 con 0x7f56d014dd70 2023-03-08T15:49:51.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.816+0000 7f56beffd700 1 -- 172.21.15.123:0/527531865 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f56c8010050 con 0x7f56d014dd70 2023-03-08T15:49:51.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.817+0000 7f56beffd700 1 --2- 172.21.15.123:0/527531865 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f56b00698d0 0x7f56b006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:51.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.817+0000 7f56beffd700 1 -- 172.21.15.123:0/527531865 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f56c8087440 con 0x7f56d014dd70 2023-03-08T15:49:51.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.817+0000 7f56ce59c700 1 --2- 172.21.15.123:0/527531865 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f56b00698d0 0x7f56b006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:51.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.817+0000 7f56ce59c700 1 --2- 172.21.15.123:0/527531865 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f56b00698d0 0x7f56b006bd80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009c10 tx=0x7f56c4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:51.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:51.821+0000 7f56beffd700 1 -- 172.21.15.123:0/527531865 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f56c8053210 con 0x7f56d014dd70 2023-03-08T15:49:52.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:52.051+0000 7f56d4bff700 1 -- 172.21.15.123:0/527531865 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f56d00744c0 con 0x7f56d014dd70 2023-03-08T15:49:52.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:52.052+0000 7f56beffd700 1 -- 172.21.15.123:0/527531865 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f56c8056830 con 0x7f56d014dd70 2023-03-08T15:49:52.053 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-08T15:49:52.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:52.054+0000 7f56d4bff700 1 -- 172.21.15.123:0/527531865 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f56b00698d0 msgr2=0x7f56b006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:52.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:52.054+0000 7f56d4bff700 1 --2- 172.21.15.123:0/527531865 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f56b00698d0 0x7f56b006bd80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009c10 tx=0x7f56c4008030 comp rx=0 tx=0).stop 2023-03-08T15:49:52.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:52.054+0000 7f56d4bff700 1 -- 172.21.15.123:0/527531865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56d014dd70 msgr2=0x7f56d01363d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:52.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:52.054+0000 7f56d4bff700 1 --2- 172.21.15.123:0/527531865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56d014dd70 0x7f56d01363d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f56c800cc50 tx=0x7f56c800cf60 comp rx=0 tx=0).stop 2023-03-08T15:49:52.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:52.054+0000 7f56d4bff700 1 -- 172.21.15.123:0/527531865 shutdown_connections 2023-03-08T15:49:52.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:52.054+0000 7f56d4bff700 1 --2- 172.21.15.123:0/527531865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56d014dd70 0x7f56d01363d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:52.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:52.054+0000 7f56d4bff700 1 --2- 172.21.15.123:0/527531865 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f56b00698d0 0x7f56b006bd80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:52.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:52.054+0000 7f56d4bff700 1 --2- 172.21.15.123:0/527531865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56d00bdf70 0x7f56d0143c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:52.057 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:52.054+0000 7f56d4bff700 1 --2- 172.21.15.123:0/527531865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56d014ad00 0x7f56d014cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:52.057 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:52.054+0000 7f56d4bff700 1 -- 172.21.15.123:0/527531865 >> 172.21.15.123:0/527531865 conn(0x7f56d006e170 msgr2=0x7f56d0072080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:52.057 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:52.054+0000 7f56d4bff700 1 -- 172.21.15.123:0/527531865 shutdown_connections 2023-03-08T15:49:52.057 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:52.054+0000 7f56d4bff700 1 -- 172.21.15.123:0/527531865 wait complete. 2023-03-08T15:49:52.067 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-08T15:49:52.067 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-08T15:49:52.067 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi182.front.sepia.ceph.com 2023-03-08T15:49:52.068 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-08T15:49:52.068 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-08T15:49:52.068 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-08T15:49:52.068 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-08T15:49:52.068 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-08T15:49:52.069 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-08T15:49:52.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:52.069 DEBUG:teuthology.orchestra.run.smithi182:> ip addr 2023-03-08T15:49:52.138 INFO:teuthology.orchestra.run.smithi182.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-08T15:49:52.138 INFO:teuthology.orchestra.run.smithi182.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-08T15:49:52.138 INFO:teuthology.orchestra.run.smithi182.stdout: inet 127.0.0.1/8 scope host lo 2023-03-08T15:49:52.139 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-03-08T15:49:52.139 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 ::1/128 scope host 2023-03-08T15:49:52.139 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-03-08T15:49:52.139 INFO:teuthology.orchestra.run.smithi182.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-08T15:49:52.139 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:d9:19:46 brd ff:ff:ff:ff:ff:ff 2023-03-08T15:49:52.139 INFO:teuthology.orchestra.run.smithi182.stdout: altname enp7s0f0 2023-03-08T15:49:52.139 INFO:teuthology.orchestra.run.smithi182.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-08T15:49:52.139 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:d9:19:47 brd ff:ff:ff:ff:ff:ff 2023-03-08T15:49:52.140 INFO:teuthology.orchestra.run.smithi182.stdout: altname enp7s0f1 2023-03-08T15:49:52.140 INFO:teuthology.orchestra.run.smithi182.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-08T15:49:52.140 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:88:77:8c brd ff:ff:ff:ff:ff:ff 2023-03-08T15:49:52.140 INFO:teuthology.orchestra.run.smithi182.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-08T15:49:52.140 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:88:77:8d brd ff:ff:ff:ff:ff:ff 2023-03-08T15:49:52.140 INFO:teuthology.orchestra.run.smithi182.stdout: inet 172.21.15.182/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-03-08T15:49:52.140 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft 42199sec preferred_lft 42199sec 2023-03-08T15:49:52.141 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 fe80::ec4:7aff:fe88:778d/64 scope link 2023-03-08T15:49:52.141 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-03-08T15:49:52.142 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-03-08T15:49:52.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:52.142 DEBUG:teuthology.orchestra.run.smithi182:> (cd / && exec bash -c ' 2023-03-08T15:49:52.143 DEBUG:teuthology.orchestra.run.smithi182:> set -e 2023-03-08T15:49:52.143 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link add name ceph-brx type bridge 2023-03-08T15:49:52.143 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip addr flush dev ceph-brx 2023-03-08T15:49:52.143 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link set ceph-brx up 2023-03-08T15:49:52.143 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-03-08T15:49:52.144 DEBUG:teuthology.orchestra.run.smithi182:> ') 2023-03-08T15:49:52.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:52.670 DEBUG:teuthology.orchestra.run.smithi182:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-08T15:49:52.819 INFO:teuthology.orchestra.run.smithi182.stdout:1 2023-03-08T15:49:52.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:52.824 DEBUG:teuthology.orchestra.run.smithi182:> route 2023-03-08T15:49:52.907 INFO:teuthology.orchestra.run.smithi182.stdout:Kernel IP routing table 2023-03-08T15:49:52.907 INFO:teuthology.orchestra.run.smithi182.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-08T15:49:52.907 INFO:teuthology.orchestra.run.smithi182.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-08T15:49:52.908 INFO:teuthology.orchestra.run.smithi182.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-03-08T15:49:52.908 INFO:teuthology.orchestra.run.smithi182.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-08T15:49:52.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:52.909 DEBUG:teuthology.orchestra.run.smithi182:> (cd / && exec bash -c ' 2023-03-08T15:49:52.910 DEBUG:teuthology.orchestra.run.smithi182:> set -e 2023-03-08T15:49:52.910 DEBUG:teuthology.orchestra.run.smithi182:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-08T15:49:52.910 DEBUG:teuthology.orchestra.run.smithi182:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-08T15:49:52.910 DEBUG:teuthology.orchestra.run.smithi182:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-08T15:49:52.910 DEBUG:teuthology.orchestra.run.smithi182:> ') 2023-03-08T15:49:53.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:53.701 DEBUG:teuthology.orchestra.run.smithi182:> ip netns list 2023-03-08T15:49:53.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:53.770 DEBUG:teuthology.orchestra.run.smithi182:> ip netns list-id 2023-03-08T15:49:53.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:53.839 DEBUG:teuthology.orchestra.run.smithi182:> (cd / && exec bash -c ' 2023-03-08T15:49:53.839 DEBUG:teuthology.orchestra.run.smithi182:> set -e 2023-03-08T15:49:53.840 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-08T15:49:53.840 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-03-08T15:49:53.840 DEBUG:teuthology.orchestra.run.smithi182:> ') 2023-03-08T15:49:54.042 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-03-08T15:49:54.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:54.043 DEBUG:teuthology.orchestra.run.smithi182:> (cd / && exec bash -c ' 2023-03-08T15:49:54.043 DEBUG:teuthology.orchestra.run.smithi182:> set -e 2023-03-08T15:49:54.043 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-03-08T15:49:54.043 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-03-08T15:49:54.044 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-03-08T15:49:54.044 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-03-08T15:49:54.044 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-03-08T15:49:54.044 DEBUG:teuthology.orchestra.run.smithi182:> ') 2023-03-08T15:49:54.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:54.411 DEBUG:teuthology.orchestra.run.smithi182:> (cd / && exec bash -c ' 2023-03-08T15:49:54.411 DEBUG:teuthology.orchestra.run.smithi182:> set -e 2023-03-08T15:49:54.411 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link set brx.0 up 2023-03-08T15:49:54.412 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link set dev brx.0 master ceph-brx 2023-03-08T15:49:54.412 DEBUG:teuthology.orchestra.run.smithi182:> ') 2023-03-08T15:49:54.644 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-08T15:49:54.644 DEBUG:teuthology.orchestra.run.smithi182:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-03-08T15:49:54.719 INFO:teuthology.orchestra.run.smithi182.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-03-08T15:49:54.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-08T15:49:54.721 DEBUG:teuthology.orchestra.run.smithi182:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-03-08T15:49:54.790 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-03-08T15:49:54.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:54.791 DEBUG:teuthology.orchestra.run.smithi182:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-08T15:49:54.935 INFO:teuthology.orchestra.run.smithi182.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-08T15:49:54.936 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-08T15:49:54.936 INFO:teuthology.orchestra.run.smithi182.stdout:invalid new device string format 2023-03-08T15:49:55.440 INFO:teuthology.orchestra.run.smithi182.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-08T15:49:55.440 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-08T15:49:55.440 INFO:teuthology.orchestra.run.smithi182.stdout:invalid new device string format 2023-03-08T15:49:55.441 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.175:3300,172.21.15.175:3301" 2023-03-08T15:49:55.441 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-08T15:49:55.467 INFO:teuthology.orchestra.run.smithi182.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-08T15:49:55.468 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-08T15:49:55.468 INFO:teuthology.orchestra.run.smithi182.stdout:invalid new device string format 2023-03-08T15:49:55.468 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.175:3300,172.21.15.175:3301" 2023-03-08T15:49:55.468 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-08T15:49:55.468 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.175:6789,172.21.15.175:6790" 2023-03-08T15:49:55.468 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.175:6789,172.21.15.175:6790:/ 2023-03-08T15:49:55.468 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1b15c317-0b05-4434-b72b-9beacb9cbd31" will pass to kernel 2023-03-08T15:49:55.478 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-08T15:49:55.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:55.479 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-03-08T15:49:55.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:55.579 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-08T15:49:55.737 INFO:teuthology.orchestra.run.smithi182.stdout:client4475 2023-03-08T15:49:55.737 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:49:55.738 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-08T15:49:55.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:55.804 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-08T15:49:55.952 INFO:teuthology.orchestra.run.smithi182.stdout:client4475 2023-03-08T15:49:55.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:55.953 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-08T15:49:56.104 INFO:teuthology.orchestra.run.smithi182.stdout:client4475 2023-03-08T15:49:56.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:49:56.104 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/1b15c317-0b05-4434-b72b-9beacb9cbd31.client4475/status') 2023-03-08T15:49:56.278 INFO:teuthology.orchestra.run.smithi182.stdout:instance: client.4475 (3)172.21.15.182:0/3734992505 2023-03-08T15:49:56.278 INFO:teuthology.orchestra.run.smithi182.stdout:blocklisted: false 2023-03-08T15:49:56.279 INFO:teuthology.orchestra.run.smithi182.stderr:0+1 records in 2023-03-08T15:49:56.279 INFO:teuthology.orchestra.run.smithi182.stderr:0+1 records out 2023-03-08T15:49:56.279 INFO:teuthology.orchestra.run.smithi182.stderr:71 bytes copied, 7.1901e-05 s, 987 kB/s 2023-03-08T15:49:56.283 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-03-08T15:49:56.300 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:49:56.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.438+0000 7efc6b0a1700 1 Processor -- start 2023-03-08T15:49:56.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.438+0000 7efc6b0a1700 1 -- start start 2023-03-08T15:49:56.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.438+0000 7efc6b0a1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efc640b6a00 0x7efc6406b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:56.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.438+0000 7efc6b0a1700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc640bd420 con 0x7efc640b3c50 2023-03-08T15:49:56.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.438+0000 7efc6b0a1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc64071cd0 con 0x7efc64149080 2023-03-08T15:49:56.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.438+0000 7efc6b0a1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc64142cc0 con 0x7efc640b6a00 2023-03-08T15:49:56.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.439+0000 7efc68e3d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efc640b6a00 0x7efc6406b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:56.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.439+0000 7efc63fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7efc640b3c50 0x7efc64148970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42352/0 (socket says 172.21.15.123:42352) 2023-03-08T15:49:56.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.439+0000 7efc63fff700 1 -- 172.21.15.123:0/1341680549 learned_addr learned my addr 172.21.15.123:0/1341680549 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:56.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.439+0000 7efc68e3d700 1 -- 172.21.15.123:0/1341680549 >> v1:172.21.15.175:6789/0 conn(0x7efc64149080 legacy=0x7efc64152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:56.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.439+0000 7efc68e3d700 1 -- 172.21.15.123:0/1341680549 >> v1:172.21.15.123:6789/0 conn(0x7efc640b3c50 legacy=0x7efc64148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:56.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.439+0000 7efc68e3d700 1 -- 172.21.15.123:0/1341680549 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc640bd670 con 0x7efc640b6a00 2023-03-08T15:49:56.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.439+0000 7efc637fe700 1 -- 172.21.15.123:0/1341680549 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582303397 0 0) 0x7efc640bd420 con 0x7efc640b3c50 2023-03-08T15:49:56.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.439+0000 7efc68e3d700 1 --2- 172.21.15.123:0/1341680549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc640b6a00 0x7efc6406b260 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efc58009840 tx=0x7efc58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b37b3d15f27c80 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:56.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.439+0000 7efc637fe700 1 -- 172.21.15.123:0/1341680549 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58004230 con 0x7efc640b6a00 2023-03-08T15:49:56.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.439+0000 7efc637fe700 1 -- 172.21.15.123:0/1341680549 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc58004390 con 0x7efc640b6a00 2023-03-08T15:49:56.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.439+0000 7efc637fe700 1 -- 172.21.15.123:0/1341680549 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc580036a0 con 0x7efc640b6a00 2023-03-08T15:49:56.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.440+0000 7efc6b0a1700 1 -- 172.21.15.123:0/1341680549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc640b6a00 msgr2=0x7efc6406b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:56.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.440+0000 7efc6b0a1700 1 --2- 172.21.15.123:0/1341680549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc640b6a00 0x7efc6406b260 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efc58009840 tx=0x7efc58009b50 comp rx=0 tx=0).stop 2023-03-08T15:49:56.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.440+0000 7efc6b0a1700 1 -- 172.21.15.123:0/1341680549 shutdown_connections 2023-03-08T15:49:56.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.440+0000 7efc6b0a1700 1 --2- 172.21.15.123:0/1341680549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc640b6a00 0x7efc6406b260 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.440+0000 7efc6b0a1700 1 -- 172.21.15.123:0/1341680549 >> 172.21.15.123:0/1341680549 conn(0x7efc640ba3c0 msgr2=0x7efc640bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:56.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.440+0000 7efc6b0a1700 1 -- 172.21.15.123:0/1341680549 shutdown_connections 2023-03-08T15:49:56.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.440+0000 7efc6b0a1700 1 -- 172.21.15.123:0/1341680549 wait complete. 2023-03-08T15:49:56.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.441+0000 7efc6b0a1700 1 Processor -- start 2023-03-08T15:49:56.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.441+0000 7efc6b0a1700 1 -- start start 2023-03-08T15:49:56.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc6b0a1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc640b3c50 0x7efc640bc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:56.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc6b0a1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc640b6a00 0x7efc641dfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:56.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc6b0a1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc64149080 0x7efc641e00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:56.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc6b0a1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc640bba10 con 0x7efc640b3c50 2023-03-08T15:49:56.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc6b0a1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc64143d20 con 0x7efc640b6a00 2023-03-08T15:49:56.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc6b0a1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc640bb3c0 con 0x7efc64149080 2023-03-08T15:49:56.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc68e3d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc640b3c50 0x7efc640bc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:56.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc68e3d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc640b3c50 0x7efc640bc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41678/0 (socket says 172.21.15.123:41678) 2023-03-08T15:49:56.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc68e3d700 1 -- 172.21.15.123:0/2971621553 learned_addr learned my addr 172.21.15.123:0/2971621553 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:56.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc63fff700 1 --2- 172.21.15.123:0/2971621553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc640b6a00 0x7efc641dfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:56.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc6963e700 1 --2- 172.21.15.123:0/2971621553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc64149080 0x7efc641e00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:56.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc68e3d700 1 -- 172.21.15.123:0/2971621553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc64149080 msgr2=0x7efc641e00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:56.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc68e3d700 1 --2- 172.21.15.123:0/2971621553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc64149080 0x7efc641e00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc68e3d700 1 -- 172.21.15.123:0/2971621553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc640b6a00 msgr2=0x7efc641dfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:56.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc68e3d700 1 --2- 172.21.15.123:0/2971621553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc640b6a00 0x7efc641dfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc68e3d700 1 -- 172.21.15.123:0/2971621553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc580094a0 con 0x7efc640b3c50 2023-03-08T15:49:56.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc68e3d700 1 --2- 172.21.15.123:0/2971621553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc640b3c50 0x7efc640bc4c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efc580090b0 tx=0x7efc58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:56.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc617fa700 1 -- 172.21.15.123:0/2971621553 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58011830 con 0x7efc640b3c50 2023-03-08T15:49:56.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc617fa700 1 -- 172.21.15.123:0/2971621553 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5801e070 con 0x7efc640b3c50 2023-03-08T15:49:56.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc6b0a1700 1 -- 172.21.15.123:0/2971621553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc640bda00 con 0x7efc640b3c50 2023-03-08T15:49:56.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc617fa700 1 -- 172.21.15.123:0/2971621553 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58011bb0 con 0x7efc640b3c50 2023-03-08T15:49:56.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.442+0000 7efc6b0a1700 1 -- 172.21.15.123:0/2971621553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc64071f20 con 0x7efc640b3c50 2023-03-08T15:49:56.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.443+0000 7efc6b0a1700 1 -- 172.21.15.123:0/2971621553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc640b7090 con 0x7efc640b3c50 2023-03-08T15:49:56.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.444+0000 7efc617fa700 1 -- 172.21.15.123:0/2971621553 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7efc58017020 con 0x7efc640b3c50 2023-03-08T15:49:56.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.444+0000 7efc617fa700 1 --2- 172.21.15.123:0/2971621553 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7efc48069900 0x7efc4806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:56.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.444+0000 7efc63fff700 1 --2- 172.21.15.123:0/2971621553 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7efc48069900 0x7efc4806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:56.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.444+0000 7efc617fa700 1 -- 172.21.15.123:0/2971621553 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc58088970 con 0x7efc640b3c50 2023-03-08T15:49:56.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.445+0000 7efc63fff700 1 --2- 172.21.15.123:0/2971621553 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7efc48069900 0x7efc4806bdb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efc64146490 tx=0x7efc50007be0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:56.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.449+0000 7efc617fa700 1 -- 172.21.15.123:0/2971621553 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7efc58054740 con 0x7efc640b3c50 2023-03-08T15:49:56.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.635+0000 7efc6b0a1700 1 -- 172.21.15.123:0/2971621553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc640744c0 con 0x7efc640b3c50 2023-03-08T15:49:56.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.636+0000 7efc617fa700 1 -- 172.21.15.123:0/2971621553 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17955 (secure 0 0 0) 0x7efc58020020 con 0x7efc640b3c50 2023-03-08T15:49:56.638 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:56.638 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:40.490671+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:49:37.104720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-08T15:49:38.431537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:49:56.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.639+0000 7efc6b0a1700 1 -- 172.21.15.123:0/2971621553 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7efc48069900 msgr2=0x7efc4806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:56.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.639+0000 7efc6b0a1700 1 --2- 172.21.15.123:0/2971621553 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7efc48069900 0x7efc4806bdb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efc64146490 tx=0x7efc50007be0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.639+0000 7efc6b0a1700 1 -- 172.21.15.123:0/2971621553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc640b3c50 msgr2=0x7efc640bc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:56.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.639+0000 7efc6b0a1700 1 --2- 172.21.15.123:0/2971621553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc640b3c50 0x7efc640bc4c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efc580090b0 tx=0x7efc58004750 comp rx=0 tx=0).stop 2023-03-08T15:49:56.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.639+0000 7efc6b0a1700 1 -- 172.21.15.123:0/2971621553 shutdown_connections 2023-03-08T15:49:56.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.639+0000 7efc6b0a1700 1 --2- 172.21.15.123:0/2971621553 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7efc48069900 0x7efc4806bdb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.639+0000 7efc6b0a1700 1 --2- 172.21.15.123:0/2971621553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc64149080 0x7efc641e00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.639+0000 7efc6b0a1700 1 --2- 172.21.15.123:0/2971621553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc640b3c50 0x7efc640bc4c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.639+0000 7efc6b0a1700 1 --2- 172.21.15.123:0/2971621553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc640b6a00 0x7efc641dfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.639+0000 7efc6b0a1700 1 -- 172.21.15.123:0/2971621553 >> 172.21.15.123:0/2971621553 conn(0x7efc640ba3c0 msgr2=0x7efc641466e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:56.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.639+0000 7efc6b0a1700 1 -- 172.21.15.123:0/2971621553 shutdown_connections 2023-03-08T15:49:56.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.639+0000 7efc6b0a1700 1 -- 172.21.15.123:0/2971621553 wait complete. 2023-03-08T15:49:56.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-08T15:49:26.011228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-08T15:49:32.528343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-08T15:49:37.104720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-08T15:49:38.431537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-08T15:49:56.653 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-08T15:49:56.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.773+0000 7f95b8736700 1 Processor -- start 2023-03-08T15:49:56.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.773+0000 7f95b8736700 1 -- start start 2023-03-08T15:49:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.774+0000 7f95b8736700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f95b0144a90 0x7f95b00bd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.774+0000 7f95b8736700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b00b7fa0 con 0x7f95b01446c0 2023-03-08T15:49:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.774+0000 7f95b8736700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b00bc030 con 0x7f95b00ba560 2023-03-08T15:49:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.774+0000 7f95b8736700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b00bc310 con 0x7f95b0144a90 2023-03-08T15:49:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.774+0000 7f95b64d2700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f95b01446c0 0x7f95b00b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42354/0 (socket says 172.21.15.123:42354) 2023-03-08T15:49:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.774+0000 7f95b64d2700 1 -- 172.21.15.123:0/1474557008 learned_addr learned my addr 172.21.15.123:0/1474557008 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.774+0000 7f95b54d0700 1 -- 172.21.15.123:0/1474557008 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423908817 0 0) 0x7f95b00b7fa0 con 0x7f95b01446c0 2023-03-08T15:49:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.774+0000 7f95b5cd1700 1 --2- 172.21.15.123:0/1474557008 >> v2:172.21.15.175:3300/0 conn(0x7f95b0144a90 0x7f95b00bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.774+0000 7f95b54d0700 1 -- 172.21.15.123:0/1474557008 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f959c0035b0 con 0x7f95b01446c0 2023-03-08T15:49:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 -- 172.21.15.123:0/1474557008 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1007051563 0 0) 0x7f959c0035b0 con 0x7f95b01446c0 2023-03-08T15:49:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 -- 172.21.15.123:0/1474557008 >> v2:172.21.15.175:3300/0 conn(0x7f95b0144a90 msgr2=0x7f95b00bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 --2- 172.21.15.123:0/1474557008 >> v2:172.21.15.175:3300/0 conn(0x7f95b0144a90 0x7f95b00bd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 -- 172.21.15.123:0/1474557008 >> v1:172.21.15.175:6789/0 conn(0x7f95b00ba560 legacy=0x7f95b0154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 -- 172.21.15.123:0/1474557008 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b00bc5f0 con 0x7f95b01446c0 2023-03-08T15:49:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 -- 172.21.15.123:0/1474557008 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f95a0001670 con 0x7f95b01446c0 2023-03-08T15:49:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 -- 172.21.15.123:0/1474557008 >> v1:172.21.15.123:6789/0 conn(0x7f95b01446c0 legacy=0x7f95b00b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 --2- 172.21.15.123:0/1474557008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c003a00 0x7f959c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 --2- 172.21.15.123:0/1474557008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f959c004850 0x7f959c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 --2- 172.21.15.123:0/1474557008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f959c005200 0x7f959c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 -- 172.21.15.123:0/1474557008 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00bc310 con 0x7f959c005200 2023-03-08T15:49:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 -- 172.21.15.123:0/1474557008 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c00c190 con 0x7f959c003a00 2023-03-08T15:49:56.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 -- 172.21.15.123:0/1474557008 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c00c350 con 0x7f959c004850 2023-03-08T15:49:56.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b6cd3700 1 --2- 172.21.15.123:0/1474557008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f959c005200 0x7f959c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:56.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b64d2700 1 --2- 172.21.15.123:0/1474557008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c003a00 0x7f959c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:56.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b5cd1700 1 --2- 172.21.15.123:0/1474557008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f959c004850 0x7f959c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:56.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b6cd3700 1 -- 172.21.15.123:0/1474557008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f959c004850 msgr2=0x7f959c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:56.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b6cd3700 1 --2- 172.21.15.123:0/1474557008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f959c004850 0x7f959c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b6cd3700 1 -- 172.21.15.123:0/1474557008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c003a00 msgr2=0x7f959c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:56.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b6cd3700 1 --2- 172.21.15.123:0/1474557008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c003a00 0x7f959c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b6cd3700 1 -- 172.21.15.123:0/1474557008 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c0035b0 con 0x7f959c005200 2023-03-08T15:49:56.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b6cd3700 1 -- 172.21.15.123:0/1474557008 reap_dead start 2023-03-08T15:49:56.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b6cd3700 1 --2- 172.21.15.123:0/1474557008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f959c005200 0x7f959c00ba10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f95a800c160 tx=0x7f959c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15b1fefe5b1ce7d server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:56.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 -- 172.21.15.123:0/1474557008 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8001db0 con 0x7f959c005200 2023-03-08T15:49:56.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 -- 172.21.15.123:0/1474557008 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a800cca0 con 0x7f959c005200 2023-03-08T15:49:56.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.775+0000 7f95b54d0700 1 -- 172.21.15.123:0/1474557008 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8003c20 con 0x7f959c005200 2023-03-08T15:49:56.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.776+0000 7f95b8736700 1 -- 172.21.15.123:0/1474557008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f959c005200 msgr2=0x7f959c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:56.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.776+0000 7f95b8736700 1 --2- 172.21.15.123:0/1474557008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f959c005200 0x7f959c00ba10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f95a800c160 tx=0x7f959c005880 comp rx=0 tx=0).stop 2023-03-08T15:49:56.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.776+0000 7f95b8736700 1 -- 172.21.15.123:0/1474557008 shutdown_connections 2023-03-08T15:49:56.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.776+0000 7f95b8736700 1 --2- 172.21.15.123:0/1474557008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f959c005200 0x7f959c00ba10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.776+0000 7f95b8736700 1 -- 172.21.15.123:0/1474557008 >> 172.21.15.123:0/1474557008 conn(0x7f95b0071980 msgr2=0x7f95b0071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:56.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.776+0000 7f95b8736700 1 -- 172.21.15.123:0/1474557008 shutdown_connections 2023-03-08T15:49:56.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.776+0000 7f95b8736700 1 -- 172.21.15.123:0/1474557008 wait complete. 2023-03-08T15:49:56.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.777+0000 7f95b8736700 1 Processor -- start 2023-03-08T15:49:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.777+0000 7f95b8736700 1 -- start start 2023-03-08T15:49:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b8736700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c005200 0x7f95b013fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b8736700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95b0140680 0x7f95b01399b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b8736700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95b0140af0 0x7f95b0139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b8736700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b01402b0 con 0x7f95b0140680 2023-03-08T15:49:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b8736700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b014cb50 con 0x7f959c005200 2023-03-08T15:49:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b8736700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b013ea00 con 0x7f95b0140af0 2023-03-08T15:49:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b5cd1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95b0140680 0x7f95b01399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b5cd1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95b0140680 0x7f95b01399b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41704/0 (socket says 172.21.15.123:41704) 2023-03-08T15:49:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b5cd1700 1 -- 172.21.15.123:0/2573605905 learned_addr learned my addr 172.21.15.123:0/2573605905 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b64d2700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c005200 0x7f95b013fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b6cd3700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95b0140af0 0x7f95b0139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b5cd1700 1 -- 172.21.15.123:0/2573605905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95b0140af0 msgr2=0x7f95b0139ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b5cd1700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95b0140af0 0x7f95b0139ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b5cd1700 1 -- 172.21.15.123:0/2573605905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c005200 msgr2=0x7f95b013fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:56.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b5cd1700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c005200 0x7f95b013fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b5cd1700 1 -- 172.21.15.123:0/2573605905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b014db90 con 0x7f95b0140680 2023-03-08T15:49:56.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b6cd3700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95b0140af0 0x7f95b0139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:49:56.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b64d2700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c005200 0x7f95b013fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:49:56.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b5cd1700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95b0140680 0x7f95b01399b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0116a0 tx=0x7f95ac011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:56.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95a6ffd700 1 -- 172.21.15.123:0/2573605905 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac00c070 con 0x7f95b0140680 2023-03-08T15:49:56.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95a6ffd700 1 -- 172.21.15.123:0/2573605905 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac015870 con 0x7f95b0140680 2023-03-08T15:49:56.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b8736700 1 -- 172.21.15.123:0/2573605905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b00b7530 con 0x7f95b0140680 2023-03-08T15:49:56.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95a6ffd700 1 -- 172.21.15.123:0/2573605905 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac015c00 con 0x7f95b0140680 2023-03-08T15:49:56.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.778+0000 7f95b8736700 1 -- 172.21.15.123:0/2573605905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b013e4e0 con 0x7f95b0140680 2023-03-08T15:49:56.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.779+0000 7f95b8736700 1 -- 172.21.15.123:0/2573605905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b013e850 con 0x7f95b0140680 2023-03-08T15:49:56.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.780+0000 7f95a6ffd700 1 -- 172.21.15.123:0/2573605905 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f95ac025070 con 0x7f95b0140680 2023-03-08T15:49:56.789 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.780+0000 7f95a6ffd700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f95940698d0 0x7f959406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:56.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.780+0000 7f95b64d2700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f95940698d0 0x7f959406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:56.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.780+0000 7f95a6ffd700 1 -- 172.21.15.123:0/2573605905 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95ac087860 con 0x7f95b0140680 2023-03-08T15:49:56.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.780+0000 7f95b64d2700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f95940698d0 0x7f959406bd80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f95a0001eb0 tx=0x7f95a0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:56.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.784+0000 7f95a6ffd700 1 -- 172.21.15.123:0/2573605905 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f95ac053630 con 0x7f95b0140680 2023-03-08T15:49:56.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.967+0000 7f95b8736700 1 -- 172.21.15.123:0/2573605905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95b014dd20 con 0x7f95b0140680 2023-03-08T15:49:56.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.968+0000 7f95a6ffd700 1 -- 172.21.15.123:0/2573605905 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95b014dd20 con 0x7f95b0140680 2023-03-08T15:49:56.969 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-03-08T15:49:56.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.970+0000 7f95b8736700 1 -- 172.21.15.123:0/2573605905 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f95940698d0 msgr2=0x7f959406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:56.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.970+0000 7f95b8736700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f95940698d0 0x7f959406bd80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f95a0001eb0 tx=0x7f95a0009040 comp rx=0 tx=0).stop 2023-03-08T15:49:56.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.970+0000 7f95b8736700 1 -- 172.21.15.123:0/2573605905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95b0140680 msgr2=0x7f95b01399b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:56.971 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.970+0000 7f95b8736700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95b0140680 0x7f95b01399b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0116a0 tx=0x7f95ac011a60 comp rx=0 tx=0).stop 2023-03-08T15:49:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.970+0000 7f95b8736700 1 -- 172.21.15.123:0/2573605905 shutdown_connections 2023-03-08T15:49:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.970+0000 7f95b8736700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f95940698d0 0x7f959406bd80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.970+0000 7f95b8736700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95b0140af0 0x7f95b0139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.970+0000 7f95b8736700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c005200 0x7f95b013fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.970+0000 7f95b8736700 1 --2- 172.21.15.123:0/2573605905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95b0140680 0x7f95b01399b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.970+0000 7f95b8736700 1 -- 172.21.15.123:0/2573605905 >> 172.21.15.123:0/2573605905 conn(0x7f95b0071980 msgr2=0x7f95b00b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.970+0000 7f95b8736700 1 -- 172.21.15.123:0/2573605905 shutdown_connections 2023-03-08T15:49:56.973 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:56.970+0000 7f95b8736700 1 -- 172.21.15.123:0/2573605905 wait complete. 2023-03-08T15:49:56.983 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-08T15:49:57.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.106+0000 7f7247c3e700 1 Processor -- start 2023-03-08T15:49:57.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.106+0000 7f7247c3e700 1 -- start start 2023-03-08T15:49:57.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.107+0000 7f7247c3e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72400ba280 0x7f724006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.107+0000 7f7247c3e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7240072760 0x7f7240141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.107+0000 7f7247c3e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7240070670 con 0x7f7240071df0 2023-03-08T15:49:57.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.107+0000 7f7247c3e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7240070a40 con 0x7f7240072760 2023-03-08T15:49:57.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.107+0000 7f7247c3e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7240070c50 con 0x7f72400ba280 2023-03-08T15:49:57.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.107+0000 7f72451d9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7240072760 0x7f7240141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.107+0000 7f72459da700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72400ba280 0x7f724006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.107+0000 7f72461db700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7240071df0 0x7f724014aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.123:47192/0 (socket says 172.21.15.123:47192) 2023-03-08T15:49:57.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.107+0000 7f72461db700 1 -- 172.21.15.123:0/3007143045 learned_addr learned my addr 172.21.15.123:0/3007143045 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:57.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.107+0000 7f72459da700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72400ba280 0x7f724006fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:40904/0 (socket says 172.21.15.123:40904) 2023-03-08T15:49:57.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.107+0000 7f72451d9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7240072760 0x7f7240141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:45394/0 (socket says 172.21.15.123:45394) 2023-03-08T15:49:57.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.107+0000 7f72459da700 1 -- 172.21.15.123:0/3007143045 >> v2:172.21.15.175:3300/0 conn(0x7f7240072760 msgr2=0x7f7240141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:57.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.107+0000 7f72459da700 1 --2- 172.21.15.123:0/3007143045 >> v2:172.21.15.175:3300/0 conn(0x7f7240072760 0x7f7240141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.107+0000 7f72459da700 1 -- 172.21.15.123:0/3007143045 >> v1:172.21.15.175:6789/0 conn(0x7f7240071df0 legacy=0x7f724014aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.108+0000 7f72459da700 1 -- 172.21.15.123:0/3007143045 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72400ba650 con 0x7f72400ba280 2023-03-08T15:49:57.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.108+0000 7f72451d9700 1 --2- 172.21.15.123:0/3007143045 >> v2:172.21.15.175:3300/0 conn(0x7f7240072760 0x7f7240141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:57.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.108+0000 7f72459da700 1 --2- 172.21.15.123:0/3007143045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72400ba280 0x7f724006fff0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f723000bae0 tx=0x7f723000bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e26f24c053f3e23 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:57.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.108+0000 7f72449d8700 1 -- 172.21.15.123:0/3007143045 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723000dc70 con 0x7f72400ba280 2023-03-08T15:49:57.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.108+0000 7f72449d8700 1 -- 172.21.15.123:0/3007143045 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723000ddd0 con 0x7f72400ba280 2023-03-08T15:49:57.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.108+0000 7f72449d8700 1 -- 172.21.15.123:0/3007143045 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7230010690 con 0x7f72400ba280 2023-03-08T15:49:57.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.108+0000 7f7247c3e700 1 -- 172.21.15.123:0/3007143045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72400ba280 msgr2=0x7f724006fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.108+0000 7f7247c3e700 1 --2- 172.21.15.123:0/3007143045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72400ba280 0x7f724006fff0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f723000bae0 tx=0x7f723000bdf0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.108+0000 7f7247c3e700 1 -- 172.21.15.123:0/3007143045 shutdown_connections 2023-03-08T15:49:57.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.108+0000 7f7247c3e700 1 --2- 172.21.15.123:0/3007143045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72400ba280 0x7f724006fff0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.108+0000 7f7247c3e700 1 --2- 172.21.15.123:0/3007143045 >> v2:172.21.15.175:3300/0 conn(0x7f7240072760 0x7f7240141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.109+0000 7f7247c3e700 1 -- 172.21.15.123:0/3007143045 >> 172.21.15.123:0/3007143045 conn(0x7f724006b360 msgr2=0x7f724006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:57.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.109+0000 7f7247c3e700 1 -- 172.21.15.123:0/3007143045 shutdown_connections 2023-03-08T15:49:57.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.109+0000 7f7247c3e700 1 -- 172.21.15.123:0/3007143045 wait complete. 2023-03-08T15:49:57.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.110+0000 7f7247c3e700 1 Processor -- start 2023-03-08T15:49:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.110+0000 7f7247c3e700 1 -- start start 2023-03-08T15:49:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.110+0000 7f7247c3e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7240071df0 0x7f72400bdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.110+0000 7f7247c3e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72400ba280 0x7f72400b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.110+0000 7f7247c3e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72400bbeb0 0x7f72400bc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.110+0000 7f7247c3e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72400be140 con 0x7f7240071df0 2023-03-08T15:49:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.110+0000 7f7247c3e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72401e00f0 con 0x7f72400bbeb0 2023-03-08T15:49:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.110+0000 7f7247c3e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72401e10a0 con 0x7f72400ba280 2023-03-08T15:49:57.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.110+0000 7f72459da700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7240071df0 0x7f72400bdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.110+0000 7f72459da700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7240071df0 0x7f72400bdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41718/0 (socket says 172.21.15.123:41718) 2023-03-08T15:49:57.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.110+0000 7f72459da700 1 -- 172.21.15.123:0/2345309325 learned_addr learned my addr 172.21.15.123:0/2345309325 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:57.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.110+0000 7f72451d9700 1 --2- 172.21.15.123:0/2345309325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72400ba280 0x7f72400b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.110+0000 7f72461db700 1 --2- 172.21.15.123:0/2345309325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72400bbeb0 0x7f72400bc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.111+0000 7f72459da700 1 -- 172.21.15.123:0/2345309325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72400ba280 msgr2=0x7f72400b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.111+0000 7f72459da700 1 --2- 172.21.15.123:0/2345309325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72400ba280 0x7f72400b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.111+0000 7f72459da700 1 -- 172.21.15.123:0/2345309325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72400bbeb0 msgr2=0x7f72400bc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.111+0000 7f72459da700 1 --2- 172.21.15.123:0/2345309325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72400bbeb0 0x7f72400bc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.111+0000 7f72459da700 1 -- 172.21.15.123:0/2345309325 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c0094a0 con 0x7f7240071df0 2023-03-08T15:49:57.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.111+0000 7f72459da700 1 --2- 172.21.15.123:0/2345309325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7240071df0 0x7f72400bdc00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f723000b2c0 tx=0x7f7230004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:57.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.111+0000 7f72367fc700 1 -- 172.21.15.123:0/2345309325 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723001d070 con 0x7f7240071df0 2023-03-08T15:49:57.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.111+0000 7f7247c3e700 1 -- 172.21.15.123:0/2345309325 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723000b740 con 0x7f7240071df0 2023-03-08T15:49:57.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.111+0000 7f72367fc700 1 -- 172.21.15.123:0/2345309325 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7230010680 con 0x7f7240071df0 2023-03-08T15:49:57.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.111+0000 7f72367fc700 1 -- 172.21.15.123:0/2345309325 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7230010aa0 con 0x7f7240071df0 2023-03-08T15:49:57.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.111+0000 7f7247c3e700 1 -- 172.21.15.123:0/2345309325 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724014b350 con 0x7f7240071df0 2023-03-08T15:49:57.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.112+0000 7f7247c3e700 1 -- 172.21.15.123:0/2345309325 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72401419c0 con 0x7f7240071df0 2023-03-08T15:49:57.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.112+0000 7f72367fc700 1 -- 172.21.15.123:0/2345309325 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f72300036a0 con 0x7f7240071df0 2023-03-08T15:49:57.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.113+0000 7f72367fc700 1 --2- 172.21.15.123:0/2345309325 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f72240698d0 0x7f722406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.113+0000 7f72451d9700 1 --2- 172.21.15.123:0/2345309325 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f72240698d0 0x7f722406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.113+0000 7f72367fc700 1 -- 172.21.15.123:0/2345309325 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7230088e90 con 0x7f7240071df0 2023-03-08T15:49:57.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.113+0000 7f72451d9700 1 --2- 172.21.15.123:0/2345309325 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f72240698d0 0x7f722406bd80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f72401480f0 tx=0x7f723c009210 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:57.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.117+0000 7f72367fc700 1 -- 172.21.15.123:0/2345309325 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f7230054be0 con 0x7f7240071df0 2023-03-08T15:49:57.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.300+0000 7f7247c3e700 1 -- 172.21.15.123:0/2345309325 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f724013f620 con 0x7f7240071df0 2023-03-08T15:49:57.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.300+0000 7f72367fc700 1 -- 172.21.15.123:0/2345309325 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f72300270a0 con 0x7f7240071df0 2023-03-08T15:49:57.302 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-03-08T15:49:57.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.302+0000 7f7247c3e700 1 -- 172.21.15.123:0/2345309325 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f72240698d0 msgr2=0x7f722406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.302+0000 7f7247c3e700 1 --2- 172.21.15.123:0/2345309325 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f72240698d0 0x7f722406bd80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f72401480f0 tx=0x7f723c009210 comp rx=0 tx=0).stop 2023-03-08T15:49:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.302+0000 7f7247c3e700 1 -- 172.21.15.123:0/2345309325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7240071df0 msgr2=0x7f72400bdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.302+0000 7f7247c3e700 1 --2- 172.21.15.123:0/2345309325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7240071df0 0x7f72400bdc00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f723000b2c0 tx=0x7f7230004750 comp rx=0 tx=0).stop 2023-03-08T15:49:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.302+0000 7f7247c3e700 1 -- 172.21.15.123:0/2345309325 shutdown_connections 2023-03-08T15:49:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.302+0000 7f7247c3e700 1 --2- 172.21.15.123:0/2345309325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72400bbeb0 0x7f72400bc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.302+0000 7f7247c3e700 1 --2- 172.21.15.123:0/2345309325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7240071df0 0x7f72400bdc00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.302+0000 7f7247c3e700 1 --2- 172.21.15.123:0/2345309325 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f72240698d0 0x7f722406bd80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.302+0000 7f7247c3e700 1 --2- 172.21.15.123:0/2345309325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72400ba280 0x7f72400b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.302+0000 7f7247c3e700 1 -- 172.21.15.123:0/2345309325 >> 172.21.15.123:0/2345309325 conn(0x7f724006b360 msgr2=0x7f724013ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:57.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.302+0000 7f7247c3e700 1 -- 172.21.15.123:0/2345309325 shutdown_connections 2023-03-08T15:49:57.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.302+0000 7f7247c3e700 1 -- 172.21.15.123:0/2345309325 wait complete. 2023-03-08T15:49:57.315 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-08T15:49:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.436+0000 7fbfcf713700 1 Processor -- start 2023-03-08T15:49:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.436+0000 7fbfcf713700 1 -- start start 2023-03-08T15:49:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.437+0000 7fbfcf713700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbfc806f8d0 0x7fbfc80b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.437+0000 7fbfcf713700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbfc8140980 0x7fbfc8140de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.437+0000 7fbfcf713700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc8071280 con 0x7fbfc806b530 2023-03-08T15:49:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.437+0000 7fbfcf713700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc8071630 con 0x7fbfc806f8d0 2023-03-08T15:49:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.437+0000 7fbfcf713700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc814a720 con 0x7fbfc8140980 2023-03-08T15:49:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.437+0000 7fbfcdcb0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbfc8140980 0x7fbfc8140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.437+0000 7fbfcccae700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbfc806f8d0 0x7fbfc80b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.437+0000 7fbfcdcb0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbfc8140980 0x7fbfc8140de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:40912/0 (socket says 172.21.15.123:40912) 2023-03-08T15:49:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.437+0000 7fbfcdcb0700 1 -- 172.21.15.123:0/4200568576 learned_addr learned my addr 172.21.15.123:0/4200568576 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.437+0000 7fbfcccae700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbfc806f8d0 0x7fbfc80b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:45402/0 (socket says 172.21.15.123:45402) 2023-03-08T15:49:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.437+0000 7fbfcd4af700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fbfc806b530 0x7fbfc814a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.123:47202/0 (socket says 172.21.15.123:47202) 2023-03-08T15:49:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.437+0000 7fbfcdcb0700 1 -- 172.21.15.123:0/4200568576 >> v2:172.21.15.175:3300/0 conn(0x7fbfc806f8d0 msgr2=0x7fbfc80b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.437+0000 7fbfcdcb0700 1 --2- 172.21.15.123:0/4200568576 >> v2:172.21.15.175:3300/0 conn(0x7fbfc806f8d0 0x7fbfc80b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.437+0000 7fbfcdcb0700 1 -- 172.21.15.123:0/4200568576 >> v1:172.21.15.175:6789/0 conn(0x7fbfc806b530 legacy=0x7fbfc814a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.437+0000 7fbfcdcb0700 1 -- 172.21.15.123:0/4200568576 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc8072020 con 0x7fbfc8140980 2023-03-08T15:49:57.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.438+0000 7fbfcdcb0700 1 --2- 172.21.15.123:0/4200568576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbfc8140980 0x7fbfc8140de0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000af60 tx=0x7fbfc000af90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e3076e1e6da60b9 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.438+0000 7fbfbffff700 1 -- 172.21.15.123:0/4200568576 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc000f070 con 0x7fbfc8140980 2023-03-08T15:49:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.438+0000 7fbfbffff700 1 -- 172.21.15.123:0/4200568576 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc000a2e0 con 0x7fbfc8140980 2023-03-08T15:49:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.438+0000 7fbfbffff700 1 -- 172.21.15.123:0/4200568576 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc000cc00 con 0x7fbfc8140980 2023-03-08T15:49:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.438+0000 7fbfcf713700 1 -- 172.21.15.123:0/4200568576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbfc8140980 msgr2=0x7fbfc8140de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.438+0000 7fbfcf713700 1 --2- 172.21.15.123:0/4200568576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbfc8140980 0x7fbfc8140de0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000af60 tx=0x7fbfc000af90 comp rx=0 tx=0).stop 2023-03-08T15:49:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.438+0000 7fbfcf713700 1 -- 172.21.15.123:0/4200568576 shutdown_connections 2023-03-08T15:49:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.438+0000 7fbfcf713700 1 --2- 172.21.15.123:0/4200568576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbfc8140980 0x7fbfc8140de0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.438+0000 7fbfcf713700 1 --2- 172.21.15.123:0/4200568576 >> v2:172.21.15.175:3300/0 conn(0x7fbfc806f8d0 0x7fbfc80b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.438+0000 7fbfcf713700 1 -- 172.21.15.123:0/4200568576 >> 172.21.15.123:0/4200568576 conn(0x7fbfc80ba3c0 msgr2=0x7fbfc80bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.438+0000 7fbfcf713700 1 -- 172.21.15.123:0/4200568576 shutdown_connections 2023-03-08T15:49:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.438+0000 7fbfcf713700 1 -- 172.21.15.123:0/4200568576 wait complete. 2023-03-08T15:49:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.439+0000 7fbfcf713700 1 Processor -- start 2023-03-08T15:49:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.439+0000 7fbfcf713700 1 -- start start 2023-03-08T15:49:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcf713700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfc806b530 0x7fbfc80b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcf713700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbfc806f8d0 0x7fbfc813c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcf713700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc8140980 0x7fbfc8143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcf713700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc813cd10 con 0x7fbfc8140980 2023-03-08T15:49:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcf713700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc81df390 con 0x7fbfc806b530 2023-03-08T15:49:57.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcf713700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc81df670 con 0x7fbfc806f8d0 2023-03-08T15:49:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcdcb0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc8140980 0x7fbfc8143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcdcb0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc8140980 0x7fbfc8143950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41734/0 (socket says 172.21.15.123:41734) 2023-03-08T15:49:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcdcb0700 1 -- 172.21.15.123:0/4207249834 learned_addr learned my addr 172.21.15.123:0/4207249834 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcccae700 1 --2- 172.21.15.123:0/4207249834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbfc806f8d0 0x7fbfc813c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcd4af700 1 --2- 172.21.15.123:0/4207249834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfc806b530 0x7fbfc80b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcdcb0700 1 -- 172.21.15.123:0/4207249834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbfc806f8d0 msgr2=0x7fbfc813c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcdcb0700 1 --2- 172.21.15.123:0/4207249834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbfc806f8d0 0x7fbfc813c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcdcb0700 1 -- 172.21.15.123:0/4207249834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfc806b530 msgr2=0x7fbfc80b6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcdcb0700 1 --2- 172.21.15.123:0/4207249834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfc806b530 0x7fbfc80b6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.440+0000 7fbfcdcb0700 1 -- 172.21.15.123:0/4207249834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc000ac40 con 0x7fbfc8140980 2023-03-08T15:49:57.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.441+0000 7fbfcdcb0700 1 --2- 172.21.15.123:0/4207249834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc8140980 0x7fbfc8143950 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbfc814a860 tx=0x7fbfc0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:57.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.441+0000 7fbfbdffb700 1 -- 172.21.15.123:0/4207249834 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0004450 con 0x7fbfc8140980 2023-03-08T15:49:57.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.441+0000 7fbfbdffb700 1 -- 172.21.15.123:0/4207249834 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc00045b0 con 0x7fbfc8140980 2023-03-08T15:49:57.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.441+0000 7fbfcf713700 1 -- 172.21.15.123:0/4207249834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc8071820 con 0x7fbfc8140980 2023-03-08T15:49:57.448 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.441+0000 7fbfbdffb700 1 -- 172.21.15.123:0/4207249834 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0004960 con 0x7fbfc8140980 2023-03-08T15:49:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.441+0000 7fbfcf713700 1 -- 172.21.15.123:0/4207249834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc806fe60 con 0x7fbfc8140980 2023-03-08T15:49:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.442+0000 7fbfcf713700 1 -- 172.21.15.123:0/4207249834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc8071b00 con 0x7fbfc8140980 2023-03-08T15:49:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.442+0000 7fbfbdffb700 1 -- 172.21.15.123:0/4207249834 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fbfc002c070 con 0x7fbfc8140980 2023-03-08T15:49:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.443+0000 7fbfbdffb700 1 --2- 172.21.15.123:0/4207249834 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fbfac0698d0 0x7fbfac06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.443+0000 7fbfbdffb700 1 -- 172.21.15.123:0/4207249834 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbfc0088fe0 con 0x7fbfc8140980 2023-03-08T15:49:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.443+0000 7fbfcd4af700 1 --2- 172.21.15.123:0/4207249834 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fbfac0698d0 0x7fbfac06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.443+0000 7fbfcd4af700 1 --2- 172.21.15.123:0/4207249834 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fbfac0698d0 0x7fbfac06bd80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8000f60 tx=0x7fbfb8007d10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:57.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.447+0000 7fbfbdffb700 1 -- 172.21.15.123:0/4207249834 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fbfc0054d30 con 0x7fbfc8140980 2023-03-08T15:49:57.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.631+0000 7fbfcf713700 1 -- 172.21.15.123:0/4207249834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbfc80744c0 con 0x7fbfc8140980 2023-03-08T15:49:57.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.631+0000 7fbfbdffb700 1 -- 172.21.15.123:0/4207249834 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbfc0058350 con 0x7fbfc8140980 2023-03-08T15:49:57.633 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-03-08T15:49:57.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.633+0000 7fbfcf713700 1 -- 172.21.15.123:0/4207249834 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fbfac0698d0 msgr2=0x7fbfac06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.633+0000 7fbfcf713700 1 --2- 172.21.15.123:0/4207249834 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fbfac0698d0 0x7fbfac06bd80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8000f60 tx=0x7fbfb8007d10 comp rx=0 tx=0).stop 2023-03-08T15:49:57.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.633+0000 7fbfcf713700 1 -- 172.21.15.123:0/4207249834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc8140980 msgr2=0x7fbfc8143950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.633+0000 7fbfcf713700 1 --2- 172.21.15.123:0/4207249834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc8140980 0x7fbfc8143950 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbfc814a860 tx=0x7fbfc0004ad0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.633+0000 7fbfcf713700 1 -- 172.21.15.123:0/4207249834 shutdown_connections 2023-03-08T15:49:57.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.633+0000 7fbfcf713700 1 --2- 172.21.15.123:0/4207249834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc8140980 0x7fbfc8143950 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.633+0000 7fbfcf713700 1 --2- 172.21.15.123:0/4207249834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfc806b530 0x7fbfc80b6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.633+0000 7fbfcf713700 1 --2- 172.21.15.123:0/4207249834 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fbfac0698d0 0x7fbfac06bd80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.633+0000 7fbfcf713700 1 --2- 172.21.15.123:0/4207249834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbfc806f8d0 0x7fbfc813c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.634+0000 7fbfcf713700 1 -- 172.21.15.123:0/4207249834 >> 172.21.15.123:0/4207249834 conn(0x7fbfc80ba3c0 msgr2=0x7fbfc813a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:57.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.634+0000 7fbfcf713700 1 -- 172.21.15.123:0/4207249834 shutdown_connections 2023-03-08T15:49:57.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.634+0000 7fbfcf713700 1 -- 172.21.15.123:0/4207249834 wait complete. 2023-03-08T15:49:57.647 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-08T15:49:57.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.767+0000 7f7200b26700 1 Processor -- start 2023-03-08T15:49:57.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.767+0000 7f7200b26700 1 -- start start 2023-03-08T15:49:57.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f7200b26700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f71fc0ba280 0x7f71fc06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f7200b26700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f71fc071df0 0x7f71fc14aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f7200b26700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71fc070670 con 0x7f71fc072760 2023-03-08T15:49:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f7200b26700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71fc070a40 con 0x7f71fc0ba280 2023-03-08T15:49:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f7200b26700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71fc070c50 con 0x7f71fc071df0 2023-03-08T15:49:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f71fa59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f71fc0ba280 0x7f71fc06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f71fa59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f71fc0ba280 0x7f71fc06fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41736/0 (socket says 172.21.15.123:41736) 2023-03-08T15:49:57.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f71fa59c700 1 -- 172.21.15.123:0/3354673316 learned_addr learned my addr 172.21.15.123:0/3354673316 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:57.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f71fad9d700 1 --2- 172.21.15.123:0/3354673316 >> v2:172.21.15.175:3300/0 conn(0x7f71fc071df0 0x7f71fc14aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f71fa59c700 1 -- 172.21.15.123:0/3354673316 >> v2:172.21.15.175:3300/0 conn(0x7f71fc071df0 msgr2=0x7f71fc14aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:57.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f71fa59c700 1 --2- 172.21.15.123:0/3354673316 >> v2:172.21.15.175:3300/0 conn(0x7f71fc071df0 0x7f71fc14aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f71fa59c700 1 -- 172.21.15.123:0/3354673316 >> v1:172.21.15.175:6789/0 conn(0x7f71fc072760 legacy=0x7f71fc141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:57.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f71fa59c700 1 -- 172.21.15.123:0/3354673316 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc0ba650 con 0x7f71fc0ba280 2023-03-08T15:49:57.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f71fad9d700 1 --2- 172.21.15.123:0/3354673316 >> v2:172.21.15.175:3300/0 conn(0x7f71fc071df0 0x7f71fc14aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:49:57.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f71fa59c700 1 --2- 172.21.15.123:0/3354673316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71fc0ba280 0x7f71fc06fff0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0b99e0 tx=0x7f71f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1965412ea7a0404a server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:57.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.768+0000 7f71f959a700 1 -- 172.21.15.123:0/3354673316 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f0004230 con 0x7f71fc0ba280 2023-03-08T15:49:57.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.769+0000 7f71f959a700 1 -- 172.21.15.123:0/3354673316 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f0004390 con 0x7f71fc0ba280 2023-03-08T15:49:57.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.769+0000 7f71f959a700 1 -- 172.21.15.123:0/3354673316 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f00036a0 con 0x7f71fc0ba280 2023-03-08T15:49:57.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.769+0000 7f7200b26700 1 -- 172.21.15.123:0/3354673316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71fc0ba280 msgr2=0x7f71fc06fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.769+0000 7f7200b26700 1 --2- 172.21.15.123:0/3354673316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71fc0ba280 0x7f71fc06fff0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0b99e0 tx=0x7f71f0009bd0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.769+0000 7f7200b26700 1 -- 172.21.15.123:0/3354673316 shutdown_connections 2023-03-08T15:49:57.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.769+0000 7f7200b26700 1 --2- 172.21.15.123:0/3354673316 >> v2:172.21.15.175:3300/0 conn(0x7f71fc071df0 0x7f71fc14aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.769+0000 7f7200b26700 1 --2- 172.21.15.123:0/3354673316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71fc0ba280 0x7f71fc06fff0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.769+0000 7f7200b26700 1 -- 172.21.15.123:0/3354673316 >> 172.21.15.123:0/3354673316 conn(0x7f71fc06b360 msgr2=0x7f71fc06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:57.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.769+0000 7f7200b26700 1 -- 172.21.15.123:0/3354673316 shutdown_connections 2023-03-08T15:49:57.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.769+0000 7f7200b26700 1 -- 172.21.15.123:0/3354673316 wait complete. 2023-03-08T15:49:57.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.770+0000 7f7200b26700 1 Processor -- start 2023-03-08T15:49:57.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.770+0000 7f7200b26700 1 -- start start 2023-03-08T15:49:57.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f7200b26700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71fc071df0 0x7f71fc14a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f7200b26700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71fc0ba280 0x7f71fc1df1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f7200b26700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71fc149450 0x7f71fc13ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f7200b26700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc13cf90 con 0x7f71fc149450 2023-03-08T15:49:57.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f7200b26700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc149170 con 0x7f71fc071df0 2023-03-08T15:49:57.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f7200b26700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc148e90 con 0x7f71fc0ba280 2023-03-08T15:49:57.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f71fad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71fc149450 0x7f71fc13ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f71fad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71fc149450 0x7f71fc13ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41748/0 (socket says 172.21.15.123:41748) 2023-03-08T15:49:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f71fad9d700 1 -- 172.21.15.123:0/2613028061 learned_addr learned my addr 172.21.15.123:0/2613028061 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f71fa59c700 1 --2- 172.21.15.123:0/2613028061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71fc071df0 0x7f71fc14a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f71f9d9b700 1 --2- 172.21.15.123:0/2613028061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71fc0ba280 0x7f71fc1df1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f71fad9d700 1 -- 172.21.15.123:0/2613028061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71fc0ba280 msgr2=0x7f71fc1df1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f71fad9d700 1 --2- 172.21.15.123:0/2613028061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71fc0ba280 0x7f71fc1df1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f71fad9d700 1 -- 172.21.15.123:0/2613028061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71fc071df0 msgr2=0x7f71fc14a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f71fad9d700 1 --2- 172.21.15.123:0/2613028061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71fc071df0 0x7f71fc14a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.771+0000 7f71fad9d700 1 -- 172.21.15.123:0/2613028061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f0009550 con 0x7f71fc149450 2023-03-08T15:49:57.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.772+0000 7f71fad9d700 1 --2- 172.21.15.123:0/2613028061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71fc149450 0x7f71fc13ca50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f71f400ce80 tx=0x7f71f400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:57.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.772+0000 7f71eaffd700 1 -- 172.21.15.123:0/2613028061 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f400ace0 con 0x7f71fc149450 2023-03-08T15:49:57.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.772+0000 7f71eaffd700 1 -- 172.21.15.123:0/2613028061 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f400ae40 con 0x7f71fc149450 2023-03-08T15:49:57.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.772+0000 7f7200b26700 1 -- 172.21.15.123:0/2613028061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71fc141d20 con 0x7f71fc149450 2023-03-08T15:49:57.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.772+0000 7f71eaffd700 1 -- 172.21.15.123:0/2613028061 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f4015680 con 0x7f71fc149450 2023-03-08T15:49:57.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.772+0000 7f7200b26700 1 -- 172.21.15.123:0/2613028061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71fc141b90 con 0x7f71fc149450 2023-03-08T15:49:57.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.773+0000 7f7200b26700 1 -- 172.21.15.123:0/2613028061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71fc14aff0 con 0x7f71fc149450 2023-03-08T15:49:57.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.773+0000 7f71eaffd700 1 -- 172.21.15.123:0/2613028061 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f71f401c030 con 0x7f71fc149450 2023-03-08T15:49:57.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.773+0000 7f71eaffd700 1 --2- 172.21.15.123:0/2613028061 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f71dc0698d0 0x7f71dc06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:57.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.773+0000 7f71eaffd700 1 -- 172.21.15.123:0/2613028061 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f71f4087950 con 0x7f71fc149450 2023-03-08T15:49:57.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.773+0000 7f71fa59c700 1 --2- 172.21.15.123:0/2613028061 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f71dc0698d0 0x7f71dc06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:57.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.774+0000 7f71fa59c700 1 --2- 172.21.15.123:0/2613028061 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f71dc0698d0 0x7f71dc06bd80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009130 tx=0x7f71f0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:57.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.778+0000 7f71eaffd700 1 -- 172.21.15.123:0/2613028061 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f71f40536c0 con 0x7f71fc149450 2023-03-08T15:49:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.963+0000 7f7200b26700 1 -- 172.21.15.123:0/2613028061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71fc0744c0 con 0x7f71fc149450 2023-03-08T15:49:57.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.963+0000 7f71eaffd700 1 -- 172.21.15.123:0/2613028061 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71f401a020 con 0x7f71fc149450 2023-03-08T15:49:57.965 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-03-08T15:49:57.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.965+0000 7f7200b26700 1 -- 172.21.15.123:0/2613028061 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f71dc0698d0 msgr2=0x7f71dc06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.965+0000 7f7200b26700 1 --2- 172.21.15.123:0/2613028061 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f71dc0698d0 0x7f71dc06bd80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009130 tx=0x7f71f0008030 comp rx=0 tx=0).stop 2023-03-08T15:49:57.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.965+0000 7f7200b26700 1 -- 172.21.15.123:0/2613028061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71fc149450 msgr2=0x7f71fc13ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:57.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.965+0000 7f7200b26700 1 --2- 172.21.15.123:0/2613028061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71fc149450 0x7f71fc13ca50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f71f400ce80 tx=0x7f71f400ceb0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.965+0000 7f7200b26700 1 -- 172.21.15.123:0/2613028061 shutdown_connections 2023-03-08T15:49:57.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.965+0000 7f7200b26700 1 --2- 172.21.15.123:0/2613028061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71fc149450 0x7f71fc13ca50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.965+0000 7f7200b26700 1 --2- 172.21.15.123:0/2613028061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71fc071df0 0x7f71fc14a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.965+0000 7f7200b26700 1 --2- 172.21.15.123:0/2613028061 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f71dc0698d0 0x7f71dc06bd80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.965+0000 7f7200b26700 1 --2- 172.21.15.123:0/2613028061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71fc0ba280 0x7f71fc1df1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:57.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.965+0000 7f7200b26700 1 -- 172.21.15.123:0/2613028061 >> 172.21.15.123:0/2613028061 conn(0x7f71fc06b360 msgr2=0x7f71fc1389c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:57.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.965+0000 7f7200b26700 1 -- 172.21.15.123:0/2613028061 shutdown_connections 2023-03-08T15:49:57.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:57.965+0000 7f7200b26700 1 -- 172.21.15.123:0/2613028061 wait complete. 2023-03-08T15:49:57.978 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:49:58.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.099+0000 7fd128d80700 1 Processor -- start 2023-03-08T15:49:58.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.099+0000 7fd128d80700 1 -- start start 2023-03-08T15:49:58.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.100+0000 7fd128d80700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd124147510 0x7fd1240bd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.100+0000 7fd128d80700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd1240b3c30 0x7fd124151d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.100+0000 7fd128d80700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1240b7180 con 0x7fd124148130 2023-03-08T15:49:58.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.100+0000 7fd128d80700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd124141cd0 con 0x7fd124147510 2023-03-08T15:49:58.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.100+0000 7fd128d80700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1240b8c40 con 0x7fd1240b3c30 2023-03-08T15:49:58.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.100+0000 7fd121d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd124147510 0x7fd1240bd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.100+0000 7fd121d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd124147510 0x7fd1240bd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41756/0 (socket says 172.21.15.123:41756) 2023-03-08T15:49:58.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.100+0000 7fd121d9b700 1 -- 172.21.15.123:0/2187324456 learned_addr learned my addr 172.21.15.123:0/2187324456 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:58.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.100+0000 7fd122d9d700 1 --2- 172.21.15.123:0/2187324456 >> v2:172.21.15.175:3300/0 conn(0x7fd1240b3c30 0x7fd124151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.101+0000 7fd121d9b700 1 -- 172.21.15.123:0/2187324456 >> v2:172.21.15.175:3300/0 conn(0x7fd1240b3c30 msgr2=0x7fd124151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:58.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.101+0000 7fd121d9b700 1 --2- 172.21.15.123:0/2187324456 >> v2:172.21.15.175:3300/0 conn(0x7fd1240b3c30 0x7fd124151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.101+0000 7fd121d9b700 1 -- 172.21.15.123:0/2187324456 >> v1:172.21.15.175:6789/0 conn(0x7fd124148130 legacy=0x7fd12406b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:58.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.101+0000 7fd121d9b700 1 -- 172.21.15.123:0/2187324456 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1240b8960 con 0x7fd124147510 2023-03-08T15:49:58.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.101+0000 7fd121d9b700 1 --2- 172.21.15.123:0/2187324456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd124147510 0x7fd1240bd420 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd1241450b0 tx=0x7fd114009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5897499986663457 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:58.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.101+0000 7fd12159a700 1 -- 172.21.15.123:0/2187324456 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114004230 con 0x7fd124147510 2023-03-08T15:49:58.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.101+0000 7fd12159a700 1 -- 172.21.15.123:0/2187324456 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd114004390 con 0x7fd124147510 2023-03-08T15:49:58.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.101+0000 7fd12159a700 1 -- 172.21.15.123:0/2187324456 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140036a0 con 0x7fd124147510 2023-03-08T15:49:58.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.101+0000 7fd128d80700 1 -- 172.21.15.123:0/2187324456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd124147510 msgr2=0x7fd1240bd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.101+0000 7fd128d80700 1 --2- 172.21.15.123:0/2187324456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd124147510 0x7fd1240bd420 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd1241450b0 tx=0x7fd114009bd0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.101+0000 7fd128d80700 1 -- 172.21.15.123:0/2187324456 shutdown_connections 2023-03-08T15:49:58.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.101+0000 7fd128d80700 1 --2- 172.21.15.123:0/2187324456 >> v2:172.21.15.175:3300/0 conn(0x7fd1240b3c30 0x7fd124151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.101+0000 7fd128d80700 1 --2- 172.21.15.123:0/2187324456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd124147510 0x7fd1240bd420 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.101+0000 7fd128d80700 1 -- 172.21.15.123:0/2187324456 >> 172.21.15.123:0/2187324456 conn(0x7fd1240ba3c0 msgr2=0x7fd1240bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:58.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.102+0000 7fd128d80700 1 -- 172.21.15.123:0/2187324456 shutdown_connections 2023-03-08T15:49:58.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.102+0000 7fd128d80700 1 -- 172.21.15.123:0/2187324456 wait complete. 2023-03-08T15:49:58.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.103+0000 7fd128d80700 1 Processor -- start 2023-03-08T15:49:58.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.103+0000 7fd128d80700 1 -- start start 2023-03-08T15:49:58.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd128d80700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1240b3c30 0x7fd124144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd128d80700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd124147510 0x7fd12413f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd128d80700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd124148130 0x7fd124143580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd128d80700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12413fe50 con 0x7fd1240b3c30 2023-03-08T15:49:58.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd128d80700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd124142600 con 0x7fd124147510 2023-03-08T15:49:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd128d80700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1241d1180 con 0x7fd124148130 2023-03-08T15:49:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd12259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1240b3c30 0x7fd124144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd12259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1240b3c30 0x7fd124144980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41770/0 (socket says 172.21.15.123:41770) 2023-03-08T15:49:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd12259c700 1 -- 172.21.15.123:0/3838248743 learned_addr learned my addr 172.21.15.123:0/3838248743 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd122d9d700 1 --2- 172.21.15.123:0/3838248743 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd124148130 0x7fd124143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd121d9b700 1 --2- 172.21.15.123:0/3838248743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd124147510 0x7fd12413f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd12259c700 1 -- 172.21.15.123:0/3838248743 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd124148130 msgr2=0x7fd124143580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd12259c700 1 --2- 172.21.15.123:0/3838248743 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd124148130 0x7fd124143580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd12259c700 1 -- 172.21.15.123:0/3838248743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd124147510 msgr2=0x7fd12413f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd12259c700 1 --2- 172.21.15.123:0/3838248743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd124147510 0x7fd12413f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd12259c700 1 -- 172.21.15.123:0/3838248743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd114009550 con 0x7fd1240b3c30 2023-03-08T15:49:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.104+0000 7fd12259c700 1 --2- 172.21.15.123:0/3838248743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1240b3c30 0x7fd124144980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd10c00b4d0 tx=0x7fd10c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.105+0000 7fd11affd700 1 -- 172.21.15.123:0/3838248743 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c011830 con 0x7fd1240b3c30 2023-03-08T15:49:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.105+0000 7fd11affd700 1 -- 172.21.15.123:0/3838248743 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10c011990 con 0x7fd1240b3c30 2023-03-08T15:49:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.105+0000 7fd128d80700 1 -- 172.21.15.123:0/3838248743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd124071eb0 con 0x7fd1240b3c30 2023-03-08T15:49:58.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.105+0000 7fd11affd700 1 -- 172.21.15.123:0/3838248743 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c011d40 con 0x7fd1240b3c30 2023-03-08T15:49:58.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.105+0000 7fd128d80700 1 -- 172.21.15.123:0/3838248743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1240b6e10 con 0x7fd1240b3c30 2023-03-08T15:49:58.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.106+0000 7fd128d80700 1 -- 172.21.15.123:0/3838248743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd124072040 con 0x7fd1240b3c30 2023-03-08T15:49:58.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.106+0000 7fd11affd700 1 -- 172.21.15.123:0/3838248743 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fd10c00f050 con 0x7fd1240b3c30 2023-03-08T15:49:58.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.106+0000 7fd11affd700 1 --2- 172.21.15.123:0/3838248743 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd1040698d0 0x7fd10406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.106+0000 7fd11affd700 1 -- 172.21.15.123:0/3838248743 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd10c087190 con 0x7fd1240b3c30 2023-03-08T15:49:58.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.106+0000 7fd121d9b700 1 --2- 172.21.15.123:0/3838248743 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd1040698d0 0x7fd10406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.107+0000 7fd121d9b700 1 --2- 172.21.15.123:0/3838248743 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd1040698d0 0x7fd10406bd80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd114009130 tx=0x7fd114008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:58.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.110+0000 7fd11affd700 1 -- 172.21.15.123:0/3838248743 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fd10c052f60 con 0x7fd1240b3c30 2023-03-08T15:49:58.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.295+0000 7fd128d80700 1 -- 172.21.15.123:0/3838248743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1241420d0 con 0x7fd1240b3c30 2023-03-08T15:49:58.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.296+0000 7fd11affd700 1 -- 172.21.15.123:0/3838248743 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17955 (secure 0 0 0) 0x7fd10c056580 con 0x7fd1240b3c30 2023-03-08T15:49:58.298 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:58.298 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:40.490671+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:49:37.104720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-08T15:49:38.431537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:49:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.298+0000 7fd128d80700 1 -- 172.21.15.123:0/3838248743 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd1040698d0 msgr2=0x7fd10406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.298+0000 7fd128d80700 1 --2- 172.21.15.123:0/3838248743 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd1040698d0 0x7fd10406bd80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd114009130 tx=0x7fd114008030 comp rx=0 tx=0).stop 2023-03-08T15:49:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.298+0000 7fd128d80700 1 -- 172.21.15.123:0/3838248743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1240b3c30 msgr2=0x7fd124144980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.298+0000 7fd128d80700 1 --2- 172.21.15.123:0/3838248743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1240b3c30 0x7fd124144980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd10c00b4d0 tx=0x7fd10c00b890 comp rx=0 tx=0).stop 2023-03-08T15:49:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.298+0000 7fd128d80700 1 -- 172.21.15.123:0/3838248743 shutdown_connections 2023-03-08T15:49:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.298+0000 7fd128d80700 1 --2- 172.21.15.123:0/3838248743 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd1040698d0 0x7fd10406bd80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.298+0000 7fd128d80700 1 --2- 172.21.15.123:0/3838248743 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd124148130 0x7fd124143580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.298+0000 7fd128d80700 1 --2- 172.21.15.123:0/3838248743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1240b3c30 0x7fd124144980 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.298+0000 7fd128d80700 1 --2- 172.21.15.123:0/3838248743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd124147510 0x7fd12413f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.298+0000 7fd128d80700 1 -- 172.21.15.123:0/3838248743 >> 172.21.15.123:0/3838248743 conn(0x7fd1240ba3c0 msgr2=0x7fd1240b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.298+0000 7fd128d80700 1 -- 172.21.15.123:0/3838248743 shutdown_connections 2023-03-08T15:49:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.298+0000 7fd128d80700 1 -- 172.21.15.123:0/3838248743 wait complete. 2023-03-08T15:49:58.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-08T15:49:26.011228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-08T15:49:32.528343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-08T15:49:37.104720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-08T15:49:38.431537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-08T15:49:58.312 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-08T15:49:58.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.433+0000 7f5003448700 1 Processor -- start 2023-03-08T15:49:58.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.434+0000 7f5003448700 1 -- start start 2023-03-08T15:49:58.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.434+0000 7f5003448700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ffc0ba280 0x7f4ffc06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.434+0000 7f5003448700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ffc071df0 0x7f4ffc14aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.434+0000 7f5003448700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ffc070670 con 0x7f4ffc072760 2023-03-08T15:49:58.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.434+0000 7f5003448700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ffc070a40 con 0x7f4ffc071df0 2023-03-08T15:49:58.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.434+0000 7f5003448700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc070c50 con 0x7f4ffc0ba280 2023-03-08T15:49:58.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.435+0000 7f50011e4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ffc0ba280 0x7f4ffc06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.435+0000 7f50019e5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ffc071df0 0x7f4ffc14aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.435+0000 7f50019e5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ffc071df0 0x7f4ffc14aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:45450/0 (socket says 172.21.15.123:45450) 2023-03-08T15:49:58.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.435+0000 7f50011e4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ffc0ba280 0x7f4ffc06fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:40938/0 (socket says 172.21.15.123:40938) 2023-03-08T15:49:58.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.435+0000 7f50019e5700 1 -- 172.21.15.123:0/3365619776 learned_addr learned my addr 172.21.15.123:0/3365619776 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:58.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.435+0000 7f50009e3700 1 --1- 172.21.15.123:0/3365619776 >> v1:172.21.15.175:6789/0 conn(0x7f4ffc072760 0x7f4ffc141480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.123:47240/0 (socket says 172.21.15.123:47240) 2023-03-08T15:49:58.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.435+0000 7f50011e4700 1 -- 172.21.15.123:0/3365619776 >> v2:172.21.15.175:3300/0 conn(0x7f4ffc071df0 msgr2=0x7f4ffc14aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:58.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.435+0000 7f50011e4700 1 --2- 172.21.15.123:0/3365619776 >> v2:172.21.15.175:3300/0 conn(0x7f4ffc071df0 0x7f4ffc14aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.435+0000 7f50011e4700 1 -- 172.21.15.123:0/3365619776 >> v1:172.21.15.175:6789/0 conn(0x7f4ffc072760 legacy=0x7f4ffc141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.435+0000 7f50011e4700 1 -- 172.21.15.123:0/3365619776 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc0ba650 con 0x7f4ffc0ba280 2023-03-08T15:49:58.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.435+0000 7f50019e5700 1 --2- 172.21.15.123:0/3365619776 >> v2:172.21.15.175:3300/0 conn(0x7f4ffc071df0 0x7f4ffc14aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:58.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.435+0000 7f50011e4700 1 --2- 172.21.15.123:0/3365619776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ffc0ba280 0x7f4ffc06fff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009840 tx=0x7f4ff4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff128589b5b40fab server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:58.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.435+0000 7f4ffbfff700 1 -- 172.21.15.123:0/3365619776 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4011830 con 0x7f4ffc0ba280 2023-03-08T15:49:58.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.435+0000 7f4ffbfff700 1 -- 172.21.15.123:0/3365619776 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff4011990 con 0x7f4ffc0ba280 2023-03-08T15:49:58.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.435+0000 7f4ffbfff700 1 -- 172.21.15.123:0/3365619776 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4011d20 con 0x7f4ffc0ba280 2023-03-08T15:49:58.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.436+0000 7f5003448700 1 -- 172.21.15.123:0/3365619776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ffc0ba280 msgr2=0x7f4ffc06fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.436+0000 7f5003448700 1 --2- 172.21.15.123:0/3365619776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ffc0ba280 0x7f4ffc06fff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009840 tx=0x7f4ff4009b50 comp rx=0 tx=0).stop 2023-03-08T15:49:58.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.436+0000 7f5003448700 1 -- 172.21.15.123:0/3365619776 shutdown_connections 2023-03-08T15:49:58.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.436+0000 7f5003448700 1 --2- 172.21.15.123:0/3365619776 >> v2:172.21.15.175:3300/0 conn(0x7f4ffc071df0 0x7f4ffc14aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.436+0000 7f5003448700 1 --2- 172.21.15.123:0/3365619776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ffc0ba280 0x7f4ffc06fff0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.436+0000 7f5003448700 1 -- 172.21.15.123:0/3365619776 >> 172.21.15.123:0/3365619776 conn(0x7f4ffc06b360 msgr2=0x7f4ffc06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:58.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.436+0000 7f5003448700 1 -- 172.21.15.123:0/3365619776 shutdown_connections 2023-03-08T15:49:58.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.436+0000 7f5003448700 1 -- 172.21.15.123:0/3365619776 wait complete. 2023-03-08T15:49:58.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.437+0000 7f5003448700 1 Processor -- start 2023-03-08T15:49:58.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.437+0000 7f5003448700 1 -- start start 2023-03-08T15:49:58.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f5003448700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ffc071df0 0x7f4ffc0b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f5003448700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ffc0ba280 0x7f4ffc141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f5003448700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ffc1423f0 0x7f4ffc13a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f5003448700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc0b7260 con 0x7f4ffc071df0 2023-03-08T15:49:58.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f5003448700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc0bdb70 con 0x7f4ffc0ba280 2023-03-08T15:49:58.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f5003448700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc0bd410 con 0x7f4ffc1423f0 2023-03-08T15:49:58.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f50011e4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ffc071df0 0x7f4ffc0b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f50011e4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ffc071df0 0x7f4ffc0b6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41786/0 (socket says 172.21.15.123:41786) 2023-03-08T15:49:58.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f50011e4700 1 -- 172.21.15.123:0/1400118645 learned_addr learned my addr 172.21.15.123:0/1400118645 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:58.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f50009e3700 1 --2- 172.21.15.123:0/1400118645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ffc0ba280 0x7f4ffc141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f50019e5700 1 --2- 172.21.15.123:0/1400118645 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ffc1423f0 0x7f4ffc13a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f50011e4700 1 -- 172.21.15.123:0/1400118645 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ffc1423f0 msgr2=0x7f4ffc13a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f50011e4700 1 --2- 172.21.15.123:0/1400118645 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ffc1423f0 0x7f4ffc13a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f50011e4700 1 -- 172.21.15.123:0/1400118645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ffc0ba280 msgr2=0x7f4ffc141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f50011e4700 1 --2- 172.21.15.123:0/1400118645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ffc0ba280 0x7f4ffc141eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f50011e4700 1 -- 172.21.15.123:0/1400118645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec009b30 con 0x7f4ffc071df0 2023-03-08T15:49:58.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f50011e4700 1 --2- 172.21.15.123:0/1400118645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ffc071df0 0x7f4ffc0b6d20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4014040 tx=0x7f4ff4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:58.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f4ff9ffb700 1 -- 172.21.15.123:0/1400118645 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff40036a0 con 0x7f4ffc071df0 2023-03-08T15:49:58.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f4ff9ffb700 1 -- 172.21.15.123:0/1400118645 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff401f070 con 0x7f4ffc071df0 2023-03-08T15:49:58.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f5003448700 1 -- 172.21.15.123:0/1400118645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff40094a0 con 0x7f4ffc071df0 2023-03-08T15:49:58.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.438+0000 7f4ff9ffb700 1 -- 172.21.15.123:0/1400118645 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4003a20 con 0x7f4ffc071df0 2023-03-08T15:49:58.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.439+0000 7f5003448700 1 -- 172.21.15.123:0/1400118645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ffc141d20 con 0x7f4ffc071df0 2023-03-08T15:49:58.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.440+0000 7f5003448700 1 -- 172.21.15.123:0/1400118645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ffc141b90 con 0x7f4ffc071df0 2023-03-08T15:49:58.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.440+0000 7f4ff9ffb700 1 -- 172.21.15.123:0/1400118645 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f4ff400f050 con 0x7f4ffc071df0 2023-03-08T15:49:58.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.440+0000 7f4ff9ffb700 1 --2- 172.21.15.123:0/1400118645 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f4fe80698d0 0x7f4fe806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.440+0000 7f4ff9ffb700 1 -- 172.21.15.123:0/1400118645 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ff4021070 con 0x7f4ffc071df0 2023-03-08T15:49:58.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.440+0000 7f50009e3700 1 --2- 172.21.15.123:0/1400118645 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f4fe80698d0 0x7f4fe806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.441+0000 7f50009e3700 1 --2- 172.21.15.123:0/1400118645 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f4fe80698d0 0x7f4fe806bd80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc140d20 tx=0x7f4ff0007ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:58.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.444+0000 7f4ff9ffb700 1 -- 172.21.15.123:0/1400118645 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f4ff4054b80 con 0x7f4ffc071df0 2023-03-08T15:49:58.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.630+0000 7f5003448700 1 -- 172.21.15.123:0/1400118645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ffc14aff0 con 0x7f4ffc071df0 2023-03-08T15:49:58.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.631+0000 7f4ff9ffb700 1 -- 172.21.15.123:0/1400118645 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ff40150a0 con 0x7f4ffc071df0 2023-03-08T15:49:58.633 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-03-08T15:49:58.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.633+0000 7f5003448700 1 -- 172.21.15.123:0/1400118645 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f4fe80698d0 msgr2=0x7f4fe806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.633+0000 7f5003448700 1 --2- 172.21.15.123:0/1400118645 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f4fe80698d0 0x7f4fe806bd80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc140d20 tx=0x7f4ff0007ed0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.633+0000 7f5003448700 1 -- 172.21.15.123:0/1400118645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ffc071df0 msgr2=0x7f4ffc0b6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.633+0000 7f5003448700 1 --2- 172.21.15.123:0/1400118645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ffc071df0 0x7f4ffc0b6d20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4014040 tx=0x7f4ff4004750 comp rx=0 tx=0).stop 2023-03-08T15:49:58.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.633+0000 7f5003448700 1 -- 172.21.15.123:0/1400118645 shutdown_connections 2023-03-08T15:49:58.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.633+0000 7f5003448700 1 --2- 172.21.15.123:0/1400118645 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f4fe80698d0 0x7f4fe806bd80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.633+0000 7f5003448700 1 --2- 172.21.15.123:0/1400118645 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ffc1423f0 0x7f4ffc13a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.633+0000 7f5003448700 1 --2- 172.21.15.123:0/1400118645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ffc071df0 0x7f4ffc0b6d20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.633+0000 7f5003448700 1 --2- 172.21.15.123:0/1400118645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ffc0ba280 0x7f4ffc141eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.633+0000 7f5003448700 1 -- 172.21.15.123:0/1400118645 >> 172.21.15.123:0/1400118645 conn(0x7f4ffc06b360 msgr2=0x7f4ffc13ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:58.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.633+0000 7f5003448700 1 -- 172.21.15.123:0/1400118645 shutdown_connections 2023-03-08T15:49:58.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.633+0000 7f5003448700 1 -- 172.21.15.123:0/1400118645 wait complete. 2023-03-08T15:49:58.646 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-08T15:49:58.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.768+0000 7fb38256f700 1 Processor -- start 2023-03-08T15:49:58.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.768+0000 7fb38256f700 1 -- start start 2023-03-08T15:49:58.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb38256f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb37c072760 0x7fb37c06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb38256f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb37c071df0 0x7fb37c14aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb38256f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37c070670 con 0x7fb37c0ba280 2023-03-08T15:49:58.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb38256f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37c070a40 con 0x7fb37c072760 2023-03-08T15:49:58.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb38256f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37c070c50 con 0x7fb37c071df0 2023-03-08T15:49:58.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb37b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb37c072760 0x7fb37c06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb37bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb37c0ba280 0x7fb37c141480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42360/0 (socket says 172.21.15.123:42360) 2023-03-08T15:49:58.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb37bfff700 1 -- 172.21.15.123:0/3480688504 learned_addr learned my addr 172.21.15.123:0/3480688504 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:58.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb380b0c700 1 --2- 172.21.15.123:0/3480688504 >> v2:172.21.15.175:3300/0 conn(0x7fb37c071df0 0x7fb37c14aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb37affd700 1 -- 172.21.15.123:0/3480688504 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189557634 0 0) 0x7fb37c070670 con 0x7fb37c0ba280 2023-03-08T15:49:58.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb37affd700 1 -- 172.21.15.123:0/3480688504 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3640035b0 con 0x7fb37c0ba280 2023-03-08T15:49:58.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb37b7fe700 1 -- 172.21.15.123:0/3480688504 >> v2:172.21.15.175:3300/0 conn(0x7fb37c071df0 msgr2=0x7fb37c14aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:58.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb37b7fe700 1 --2- 172.21.15.123:0/3480688504 >> v2:172.21.15.175:3300/0 conn(0x7fb37c071df0 0x7fb37c14aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb37b7fe700 1 -- 172.21.15.123:0/3480688504 >> v1:172.21.15.123:6789/0 conn(0x7fb37c0ba280 legacy=0x7fb37c141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb37b7fe700 1 -- 172.21.15.123:0/3480688504 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c0ba650 con 0x7fb37c072760 2023-03-08T15:49:58.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb37b7fe700 1 --2- 172.21.15.123:0/3480688504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb37c072760 0x7fb37c06fff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0b99e0 tx=0x7fb36c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3529b12233b2954e server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:58.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb37affd700 1 -- 172.21.15.123:0/3480688504 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c011830 con 0x7fb37c072760 2023-03-08T15:49:58.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb37affd700 1 -- 172.21.15.123:0/3480688504 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36c011990 con 0x7fb37c072760 2023-03-08T15:49:58.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.769+0000 7fb37affd700 1 -- 172.21.15.123:0/3480688504 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c011d20 con 0x7fb37c072760 2023-03-08T15:49:58.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.770+0000 7fb38256f700 1 -- 172.21.15.123:0/3480688504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb37c072760 msgr2=0x7fb37c06fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.770+0000 7fb38256f700 1 --2- 172.21.15.123:0/3480688504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb37c072760 0x7fb37c06fff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0b99e0 tx=0x7fb36c009b20 comp rx=0 tx=0).stop 2023-03-08T15:49:58.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.770+0000 7fb38256f700 1 -- 172.21.15.123:0/3480688504 shutdown_connections 2023-03-08T15:49:58.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.770+0000 7fb38256f700 1 --2- 172.21.15.123:0/3480688504 >> v2:172.21.15.175:3300/0 conn(0x7fb37c071df0 0x7fb37c14aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.770+0000 7fb38256f700 1 --2- 172.21.15.123:0/3480688504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb37c072760 0x7fb37c06fff0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.770+0000 7fb38256f700 1 -- 172.21.15.123:0/3480688504 >> 172.21.15.123:0/3480688504 conn(0x7fb37c06b360 msgr2=0x7fb37c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:58.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.770+0000 7fb38256f700 1 -- 172.21.15.123:0/3480688504 shutdown_connections 2023-03-08T15:49:58.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.770+0000 7fb38256f700 1 -- 172.21.15.123:0/3480688504 wait complete. 2023-03-08T15:49:58.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.771+0000 7fb38256f700 1 Processor -- start 2023-03-08T15:49:58.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.771+0000 7fb38256f700 1 -- start start 2023-03-08T15:49:58.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb38256f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb37c071df0 0x7fb37c1386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb38256f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb37c0ba280 0x7fb37c1359c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb38256f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb37c0b7760 0x7fb37c146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb38256f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c138c20 con 0x7fb37c071df0 2023-03-08T15:49:58.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb38256f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c0b70f0 con 0x7fb37c0ba280 2023-03-08T15:49:58.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb38256f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c147b70 con 0x7fb37c0b7760 2023-03-08T15:49:58.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb37bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb37c071df0 0x7fb37c1386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb37bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb37c071df0 0x7fb37c1386e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41812/0 (socket says 172.21.15.123:41812) 2023-03-08T15:49:58.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb37bfff700 1 -- 172.21.15.123:0/1520282071 learned_addr learned my addr 172.21.15.123:0/1520282071 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:58.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb37b7fe700 1 --2- 172.21.15.123:0/1520282071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb37c0ba280 0x7fb37c1359c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb380b0c700 1 --2- 172.21.15.123:0/1520282071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb37c0b7760 0x7fb37c146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb37bfff700 1 -- 172.21.15.123:0/1520282071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb37c0b7760 msgr2=0x7fb37c146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb37bfff700 1 --2- 172.21.15.123:0/1520282071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb37c0b7760 0x7fb37c146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb37bfff700 1 -- 172.21.15.123:0/1520282071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb37c0ba280 msgr2=0x7fb37c1359c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb37bfff700 1 --2- 172.21.15.123:0/1520282071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb37c0ba280 0x7fb37c1359c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb37bfff700 1 -- 172.21.15.123:0/1520282071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c0094a0 con 0x7fb37c071df0 2023-03-08T15:49:58.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb380b0c700 1 --2- 172.21.15.123:0/1520282071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb37c0b7760 0x7fb37c146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:58.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb37bfff700 1 --2- 172.21.15.123:0/1520282071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb37c071df0 0x7fb37c1386e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb37000c4d0 tx=0x7fb37000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:58.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb378ff9700 1 -- 172.21.15.123:0/1520282071 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370005d70 con 0x7fb37c071df0 2023-03-08T15:49:58.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb378ff9700 1 -- 172.21.15.123:0/1520282071 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3700070d0 con 0x7fb37c071df0 2023-03-08T15:49:58.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb38256f700 1 -- 172.21.15.123:0/1520282071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37c141d20 con 0x7fb37c071df0 2023-03-08T15:49:58.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb378ff9700 1 -- 172.21.15.123:0/1520282071 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370007460 con 0x7fb37c071df0 2023-03-08T15:49:58.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.772+0000 7fb38256f700 1 -- 172.21.15.123:0/1520282071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37c141b90 con 0x7fb37c071df0 2023-03-08T15:49:58.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.773+0000 7fb38256f700 1 -- 172.21.15.123:0/1520282071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37c14aff0 con 0x7fb37c071df0 2023-03-08T15:49:58.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.774+0000 7fb378ff9700 1 -- 172.21.15.123:0/1520282071 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fb370019030 con 0x7fb37c071df0 2023-03-08T15:49:58.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.774+0000 7fb378ff9700 1 --2- 172.21.15.123:0/1520282071 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb3680698d0 0x7fb36806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:58.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.774+0000 7fb378ff9700 1 -- 172.21.15.123:0/1520282071 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb3700869e0 con 0x7fb37c071df0 2023-03-08T15:49:58.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.774+0000 7fb37b7fe700 1 --2- 172.21.15.123:0/1520282071 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb3680698d0 0x7fb36806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:58.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.775+0000 7fb37b7fe700 1 --2- 172.21.15.123:0/1520282071 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb3680698d0 0x7fb36806bd80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb37c06f9c0 tx=0x7fb36c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:58.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.778+0000 7fb378ff9700 1 -- 172.21.15.123:0/1520282071 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fb370052720 con 0x7fb37c071df0 2023-03-08T15:49:58.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.965+0000 7fb38256f700 1 -- 172.21.15.123:0/1520282071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb37c0717c0 con 0x7fb37c071df0 2023-03-08T15:49:58.967 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.965+0000 7fb378ff9700 1 -- 172.21.15.123:0/1520282071 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb370017020 con 0x7fb37c071df0 2023-03-08T15:49:58.967 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-03-08T15:49:58.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.967+0000 7fb38256f700 1 -- 172.21.15.123:0/1520282071 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb3680698d0 msgr2=0x7fb36806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.967+0000 7fb38256f700 1 --2- 172.21.15.123:0/1520282071 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb3680698d0 0x7fb36806bd80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb37c06f9c0 tx=0x7fb36c008030 comp rx=0 tx=0).stop 2023-03-08T15:49:58.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.967+0000 7fb38256f700 1 -- 172.21.15.123:0/1520282071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb37c071df0 msgr2=0x7fb37c1386e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:58.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.967+0000 7fb38256f700 1 --2- 172.21.15.123:0/1520282071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb37c071df0 0x7fb37c1386e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb37000c4d0 tx=0x7fb37000c7e0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.969 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.967+0000 7fb38256f700 1 -- 172.21.15.123:0/1520282071 shutdown_connections 2023-03-08T15:49:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.967+0000 7fb38256f700 1 --2- 172.21.15.123:0/1520282071 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb3680698d0 0x7fb36806bd80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.967+0000 7fb38256f700 1 --2- 172.21.15.123:0/1520282071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb37c0b7760 0x7fb37c146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.967+0000 7fb38256f700 1 --2- 172.21.15.123:0/1520282071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb37c071df0 0x7fb37c1386e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.967+0000 7fb38256f700 1 --2- 172.21.15.123:0/1520282071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb37c0ba280 0x7fb37c1359c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.967+0000 7fb38256f700 1 -- 172.21.15.123:0/1520282071 >> 172.21.15.123:0/1520282071 conn(0x7fb37c06b360 msgr2=0x7fb37c13f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.967+0000 7fb38256f700 1 -- 172.21.15.123:0/1520282071 shutdown_connections 2023-03-08T15:49:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:58.967+0000 7fb38256f700 1 -- 172.21.15.123:0/1520282071 wait complete. 2023-03-08T15:49:58.980 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-08T15:49:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.103+0000 7fb8ba1a1700 1 Processor -- start 2023-03-08T15:49:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.103+0000 7fb8ba1a1700 1 -- start start 2023-03-08T15:49:59.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.103+0000 7fb8ba1a1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8b40bb350 0x7fb8b41446b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.103+0000 7fb8ba1a1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b4144bf0 0x7fb8b40bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.103+0000 7fb8ba1a1700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b414dc00 con 0x7fb8b40be1f0 2023-03-08T15:49:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.103+0000 7fb8ba1a1700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b406bb70 con 0x7fb8b40bb350 2023-03-08T15:49:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.103+0000 7fb8ba1a1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40b9fc0 con 0x7fb8b4144bf0 2023-03-08T15:49:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.103+0000 7fb8b3fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb8b40be1f0 0x7fb8b414e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42362/0 (socket says 172.21.15.123:42362) 2023-03-08T15:49:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.103+0000 7fb8b3fff700 1 -- 172.21.15.123:0/376255183 learned_addr learned my addr 172.21.15.123:0/376255183 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.104+0000 7fb8b37fe700 1 --2- 172.21.15.123:0/376255183 >> v2:172.21.15.175:3300/0 conn(0x7fb8b40bb350 0x7fb8b41446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.104+0000 7fb8b2ffd700 1 --2- 172.21.15.123:0/376255183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b4144bf0 0x7fb8b40bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.104+0000 7fb8b27fc700 1 -- 172.21.15.123:0/376255183 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783946300 0 0) 0x7fb8b414dc00 con 0x7fb8b40be1f0 2023-03-08T15:49:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.104+0000 7fb8b27fc700 1 -- 172.21.15.123:0/376255183 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb89c0035b0 con 0x7fb8b40be1f0 2023-03-08T15:49:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.104+0000 7fb8b37fe700 1 -- 172.21.15.123:0/376255183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b4144bf0 msgr2=0x7fb8b40bdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.104+0000 7fb8b37fe700 1 --2- 172.21.15.123:0/376255183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b4144bf0 0x7fb8b40bdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.104+0000 7fb8b37fe700 1 -- 172.21.15.123:0/376255183 >> v1:172.21.15.123:6789/0 conn(0x7fb8b40be1f0 legacy=0x7fb8b414e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.104+0000 7fb8b37fe700 1 -- 172.21.15.123:0/376255183 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b40ba2a0 con 0x7fb8b40bb350 2023-03-08T15:49:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.104+0000 7fb8b2ffd700 1 --2- 172.21.15.123:0/376255183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b4144bf0 0x7fb8b40bdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.104+0000 7fb8b37fe700 1 --2- 172.21.15.123:0/376255183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8b40bb350 0x7fb8b41446b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009840 tx=0x7fb8a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2829adbaf027e5e server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.104+0000 7fb8b27fc700 1 -- 172.21.15.123:0/376255183 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4011830 con 0x7fb8b40bb350 2023-03-08T15:49:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.104+0000 7fb8b27fc700 1 -- 172.21.15.123:0/376255183 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a4011990 con 0x7fb8b40bb350 2023-03-08T15:49:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.104+0000 7fb8b27fc700 1 -- 172.21.15.123:0/376255183 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4011d00 con 0x7fb8b40bb350 2023-03-08T15:49:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.105+0000 7fb8ba1a1700 1 -- 172.21.15.123:0/376255183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8b40bb350 msgr2=0x7fb8b41446b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.105+0000 7fb8ba1a1700 1 --2- 172.21.15.123:0/376255183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8b40bb350 0x7fb8b41446b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009840 tx=0x7fb8a4009b50 comp rx=0 tx=0).stop 2023-03-08T15:49:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.105+0000 7fb8ba1a1700 1 -- 172.21.15.123:0/376255183 shutdown_connections 2023-03-08T15:49:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.105+0000 7fb8ba1a1700 1 --2- 172.21.15.123:0/376255183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8b40bb350 0x7fb8b41446b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.105+0000 7fb8ba1a1700 1 --2- 172.21.15.123:0/376255183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b4144bf0 0x7fb8b40bdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.105+0000 7fb8ba1a1700 1 -- 172.21.15.123:0/376255183 >> 172.21.15.123:0/376255183 conn(0x7fb8b406a250 msgr2=0x7fb8b406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.105+0000 7fb8ba1a1700 1 -- 172.21.15.123:0/376255183 shutdown_connections 2023-03-08T15:49:59.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.105+0000 7fb8ba1a1700 1 -- 172.21.15.123:0/376255183 wait complete. 2023-03-08T15:49:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.106+0000 7fb8ba1a1700 1 Processor -- start 2023-03-08T15:49:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.106+0000 7fb8ba1a1700 1 -- start start 2023-03-08T15:49:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.106+0000 7fb8ba1a1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8b40bb350 0x7fb8b4139cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.106+0000 7fb8ba1a1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8b40be1f0 0x7fb8b41dff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.106+0000 7fb8ba1a1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b4144bf0 0x7fb8b41e0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.106+0000 7fb8ba1a1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b413a1f0 con 0x7fb8b40be1f0 2023-03-08T15:49:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.106+0000 7fb8ba1a1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b41e3780 con 0x7fb8b40bb350 2023-03-08T15:49:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.106+0000 7fb8ba1a1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b41e3a60 con 0x7fb8b4144bf0 2023-03-08T15:49:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb8b2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8b40be1f0 0x7fb8b41dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb8b2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8b40be1f0 0x7fb8b41dff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41828/0 (socket says 172.21.15.123:41828) 2023-03-08T15:49:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb8b2ffd700 1 -- 172.21.15.123:0/573497428 learned_addr learned my addr 172.21.15.123:0/573497428 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:59.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb8b37fe700 1 --2- 172.21.15.123:0/573497428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8b40bb350 0x7fb8b4139cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb8b3fff700 1 --2- 172.21.15.123:0/573497428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b4144bf0 0x7fb8b41e0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb8b2ffd700 1 -- 172.21.15.123:0/573497428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b4144bf0 msgr2=0x7fb8b41e0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb8b2ffd700 1 --2- 172.21.15.123:0/573497428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b4144bf0 0x7fb8b41e0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb8b2ffd700 1 -- 172.21.15.123:0/573497428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8b40bb350 msgr2=0x7fb8b4139cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb8b2ffd700 1 --2- 172.21.15.123:0/573497428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8b40bb350 0x7fb8b4139cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb8b2ffd700 1 -- 172.21.15.123:0/573497428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a80094a0 con 0x7fb8b40be1f0 2023-03-08T15:49:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb8b3fff700 1 --2- 172.21.15.123:0/573497428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b4144bf0 0x7fb8b41e0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:49:59.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb8b2ffd700 1 --2- 172.21.15.123:0/573497428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8b40be1f0 0x7fb8b41dff30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800ebe0 tx=0x7fb8a800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb89bfff700 1 -- 172.21.15.123:0/573497428 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a800c850 con 0x7fb8b40be1f0 2023-03-08T15:49:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb89bfff700 1 -- 172.21.15.123:0/573497428 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a800c9b0 con 0x7fb8b40be1f0 2023-03-08T15:49:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb8ba1a1700 1 -- 172.21.15.123:0/573497428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a40094a0 con 0x7fb8b40be1f0 2023-03-08T15:49:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb89bfff700 1 -- 172.21.15.123:0/573497428 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a800cd40 con 0x7fb8b40be1f0 2023-03-08T15:49:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.107+0000 7fb8ba1a1700 1 -- 172.21.15.123:0/573497428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b40bb720 con 0x7fb8b40be1f0 2023-03-08T15:49:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.108+0000 7fb8ba1a1700 1 -- 172.21.15.123:0/573497428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b40ba580 con 0x7fb8b40be1f0 2023-03-08T15:49:59.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.109+0000 7fb89bfff700 1 -- 172.21.15.123:0/573497428 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fb8a8019030 con 0x7fb8b40be1f0 2023-03-08T15:49:59.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.109+0000 7fb89bfff700 1 --2- 172.21.15.123:0/573497428 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb8a00698d0 0x7fb8a006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.109+0000 7fb89bfff700 1 -- 172.21.15.123:0/573497428 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb8a8087600 con 0x7fb8b40be1f0 2023-03-08T15:49:59.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.109+0000 7fb8b37fe700 1 --2- 172.21.15.123:0/573497428 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb8a00698d0 0x7fb8a006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.109+0000 7fb8b37fe700 1 --2- 172.21.15.123:0/573497428 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb8a00698d0 0x7fb8a006bd80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009fd0 tx=0x7fb8a4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:59.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.113+0000 7fb89bfff700 1 -- 172.21.15.123:0/573497428 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fb8a8053340 con 0x7fb8b40be1f0 2023-03-08T15:49:59.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.296+0000 7fb8ba1a1700 1 -- 172.21.15.123:0/573497428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8b414e7a0 con 0x7fb8b40be1f0 2023-03-08T15:49:59.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.297+0000 7fb89bfff700 1 -- 172.21.15.123:0/573497428 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8a800cea0 con 0x7fb8b40be1f0 2023-03-08T15:49:59.299 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-03-08T15:49:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.299+0000 7fb8ba1a1700 1 -- 172.21.15.123:0/573497428 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb8a00698d0 msgr2=0x7fb8a006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.299+0000 7fb8ba1a1700 1 --2- 172.21.15.123:0/573497428 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb8a00698d0 0x7fb8a006bd80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009fd0 tx=0x7fb8a4008030 comp rx=0 tx=0).stop 2023-03-08T15:49:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.299+0000 7fb8ba1a1700 1 -- 172.21.15.123:0/573497428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8b40be1f0 msgr2=0x7fb8b41dff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.299+0000 7fb8ba1a1700 1 --2- 172.21.15.123:0/573497428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8b40be1f0 0x7fb8b41dff30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800ebe0 tx=0x7fb8a800eef0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.299+0000 7fb8ba1a1700 1 -- 172.21.15.123:0/573497428 shutdown_connections 2023-03-08T15:49:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.299+0000 7fb8ba1a1700 1 --2- 172.21.15.123:0/573497428 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb8a00698d0 0x7fb8a006bd80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.299+0000 7fb8ba1a1700 1 --2- 172.21.15.123:0/573497428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8b4144bf0 0x7fb8b41e0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.299+0000 7fb8ba1a1700 1 --2- 172.21.15.123:0/573497428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8b40bb350 0x7fb8b4139cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.299+0000 7fb8ba1a1700 1 --2- 172.21.15.123:0/573497428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8b40be1f0 0x7fb8b41dff30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.299+0000 7fb8ba1a1700 1 -- 172.21.15.123:0/573497428 >> 172.21.15.123:0/573497428 conn(0x7fb8b406a250 msgr2=0x7fb8b406c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.299+0000 7fb8ba1a1700 1 -- 172.21.15.123:0/573497428 shutdown_connections 2023-03-08T15:49:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.299+0000 7fb8ba1a1700 1 -- 172.21.15.123:0/573497428 wait complete. 2023-03-08T15:49:59.312 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-08T15:49:59.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.433+0000 7f49375f1700 1 Processor -- start 2023-03-08T15:49:59.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.433+0000 7f49375f1700 1 -- start start 2023-03-08T15:49:59.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.434+0000 7f49375f1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49300b6a00 0x7f493006b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.434+0000 7f49375f1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f49300b3c50 0x7f4930148970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.434+0000 7f49375f1700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49300bd420 con 0x7f4930148eb0 2023-03-08T15:49:59.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.434+0000 7f49375f1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4930142cc0 con 0x7f49300b3c50 2023-03-08T15:49:59.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.434+0000 7f49375f1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4930148520 con 0x7f49300b6a00 2023-03-08T15:49:59.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.434+0000 7f4934b8c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f49300b3c50 0x7f4930148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.434+0000 7f4934b8c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f49300b3c50 0x7f4930148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41838/0 (socket says 172.21.15.123:41838) 2023-03-08T15:49:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.434+0000 7f4934b8c700 1 -- 172.21.15.123:0/3740960881 learned_addr learned my addr 172.21.15.123:0/3740960881 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.434+0000 7f493538d700 1 --2- 172.21.15.123:0/3740960881 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49300b6a00 0x7f493006b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.434+0000 7f4934b8c700 1 -- 172.21.15.123:0/3740960881 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49300b6a00 msgr2=0x7f493006b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.434+0000 7f4934b8c700 1 --2- 172.21.15.123:0/3740960881 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49300b6a00 0x7f493006b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.434+0000 7f4934b8c700 1 -- 172.21.15.123:0/3740960881 >> v1:172.21.15.175:6789/0 conn(0x7f4930148eb0 legacy=0x7f493014ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.434+0000 7f4934b8c700 1 -- 172.21.15.123:0/3740960881 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4930071cd0 con 0x7f49300b3c50 2023-03-08T15:49:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.435+0000 7f4934b8c700 1 --2- 172.21.15.123:0/3740960881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49300b3c50 0x7f4930148970 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098f0 tx=0x7f492c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531d01dc5e57bb17 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.435+0000 7f4927fff700 1 -- 172.21.15.123:0/3740960881 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c011830 con 0x7f49300b3c50 2023-03-08T15:49:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.435+0000 7f4927fff700 1 -- 172.21.15.123:0/3740960881 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c011990 con 0x7f49300b3c50 2023-03-08T15:49:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.435+0000 7f4927fff700 1 -- 172.21.15.123:0/3740960881 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c011d20 con 0x7f49300b3c50 2023-03-08T15:49:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.435+0000 7f49375f1700 1 -- 172.21.15.123:0/3740960881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49300b3c50 msgr2=0x7f4930148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.435+0000 7f49375f1700 1 --2- 172.21.15.123:0/3740960881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49300b3c50 0x7f4930148970 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098f0 tx=0x7f492c009c00 comp rx=0 tx=0).stop 2023-03-08T15:49:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.435+0000 7f49375f1700 1 -- 172.21.15.123:0/3740960881 shutdown_connections 2023-03-08T15:49:59.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.435+0000 7f49375f1700 1 --2- 172.21.15.123:0/3740960881 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49300b6a00 0x7f493006b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.435+0000 7f49375f1700 1 --2- 172.21.15.123:0/3740960881 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49300b3c50 0x7f4930148970 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.435+0000 7f49375f1700 1 -- 172.21.15.123:0/3740960881 >> 172.21.15.123:0/3740960881 conn(0x7f49300ba3c0 msgr2=0x7f49300bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.435+0000 7f49375f1700 1 -- 172.21.15.123:0/3740960881 shutdown_connections 2023-03-08T15:49:59.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.435+0000 7f49375f1700 1 -- 172.21.15.123:0/3740960881 wait complete. 2023-03-08T15:49:59.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.436+0000 7f49375f1700 1 Processor -- start 2023-03-08T15:49:59.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.436+0000 7f49375f1700 1 -- start start 2023-03-08T15:49:59.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f49375f1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49300b3c50 0x7f4930140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f49375f1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49300b6a00 0x7f4930145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f49375f1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4930148eb0 0x7f49301e1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f49375f1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4930144780 con 0x7f49300b6a00 2023-03-08T15:49:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f49375f1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49301449e0 con 0x7f49300b3c50 2023-03-08T15:49:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f49375f1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4930144cc0 con 0x7f4930148eb0 2023-03-08T15:49:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f4934b8c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49300b6a00 0x7f4930145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f4934b8c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49300b6a00 0x7f4930145640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41852/0 (socket says 172.21.15.123:41852) 2023-03-08T15:49:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f4934b8c700 1 -- 172.21.15.123:0/3832397323 learned_addr learned my addr 172.21.15.123:0/3832397323 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f493538d700 1 --2- 172.21.15.123:0/3832397323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49300b3c50 0x7f4930140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f4935b8e700 1 --2- 172.21.15.123:0/3832397323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4930148eb0 0x7f49301e1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f4934b8c700 1 -- 172.21.15.123:0/3832397323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4930148eb0 msgr2=0x7f49301e1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f4934b8c700 1 --2- 172.21.15.123:0/3832397323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4930148eb0 0x7f49301e1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f4934b8c700 1 -- 172.21.15.123:0/3832397323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49300b3c50 msgr2=0x7f4930140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f4934b8c700 1 --2- 172.21.15.123:0/3832397323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49300b3c50 0x7f4930140fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.437+0000 7f4934b8c700 1 -- 172.21.15.123:0/3832397323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c009550 con 0x7f49300b6a00 2023-03-08T15:49:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.438+0000 7f4934b8c700 1 --2- 172.21.15.123:0/3832397323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49300b6a00 0x7f4930145640 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f492c000c00 tx=0x7f492c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.438+0000 7f4925ffb700 1 -- 172.21.15.123:0/3832397323 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c004400 con 0x7f49300b6a00 2023-03-08T15:49:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.438+0000 7f4925ffb700 1 -- 172.21.15.123:0/3832397323 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c01f070 con 0x7f49300b6a00 2023-03-08T15:49:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.438+0000 7f49375f1700 1 -- 172.21.15.123:0/3832397323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49300bd670 con 0x7f49300b6a00 2023-03-08T15:49:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.438+0000 7f4925ffb700 1 -- 172.21.15.123:0/3832397323 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c0038e0 con 0x7f49300b6a00 2023-03-08T15:49:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.438+0000 7f49375f1700 1 -- 172.21.15.123:0/3832397323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4930149310 con 0x7f49300b6a00 2023-03-08T15:49:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.439+0000 7f49375f1700 1 -- 172.21.15.123:0/3832397323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4930071f20 con 0x7f49300b6a00 2023-03-08T15:49:59.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.439+0000 7f4925ffb700 1 -- 172.21.15.123:0/3832397323 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f492c02a020 con 0x7f49300b6a00 2023-03-08T15:49:59.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.440+0000 7f4925ffb700 1 --2- 172.21.15.123:0/3832397323 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f49140698d0 0x7f491406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.440+0000 7f493538d700 1 --2- 172.21.15.123:0/3832397323 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f49140698d0 0x7f491406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.440+0000 7f4925ffb700 1 -- 172.21.15.123:0/3832397323 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f492c088b30 con 0x7f49300b6a00 2023-03-08T15:49:59.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.440+0000 7f493538d700 1 --2- 172.21.15.123:0/3832397323 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f49140698d0 0x7f491406bd80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4920009be0 tx=0x7f4920009210 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:59.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.444+0000 7f4925ffb700 1 -- 172.21.15.123:0/3832397323 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f492c054930 con 0x7f49300b6a00 2023-03-08T15:49:59.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.628+0000 7f49375f1700 1 -- 172.21.15.123:0/3832397323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4930145000 con 0x7f49300b6a00 2023-03-08T15:49:59.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.628+0000 7f4925ffb700 1 -- 172.21.15.123:0/3832397323 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f492c0150a0 con 0x7f49300b6a00 2023-03-08T15:49:59.630 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-03-08T15:49:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.630+0000 7f49375f1700 1 -- 172.21.15.123:0/3832397323 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f49140698d0 msgr2=0x7f491406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.630+0000 7f49375f1700 1 --2- 172.21.15.123:0/3832397323 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f49140698d0 0x7f491406bd80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4920009be0 tx=0x7f4920009210 comp rx=0 tx=0).stop 2023-03-08T15:49:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.630+0000 7f49375f1700 1 -- 172.21.15.123:0/3832397323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49300b6a00 msgr2=0x7f4930145640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.630+0000 7f49375f1700 1 --2- 172.21.15.123:0/3832397323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49300b6a00 0x7f4930145640 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f492c000c00 tx=0x7f492c004750 comp rx=0 tx=0).stop 2023-03-08T15:49:59.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.630+0000 7f49375f1700 1 -- 172.21.15.123:0/3832397323 shutdown_connections 2023-03-08T15:49:59.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.630+0000 7f49375f1700 1 --2- 172.21.15.123:0/3832397323 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f49140698d0 0x7f491406bd80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.630+0000 7f49375f1700 1 --2- 172.21.15.123:0/3832397323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4930148eb0 0x7f49301e1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.630+0000 7f49375f1700 1 --2- 172.21.15.123:0/3832397323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49300b3c50 0x7f4930140fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.630+0000 7f49375f1700 1 --2- 172.21.15.123:0/3832397323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49300b6a00 0x7f4930145640 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.630+0000 7f49375f1700 1 -- 172.21.15.123:0/3832397323 >> 172.21.15.123:0/3832397323 conn(0x7f49300ba3c0 msgr2=0x7f4930146320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:59.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.631+0000 7f49375f1700 1 -- 172.21.15.123:0/3832397323 shutdown_connections 2023-03-08T15:49:59.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.631+0000 7f49375f1700 1 -- 172.21.15.123:0/3832397323 wait complete. 2023-03-08T15:49:59.644 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:49:59.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.761+0000 7ff83501b700 1 Processor -- start 2023-03-08T15:49:59.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.761+0000 7ff83501b700 1 -- start start 2023-03-08T15:49:59.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff83501b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff8301446c0 0x7ff8300b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff83501b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8300b7fa0 con 0x7ff8300ba560 2023-03-08T15:49:59.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff83501b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8300b7130 con 0x7ff830144a90 2023-03-08T15:49:59.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff83501b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8300bdc90 con 0x7ff8301446c0 2023-03-08T15:49:59.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82f59e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff8300ba560 0x7ff830154f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42374/0 (socket says 172.21.15.123:42374) 2023-03-08T15:49:59.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82f59e700 1 -- 172.21.15.123:0/1514281586 learned_addr learned my addr 172.21.15.123:0/1514281586 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:49:59.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82dd9b700 1 -- 172.21.15.123:0/1514281586 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700985120 0 0) 0x7ff8300b7fa0 con 0x7ff8300ba560 2023-03-08T15:49:59.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82ed9d700 1 --2- 172.21.15.123:0/1514281586 >> v2:172.21.15.175:3300/0 conn(0x7ff8301446c0 0x7ff8300b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82dd9b700 1 -- 172.21.15.123:0/1514281586 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8180035b0 con 0x7ff8300ba560 2023-03-08T15:49:59.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82dd9b700 1 -- 172.21.15.123:0/1514281586 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 399553951 0 0) 0x7ff8180035b0 con 0x7ff8300ba560 2023-03-08T15:49:59.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82dd9b700 1 -- 172.21.15.123:0/1514281586 >> v2:172.21.15.175:3300/0 conn(0x7ff8301446c0 msgr2=0x7ff8300b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:59.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82dd9b700 1 --2- 172.21.15.123:0/1514281586 >> v2:172.21.15.175:3300/0 conn(0x7ff8301446c0 0x7ff8300b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82dd9b700 1 -- 172.21.15.123:0/1514281586 >> v1:172.21.15.175:6789/0 conn(0x7ff830144a90 legacy=0x7ff8300bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82dd9b700 1 -- 172.21.15.123:0/1514281586 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8300bc030 con 0x7ff8300ba560 2023-03-08T15:49:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82dd9b700 1 -- 172.21.15.123:0/1514281586 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7ff8280019f0 con 0x7ff8300ba560 2023-03-08T15:49:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82dd9b700 1 -- 172.21.15.123:0/1514281586 >> v1:172.21.15.123:6789/0 conn(0x7ff8300ba560 legacy=0x7ff830154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82dd9b700 1 --2- 172.21.15.123:0/1514281586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff818003a00 0x7ff818003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82dd9b700 1 --2- 172.21.15.123:0/1514281586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff818004850 0x7ff818004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82dd9b700 1 --2- 172.21.15.123:0/1514281586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff818005200 0x7ff81800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82dd9b700 1 -- 172.21.15.123:0/1514281586 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8300bdc90 con 0x7ff818005200 2023-03-08T15:49:59.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82dd9b700 1 -- 172.21.15.123:0/1514281586 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81800c080 con 0x7ff818003a00 2023-03-08T15:49:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82dd9b700 1 -- 172.21.15.123:0/1514281586 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81800c240 con 0x7ff818004850 2023-03-08T15:49:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.762+0000 7ff82f59e700 1 --2- 172.21.15.123:0/1514281586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff818005200 0x7ff81800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.763+0000 7ff82ed9d700 1 --2- 172.21.15.123:0/1514281586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff818003a00 0x7ff818003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.763+0000 7ff82f59e700 1 -- 172.21.15.123:0/1514281586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff818004850 msgr2=0x7ff818004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.763+0000 7ff82e59c700 1 --2- 172.21.15.123:0/1514281586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff818004850 0x7ff818004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.763+0000 7ff82f59e700 1 --2- 172.21.15.123:0/1514281586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff818004850 0x7ff818004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.763+0000 7ff82f59e700 1 -- 172.21.15.123:0/1514281586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff818003a00 msgr2=0x7ff818003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:49:59.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.763+0000 7ff82f59e700 1 --2- 172.21.15.123:0/1514281586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff818003a00 0x7ff818003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.763+0000 7ff82f59e700 1 -- 172.21.15.123:0/1514281586 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8180035b0 con 0x7ff818005200 2023-03-08T15:49:59.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.763+0000 7ff82e59c700 1 --2- 172.21.15.123:0/1514281586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff818004850 0x7ff818004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:49:59.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.763+0000 7ff82ed9d700 1 --2- 172.21.15.123:0/1514281586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff818003a00 0x7ff818003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:49:59.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.763+0000 7ff82f59e700 1 -- 172.21.15.123:0/1514281586 reap_dead start 2023-03-08T15:49:59.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.763+0000 7ff82f59e700 1 --2- 172.21.15.123:0/1514281586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff818005200 0x7ff81800ba10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff82800a830 tx=0x7ff818005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1587c8ed3511f4e4 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:59.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.763+0000 7ff82dd9b700 1 -- 172.21.15.123:0/1514281586 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800a2f0 con 0x7ff818005200 2023-03-08T15:49:59.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.763+0000 7ff82dd9b700 1 -- 172.21.15.123:0/1514281586 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff828012600 con 0x7ff818005200 2023-03-08T15:49:59.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.763+0000 7ff82dd9b700 1 -- 172.21.15.123:0/1514281586 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8280129b0 con 0x7ff818005200 2023-03-08T15:49:59.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.763+0000 7ff83501b700 1 -- 172.21.15.123:0/1514281586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff818005200 msgr2=0x7ff81800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.764+0000 7ff83501b700 1 --2- 172.21.15.123:0/1514281586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff818005200 0x7ff81800ba10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff82800a830 tx=0x7ff818005880 comp rx=0 tx=0).stop 2023-03-08T15:49:59.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.764+0000 7ff83501b700 1 -- 172.21.15.123:0/1514281586 shutdown_connections 2023-03-08T15:49:59.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.764+0000 7ff83501b700 1 --2- 172.21.15.123:0/1514281586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff818005200 0x7ff81800ba10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.764+0000 7ff83501b700 1 -- 172.21.15.123:0/1514281586 >> 172.21.15.123:0/1514281586 conn(0x7ff830071980 msgr2=0x7ff830071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.764+0000 7ff83501b700 1 -- 172.21.15.123:0/1514281586 shutdown_connections 2023-03-08T15:49:59.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.764+0000 7ff83501b700 1 -- 172.21.15.123:0/1514281586 wait complete. 2023-03-08T15:49:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.765+0000 7ff83501b700 1 Processor -- start 2023-03-08T15:49:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.765+0000 7ff83501b700 1 -- start start 2023-03-08T15:49:59.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff83501b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff818005200 0x7ff830141250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff83501b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8301e3b00 0x7ff8301e3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff83501b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff83013ee70 0x7ff83013f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff83501b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff830141790 con 0x7ff83013ee70 2023-03-08T15:49:59.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff83501b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff830145dd0 con 0x7ff8301e3b00 2023-03-08T15:49:59.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff83501b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8301e44b0 con 0x7ff818005200 2023-03-08T15:49:59.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff82f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff83013ee70 0x7ff83013f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff82f59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff83013ee70 0x7ff83013f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41876/0 (socket says 172.21.15.123:41876) 2023-03-08T15:49:59.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff82f59e700 1 -- 172.21.15.123:0/1944566440 learned_addr learned my addr 172.21.15.123:0/1944566440 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:49:59.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff82e59c700 1 --2- 172.21.15.123:0/1944566440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8301e3b00 0x7ff8301e3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff82ed9d700 1 --2- 172.21.15.123:0/1944566440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff818005200 0x7ff830141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff82f59e700 1 -- 172.21.15.123:0/1944566440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff818005200 msgr2=0x7ff830141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff82f59e700 1 --2- 172.21.15.123:0/1944566440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff818005200 0x7ff830141250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff82f59e700 1 -- 172.21.15.123:0/1944566440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8301e3b00 msgr2=0x7ff8301e3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff82f59e700 1 --2- 172.21.15.123:0/1944566440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8301e3b00 0x7ff8301e3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff82f59e700 1 -- 172.21.15.123:0/1944566440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8300bc5f0 con 0x7ff83013ee70 2023-03-08T15:49:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff82e59c700 1 --2- 172.21.15.123:0/1944566440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8301e3b00 0x7ff8301e3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:49:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff82f59e700 1 --2- 172.21.15.123:0/1944566440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff83013ee70 0x7ff83013f310 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff8300bc8d0 tx=0x7ff828001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff8177fe700 1 -- 172.21.15.123:0/1944566440 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8280019f0 con 0x7ff83013ee70 2023-03-08T15:49:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff8177fe700 1 -- 172.21.15.123:0/1944566440 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82801d420 con 0x7ff83013ee70 2023-03-08T15:49:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff83501b700 1 -- 172.21.15.123:0/1944566440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8300bc310 con 0x7ff83013ee70 2023-03-08T15:49:59.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff8177fe700 1 -- 172.21.15.123:0/1944566440 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82801d7d0 con 0x7ff83013ee70 2023-03-08T15:49:59.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.766+0000 7ff83501b700 1 -- 172.21.15.123:0/1944566440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83014db90 con 0x7ff83013ee70 2023-03-08T15:49:59.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.767+0000 7ff83501b700 1 -- 172.21.15.123:0/1944566440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8300744c0 con 0x7ff83013ee70 2023-03-08T15:49:59.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.767+0000 7ff8177fe700 1 -- 172.21.15.123:0/1944566440 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7ff828028030 con 0x7ff83013ee70 2023-03-08T15:49:59.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.768+0000 7ff8177fe700 1 --2- 172.21.15.123:0/1944566440 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff81c0698d0 0x7ff81c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:49:59.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.768+0000 7ff8177fe700 1 -- 172.21.15.123:0/1944566440 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff828088bc0 con 0x7ff83013ee70 2023-03-08T15:49:59.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.768+0000 7ff82ed9d700 1 --2- 172.21.15.123:0/1944566440 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff81c0698d0 0x7ff81c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:49:59.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.768+0000 7ff82ed9d700 1 --2- 172.21.15.123:0/1944566440 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff81c0698d0 0x7ff81c06bd80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff824009a00 tx=0x7ff824008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:49:59.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.772+0000 7ff8177fe700 1 -- 172.21.15.123:0/1944566440 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7ff828054990 con 0x7ff83013ee70 2023-03-08T15:49:59.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.960+0000 7ff83501b700 1 -- 172.21.15.123:0/1944566440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8301e3820 con 0x7ff83013ee70 2023-03-08T15:49:59.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.961+0000 7ff8177fe700 1 -- 172.21.15.123:0/1944566440 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17955 (secure 0 0 0) 0x7ff8301e3820 con 0x7ff83013ee70 2023-03-08T15:49:59.963 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:49:59.963 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:40.490671+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:49:37.104720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-08T15:49:38.431537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:49:59.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.963+0000 7ff83501b700 1 -- 172.21.15.123:0/1944566440 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff81c0698d0 msgr2=0x7ff81c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.963+0000 7ff83501b700 1 --2- 172.21.15.123:0/1944566440 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff81c0698d0 0x7ff81c06bd80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff824009a00 tx=0x7ff824008040 comp rx=0 tx=0).stop 2023-03-08T15:49:59.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.963+0000 7ff83501b700 1 -- 172.21.15.123:0/1944566440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff83013ee70 msgr2=0x7ff83013f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:49:59.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.963+0000 7ff83501b700 1 --2- 172.21.15.123:0/1944566440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff83013ee70 0x7ff83013f310 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff8300bc8d0 tx=0x7ff828001d80 comp rx=0 tx=0).stop 2023-03-08T15:49:59.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.963+0000 7ff83501b700 1 -- 172.21.15.123:0/1944566440 shutdown_connections 2023-03-08T15:49:59.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.963+0000 7ff83501b700 1 --2- 172.21.15.123:0/1944566440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff83013ee70 0x7ff83013f310 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.963+0000 7ff83501b700 1 --2- 172.21.15.123:0/1944566440 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff81c0698d0 0x7ff81c06bd80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.963+0000 7ff83501b700 1 --2- 172.21.15.123:0/1944566440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff818005200 0x7ff830141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.963+0000 7ff83501b700 1 --2- 172.21.15.123:0/1944566440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8301e3b00 0x7ff8301e3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:49:59.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.963+0000 7ff83501b700 1 -- 172.21.15.123:0/1944566440 >> 172.21.15.123:0/1944566440 conn(0x7ff830071980 msgr2=0x7ff8300b97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:49:59.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.963+0000 7ff83501b700 1 -- 172.21.15.123:0/1944566440 shutdown_connections 2023-03-08T15:49:59.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:49:59.963+0000 7ff83501b700 1 -- 172.21.15.123:0/1944566440 wait complete. 2023-03-08T15:49:59.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-08T15:49:26.011228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-08T15:49:32.528343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-08T15:49:37.104720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-08T15:49:38.431537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-08T15:49:59.978 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-08T15:50:00.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.099+0000 7f8429871700 1 Processor -- start 2023-03-08T15:50:00.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.099+0000 7f8429871700 1 -- start start 2023-03-08T15:50:00.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.100+0000 7f8429871700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84241446c0 0x7f84240b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.100+0000 7f8429871700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8424144a90 0x7f84240bd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.100+0000 7f8429871700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84240b7fa0 con 0x7f84240ba560 2023-03-08T15:50:00.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.100+0000 7f8429871700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84240b7130 con 0x7f8424144a90 2023-03-08T15:50:00.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.100+0000 7f8429871700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84240bc030 con 0x7f84241446c0 2023-03-08T15:50:00.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.100+0000 7f84227fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8424144a90 0x7f84240bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.100+0000 7f8422ffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84241446c0 0x7f84240b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.100+0000 7f84237fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f84240ba560 0x7f84240b5a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.123:47276/0 (socket says 172.21.15.123:47276) 2023-03-08T15:50:00.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.100+0000 7f8422ffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84241446c0 0x7f84240b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:41016/0 (socket says 172.21.15.123:41016) 2023-03-08T15:50:00.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.100+0000 7f84227fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8424144a90 0x7f84240bd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:45516/0 (socket says 172.21.15.123:45516) 2023-03-08T15:50:00.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.100+0000 7f84237fe700 1 -- 172.21.15.123:0/1371015871 learned_addr learned my addr 172.21.15.123:0/1371015871 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:00.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.101+0000 7f8422ffd700 1 -- 172.21.15.123:0/1371015871 >> v2:172.21.15.175:3300/0 conn(0x7f8424144a90 msgr2=0x7f84240bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:00.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.101+0000 7f8422ffd700 1 --2- 172.21.15.123:0/1371015871 >> v2:172.21.15.175:3300/0 conn(0x7f8424144a90 0x7f84240bd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.101+0000 7f8422ffd700 1 -- 172.21.15.123:0/1371015871 >> v1:172.21.15.175:6789/0 conn(0x7f84240ba560 legacy=0x7f84240b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.101+0000 7f8422ffd700 1 -- 172.21.15.123:0/1371015871 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84240bc310 con 0x7f84241446c0 2023-03-08T15:50:00.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.101+0000 7f84227fc700 1 --2- 172.21.15.123:0/1371015871 >> v2:172.21.15.175:3300/0 conn(0x7f8424144a90 0x7f84240bd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:50:00.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.101+0000 7f8422ffd700 1 --2- 172.21.15.123:0/1371015871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84241446c0 0x7f84240b6bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8418009840 tx=0x7f8418009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3eb8c43cadd4b445 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:00.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.101+0000 7f8421ffb700 1 -- 172.21.15.123:0/1371015871 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418011830 con 0x7f84241446c0 2023-03-08T15:50:00.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.101+0000 7f8421ffb700 1 -- 172.21.15.123:0/1371015871 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8418011990 con 0x7f84241446c0 2023-03-08T15:50:00.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.101+0000 7f8421ffb700 1 -- 172.21.15.123:0/1371015871 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418011d20 con 0x7f84241446c0 2023-03-08T15:50:00.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.102+0000 7f8429871700 1 -- 172.21.15.123:0/1371015871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84241446c0 msgr2=0x7f84240b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.102+0000 7f8429871700 1 --2- 172.21.15.123:0/1371015871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84241446c0 0x7f84240b6bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8418009840 tx=0x7f8418009b50 comp rx=0 tx=0).stop 2023-03-08T15:50:00.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.102+0000 7f8429871700 1 -- 172.21.15.123:0/1371015871 shutdown_connections 2023-03-08T15:50:00.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.102+0000 7f8429871700 1 --2- 172.21.15.123:0/1371015871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84241446c0 0x7f84240b6bf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.102+0000 7f8429871700 1 --2- 172.21.15.123:0/1371015871 >> v2:172.21.15.175:3300/0 conn(0x7f8424144a90 0x7f84240bd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.102+0000 7f8429871700 1 -- 172.21.15.123:0/1371015871 >> 172.21.15.123:0/1371015871 conn(0x7f8424071980 msgr2=0x7f8424071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:00.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.102+0000 7f8429871700 1 -- 172.21.15.123:0/1371015871 shutdown_connections 2023-03-08T15:50:00.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.102+0000 7f8429871700 1 -- 172.21.15.123:0/1371015871 wait complete. 2023-03-08T15:50:00.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.103+0000 7f8429871700 1 Processor -- start 2023-03-08T15:50:00.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.103+0000 7f8429871700 1 -- start start 2023-03-08T15:50:00.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f8429871700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84240ba560 0x7f84240c07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f8429871700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84241446c0 0x7f842413fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f8429871700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8424144a90 0x7f8424149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f8429871700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8424145190 con 0x7f84241446c0 2023-03-08T15:50:00.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f8429871700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84240c0f10 con 0x7f84240ba560 2023-03-08T15:50:00.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f8429871700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84240c0d00 con 0x7f8424144a90 2023-03-08T15:50:00.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f84227fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84241446c0 0x7f842413fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f84227fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84241446c0 0x7f842413fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41880/0 (socket says 172.21.15.123:41880) 2023-03-08T15:50:00.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f84227fc700 1 -- 172.21.15.123:0/923951557 learned_addr learned my addr 172.21.15.123:0/923951557 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:00.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f8422ffd700 1 --2- 172.21.15.123:0/923951557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84240ba560 0x7f84240c07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f84237fe700 1 --2- 172.21.15.123:0/923951557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8424144a90 0x7f8424149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f84227fc700 1 -- 172.21.15.123:0/923951557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8424144a90 msgr2=0x7f8424149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f84227fc700 1 --2- 172.21.15.123:0/923951557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8424144a90 0x7f8424149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f84227fc700 1 -- 172.21.15.123:0/923951557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84240ba560 msgr2=0x7f84240c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f84227fc700 1 --2- 172.21.15.123:0/923951557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84240ba560 0x7f84240c07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f84227fc700 1 -- 172.21.15.123:0/923951557 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84140094a0 con 0x7f84241446c0 2023-03-08T15:50:00.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.104+0000 7f84237fe700 1 --2- 172.21.15.123:0/923951557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8424144a90 0x7f8424149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:00.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.105+0000 7f84227fc700 1 --2- 172.21.15.123:0/923951557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84241446c0 0x7f842413fe80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f841400e9b0 tx=0x7f841400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:00.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.105+0000 7f840bfff700 1 -- 172.21.15.123:0/923951557 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414009700 con 0x7f84241446c0 2023-03-08T15:50:00.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.105+0000 7f840bfff700 1 -- 172.21.15.123:0/923951557 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841400c850 con 0x7f84241446c0 2023-03-08T15:50:00.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.105+0000 7f8429871700 1 -- 172.21.15.123:0/923951557 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84180094a0 con 0x7f84241446c0 2023-03-08T15:50:00.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.105+0000 7f840bfff700 1 -- 172.21.15.123:0/923951557 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841400cc00 con 0x7f84241446c0 2023-03-08T15:50:00.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.105+0000 7f8429871700 1 -- 172.21.15.123:0/923951557 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842414db90 con 0x7f84241446c0 2023-03-08T15:50:00.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.106+0000 7f8429871700 1 -- 172.21.15.123:0/923951557 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84240bc5f0 con 0x7f84241446c0 2023-03-08T15:50:00.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.106+0000 7f840bfff700 1 -- 172.21.15.123:0/923951557 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f8414019030 con 0x7f84241446c0 2023-03-08T15:50:00.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.106+0000 7f840bfff700 1 --2- 172.21.15.123:0/923951557 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f84100698d0 0x7f841006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.106+0000 7f840bfff700 1 -- 172.21.15.123:0/923951557 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84140871d0 con 0x7f84241446c0 2023-03-08T15:50:00.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.106+0000 7f8422ffd700 1 --2- 172.21.15.123:0/923951557 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f84100698d0 0x7f841006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.107+0000 7f8422ffd700 1 --2- 172.21.15.123:0/923951557 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f84100698d0 0x7f841006bd80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8418000c00 tx=0x7f8418008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:00.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.111+0000 7f840bfff700 1 -- 172.21.15.123:0/923951557 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f8414052f40 con 0x7f84241446c0 2023-03-08T15:50:00.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.296+0000 7f8429871700 1 -- 172.21.15.123:0/923951557 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f842414dd20 con 0x7f84241446c0 2023-03-08T15:50:00.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.296+0000 7f840bfff700 1 -- 172.21.15.123:0/923951557 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f842414dd20 con 0x7f84241446c0 2023-03-08T15:50:00.298 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-03-08T15:50:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.298+0000 7f8429871700 1 -- 172.21.15.123:0/923951557 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f84100698d0 msgr2=0x7f841006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.298+0000 7f8429871700 1 --2- 172.21.15.123:0/923951557 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f84100698d0 0x7f841006bd80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8418000c00 tx=0x7f8418008030 comp rx=0 tx=0).stop 2023-03-08T15:50:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.298+0000 7f8429871700 1 -- 172.21.15.123:0/923951557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84241446c0 msgr2=0x7f842413fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.298+0000 7f8429871700 1 --2- 172.21.15.123:0/923951557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84241446c0 0x7f842413fe80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f841400e9b0 tx=0x7f841400ecc0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.298+0000 7f8429871700 1 -- 172.21.15.123:0/923951557 shutdown_connections 2023-03-08T15:50:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.298+0000 7f8429871700 1 --2- 172.21.15.123:0/923951557 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f84100698d0 0x7f841006bd80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.298+0000 7f8429871700 1 --2- 172.21.15.123:0/923951557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8424144a90 0x7f8424149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.298+0000 7f8429871700 1 --2- 172.21.15.123:0/923951557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84240ba560 0x7f84240c07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.298+0000 7f8429871700 1 --2- 172.21.15.123:0/923951557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84241446c0 0x7f842413fe80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.298+0000 7f8429871700 1 -- 172.21.15.123:0/923951557 >> 172.21.15.123:0/923951557 conn(0x7f8424071980 msgr2=0x7f842414b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.298+0000 7f8429871700 1 -- 172.21.15.123:0/923951557 shutdown_connections 2023-03-08T15:50:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.298+0000 7f8429871700 1 -- 172.21.15.123:0/923951557 wait complete. 2023-03-08T15:50:00.311 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-08T15:50:00.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.434+0000 7fa4b7371700 1 Processor -- start 2023-03-08T15:50:00.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.434+0000 7fa4b7371700 1 -- start start 2023-03-08T15:50:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.435+0000 7fa4b7371700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4b0144a90 0x7fa4b00bd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.435+0000 7fa4b7371700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b00b7fa0 con 0x7fa4b00ba560 2023-03-08T15:50:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.435+0000 7fa4b7371700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b00bc030 con 0x7fa4b01446c0 2023-03-08T15:50:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.435+0000 7fa4b7371700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b00bc310 con 0x7fa4b0144a90 2023-03-08T15:50:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.435+0000 7fa4b590e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa4b00ba560 0x7fa4b0154f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42384/0 (socket says 172.21.15.123:42384) 2023-03-08T15:50:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.435+0000 7fa4b590e700 1 -- 172.21.15.123:0/3644364286 learned_addr learned my addr 172.21.15.123:0/3644364286 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.435+0000 7fa4b490c700 1 --2- 172.21.15.123:0/3644364286 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4b0144a90 0x7fa4b00bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.435+0000 7fa4a7fff700 1 -- 172.21.15.123:0/3644364286 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087913991 0 0) 0x7fa4b00b7fa0 con 0x7fa4b00ba560 2023-03-08T15:50:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.435+0000 7fa4a7fff700 1 -- 172.21.15.123:0/3644364286 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa49c0035b0 con 0x7fa4b00ba560 2023-03-08T15:50:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.435+0000 7fa4a7fff700 1 -- 172.21.15.123:0/3644364286 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711151916 0 0) 0x7fa4b00bc030 con 0x7fa4b01446c0 2023-03-08T15:50:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.435+0000 7fa4a7fff700 1 -- 172.21.15.123:0/3644364286 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4b00b7fa0 con 0x7fa4b01446c0 2023-03-08T15:50:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.435+0000 7fa4b490c700 1 -- 172.21.15.123:0/3644364286 >> v1:172.21.15.175:6789/0 conn(0x7fa4b01446c0 legacy=0x7fa4b00b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.435+0000 7fa4b490c700 1 -- 172.21.15.123:0/3644364286 >> v1:172.21.15.123:6789/0 conn(0x7fa4b00ba560 legacy=0x7fa4b0154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.435+0000 7fa4b490c700 1 -- 172.21.15.123:0/3644364286 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b00bc5f0 con 0x7fa4b0144a90 2023-03-08T15:50:00.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.435+0000 7fa4b490c700 1 --2- 172.21.15.123:0/3644364286 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4b0144a90 0x7fa4b00bd580 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009870 tx=0x7fa4ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36d431fe6eec6a9b server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:00.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.436+0000 7fa4a7fff700 1 -- 172.21.15.123:0/3644364286 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac011830 con 0x7fa4b0144a90 2023-03-08T15:50:00.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.436+0000 7fa4a7fff700 1 -- 172.21.15.123:0/3644364286 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac011990 con 0x7fa4b0144a90 2023-03-08T15:50:00.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.436+0000 7fa4a7fff700 1 -- 172.21.15.123:0/3644364286 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac011d20 con 0x7fa4b0144a90 2023-03-08T15:50:00.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.436+0000 7fa4b7371700 1 -- 172.21.15.123:0/3644364286 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4b0144a90 msgr2=0x7fa4b00bd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.436+0000 7fa4b7371700 1 --2- 172.21.15.123:0/3644364286 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4b0144a90 0x7fa4b00bd580 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009870 tx=0x7fa4ac009b80 comp rx=0 tx=0).stop 2023-03-08T15:50:00.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.436+0000 7fa4b7371700 1 -- 172.21.15.123:0/3644364286 shutdown_connections 2023-03-08T15:50:00.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.436+0000 7fa4b7371700 1 --2- 172.21.15.123:0/3644364286 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4b0144a90 0x7fa4b00bd580 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.436+0000 7fa4b7371700 1 -- 172.21.15.123:0/3644364286 >> 172.21.15.123:0/3644364286 conn(0x7fa4b0071980 msgr2=0x7fa4b0071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:00.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.436+0000 7fa4b7371700 1 -- 172.21.15.123:0/3644364286 shutdown_connections 2023-03-08T15:50:00.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.436+0000 7fa4b7371700 1 -- 172.21.15.123:0/3644364286 wait complete. 2023-03-08T15:50:00.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.437+0000 7fa4b7371700 1 Processor -- start 2023-03-08T15:50:00.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.437+0000 7fa4b7371700 1 -- start start 2023-03-08T15:50:00.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b7371700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4b00ba560 0x7fa4b0145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b7371700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b01446c0 0x7fa4b00c0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b7371700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4b0144a90 0x7fa4b00bf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b7371700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b014a0b0 con 0x7fa4b01446c0 2023-03-08T15:50:00.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b7371700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b00bef90 con 0x7fa4b0144a90 2023-03-08T15:50:00.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b7371700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b01d6810 con 0x7fa4b00ba560 2023-03-08T15:50:00.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b490c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b01446c0 0x7fa4b00c0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b490c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b01446c0 0x7fa4b00c0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41882/0 (socket says 172.21.15.123:41882) 2023-03-08T15:50:00.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b490c700 1 -- 172.21.15.123:0/2689264265 learned_addr learned my addr 172.21.15.123:0/2689264265 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:00.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b510d700 1 --2- 172.21.15.123:0/2689264265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4b00ba560 0x7fa4b0145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b590e700 1 --2- 172.21.15.123:0/2689264265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4b0144a90 0x7fa4b00bf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b490c700 1 -- 172.21.15.123:0/2689264265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4b00ba560 msgr2=0x7fa4b0145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b490c700 1 --2- 172.21.15.123:0/2689264265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4b00ba560 0x7fa4b0145060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b490c700 1 -- 172.21.15.123:0/2689264265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4b0144a90 msgr2=0x7fa4b00bf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b490c700 1 --2- 172.21.15.123:0/2689264265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4b0144a90 0x7fa4b00bf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b490c700 1 -- 172.21.15.123:0/2689264265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac0094a0 con 0x7fa4b01446c0 2023-03-08T15:50:00.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b490c700 1 --2- 172.21.15.123:0/2689264265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b01446c0 0x7fa4b00c0960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0090b0 tx=0x7fa4ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:00.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4a5ffb700 1 -- 172.21.15.123:0/2689264265 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac01a6e0 con 0x7fa4b01446c0 2023-03-08T15:50:00.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4a5ffb700 1 -- 172.21.15.123:0/2689264265 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac01a840 con 0x7fa4b01446c0 2023-03-08T15:50:00.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4b7371700 1 -- 172.21.15.123:0/2689264265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b014db90 con 0x7fa4b01446c0 2023-03-08T15:50:00.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.438+0000 7fa4a5ffb700 1 -- 172.21.15.123:0/2689264265 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac01abb0 con 0x7fa4b01446c0 2023-03-08T15:50:00.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.439+0000 7fa4b7371700 1 -- 172.21.15.123:0/2689264265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b00bdac0 con 0x7fa4b01446c0 2023-03-08T15:50:00.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.440+0000 7fa4b7371700 1 -- 172.21.15.123:0/2689264265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b014dd20 con 0x7fa4b01446c0 2023-03-08T15:50:00.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.440+0000 7fa4a5ffb700 1 -- 172.21.15.123:0/2689264265 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fa4ac00f050 con 0x7fa4b01446c0 2023-03-08T15:50:00.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.441+0000 7fa4a5ffb700 1 --2- 172.21.15.123:0/2689264265 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4940698d0 0x7fa49406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.441+0000 7fa4b510d700 1 --2- 172.21.15.123:0/2689264265 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4940698d0 0x7fa49406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.441+0000 7fa4a5ffb700 1 -- 172.21.15.123:0/2689264265 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa4ac088400 con 0x7fa4b01446c0 2023-03-08T15:50:00.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.441+0000 7fa4b510d700 1 --2- 172.21.15.123:0/2689264265 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4940698d0 0x7fa49406bd80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00011e0 tx=0x7fa4a0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:00.447 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.445+0000 7fa4a5ffb700 1 -- 172.21.15.123:0/2689264265 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fa4b014dd20 con 0x7fa4b01446c0 2023-03-08T15:50:00.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.627+0000 7fa4b7371700 1 -- 172.21.15.123:0/2689264265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa4b014dd20 con 0x7fa4b01446c0 2023-03-08T15:50:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.627+0000 7fa4a5ffb700 1 -- 172.21.15.123:0/2689264265 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa4ac029020 con 0x7fa4b01446c0 2023-03-08T15:50:00.629 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-03-08T15:50:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.629+0000 7fa4b7371700 1 -- 172.21.15.123:0/2689264265 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4940698d0 msgr2=0x7fa49406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.629+0000 7fa4b7371700 1 --2- 172.21.15.123:0/2689264265 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4940698d0 0x7fa49406bd80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00011e0 tx=0x7fa4a0009040 comp rx=0 tx=0).stop 2023-03-08T15:50:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.629+0000 7fa4b7371700 1 -- 172.21.15.123:0/2689264265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b01446c0 msgr2=0x7fa4b00c0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.629+0000 7fa4b7371700 1 --2- 172.21.15.123:0/2689264265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b01446c0 0x7fa4b00c0960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0090b0 tx=0x7fa4ac004750 comp rx=0 tx=0).stop 2023-03-08T15:50:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.629+0000 7fa4b7371700 1 -- 172.21.15.123:0/2689264265 shutdown_connections 2023-03-08T15:50:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.629+0000 7fa4b7371700 1 --2- 172.21.15.123:0/2689264265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4b0144a90 0x7fa4b00bf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.629+0000 7fa4b7371700 1 --2- 172.21.15.123:0/2689264265 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4940698d0 0x7fa49406bd80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.629+0000 7fa4b7371700 1 --2- 172.21.15.123:0/2689264265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4b00ba560 0x7fa4b0145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.629+0000 7fa4b7371700 1 --2- 172.21.15.123:0/2689264265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b01446c0 0x7fa4b00c0960 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.629+0000 7fa4b7371700 1 -- 172.21.15.123:0/2689264265 >> 172.21.15.123:0/2689264265 conn(0x7fa4b0071980 msgr2=0x7fa4b01d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:00.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.629+0000 7fa4b7371700 1 -- 172.21.15.123:0/2689264265 shutdown_connections 2023-03-08T15:50:00.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.629+0000 7fa4b7371700 1 -- 172.21.15.123:0/2689264265 wait complete. 2023-03-08T15:50:00.643 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-08T15:50:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.765+0000 7f46db3c2700 1 Processor -- start 2023-03-08T15:50:00.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.765+0000 7f46db3c2700 1 -- start start 2023-03-08T15:50:00.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.766+0000 7f46db3c2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f46d4147510 0x7f46d40bd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.766+0000 7f46db3c2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d40b7180 con 0x7f46d40b3c30 2023-03-08T15:50:00.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.766+0000 7f46db3c2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d40b8960 con 0x7f46d4148130 2023-03-08T15:50:00.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.766+0000 7f46db3c2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d4141cd0 con 0x7f46d4147510 2023-03-08T15:50:00.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.766+0000 7f46d895d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f46d4147510 0x7f46d40bd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.766+0000 7f46d995f700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f46d40b3c30 0x7f46d4151d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42390/0 (socket says 172.21.15.123:42390) 2023-03-08T15:50:00.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.766+0000 7f46d995f700 1 -- 172.21.15.123:0/1748719889 learned_addr learned my addr 172.21.15.123:0/1748719889 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:00.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.766+0000 7f46d895d700 1 -- 172.21.15.123:0/1748719889 >> v1:172.21.15.175:6789/0 conn(0x7f46d4148130 legacy=0x7f46d406b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:00.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.766+0000 7f46d895d700 1 -- 172.21.15.123:0/1748719889 >> v1:172.21.15.123:6789/0 conn(0x7f46d40b3c30 legacy=0x7f46d4151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.766+0000 7f46d895d700 1 -- 172.21.15.123:0/1748719889 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d40b6e10 con 0x7f46d4147510 2023-03-08T15:50:00.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.766+0000 7f46cbfff700 1 -- 172.21.15.123:0/1748719889 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269085788 0 0) 0x7f46d40b7180 con 0x7f46d40b3c30 2023-03-08T15:50:00.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.767+0000 7f46d895d700 1 --2- 172.21.15.123:0/1748719889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d4147510 0x7f46d40bd420 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009840 tx=0x7f46d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfb02309cb022c2 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:00.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.767+0000 7f46cbfff700 1 -- 172.21.15.123:0/1748719889 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0004230 con 0x7f46d4147510 2023-03-08T15:50:00.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.767+0000 7f46cbfff700 1 -- 172.21.15.123:0/1748719889 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d0004390 con 0x7f46d4147510 2023-03-08T15:50:00.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.767+0000 7f46cbfff700 1 -- 172.21.15.123:0/1748719889 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d00036a0 con 0x7f46d4147510 2023-03-08T15:50:00.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.767+0000 7f46db3c2700 1 -- 172.21.15.123:0/1748719889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d4147510 msgr2=0x7f46d40bd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.767+0000 7f46db3c2700 1 --2- 172.21.15.123:0/1748719889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d4147510 0x7f46d40bd420 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009840 tx=0x7f46d0009b50 comp rx=0 tx=0).stop 2023-03-08T15:50:00.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.767+0000 7f46db3c2700 1 -- 172.21.15.123:0/1748719889 shutdown_connections 2023-03-08T15:50:00.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.767+0000 7f46db3c2700 1 --2- 172.21.15.123:0/1748719889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d4147510 0x7f46d40bd420 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.767+0000 7f46db3c2700 1 -- 172.21.15.123:0/1748719889 >> 172.21.15.123:0/1748719889 conn(0x7f46d40ba3c0 msgr2=0x7f46d40bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:00.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.767+0000 7f46db3c2700 1 -- 172.21.15.123:0/1748719889 shutdown_connections 2023-03-08T15:50:00.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.767+0000 7f46db3c2700 1 -- 172.21.15.123:0/1748719889 wait complete. 2023-03-08T15:50:00.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.768+0000 7f46db3c2700 1 Processor -- start 2023-03-08T15:50:00.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.768+0000 7f46db3c2700 1 -- start start 2023-03-08T15:50:00.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46db3c2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d40b3c30 0x7f46d4144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46db3c2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46d4147510 0x7f46d40acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46db3c2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d4148130 0x7f46d41e0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46db3c2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d40b8c40 con 0x7f46d40b3c30 2023-03-08T15:50:00.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46db3c2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d41432d0 con 0x7f46d4147510 2023-03-08T15:50:00.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46db3c2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d4144b90 con 0x7f46d4148130 2023-03-08T15:50:00.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46d915e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d40b3c30 0x7f46d4144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46d915e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d40b3c30 0x7f46d4144650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41892/0 (socket says 172.21.15.123:41892) 2023-03-08T15:50:00.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46d915e700 1 -- 172.21.15.123:0/3485528764 learned_addr learned my addr 172.21.15.123:0/3485528764 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:00.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46d895d700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46d4147510 0x7f46d40acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46d995f700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d4148130 0x7f46d41e0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46d915e700 1 -- 172.21.15.123:0/3485528764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d4148130 msgr2=0x7f46d41e0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46d915e700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d4148130 0x7f46d41e0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46d915e700 1 -- 172.21.15.123:0/3485528764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46d4147510 msgr2=0x7f46d40acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46d915e700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46d4147510 0x7f46d40acb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46d915e700 1 -- 172.21.15.123:0/3485528764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d00094a0 con 0x7f46d40b3c30 2023-03-08T15:50:00.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46d995f700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d4148130 0x7f46d41e0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:00.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46d895d700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46d4147510 0x7f46d40acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:00.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46d915e700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d40b3c30 0x7f46d4144650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f46c400c4a0 tx=0x7f46c400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:00.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.769+0000 7f46c9ffb700 1 -- 172.21.15.123:0/3485528764 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c40054e0 con 0x7f46d40b3c30 2023-03-08T15:50:00.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.770+0000 7f46c9ffb700 1 -- 172.21.15.123:0/3485528764 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c4003680 con 0x7f46d40b3c30 2023-03-08T15:50:00.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.770+0000 7f46db3c2700 1 -- 172.21.15.123:0/3485528764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d4072040 con 0x7f46d40b3c30 2023-03-08T15:50:00.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.770+0000 7f46c9ffb700 1 -- 172.21.15.123:0/3485528764 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c4003a30 con 0x7f46d40b3c30 2023-03-08T15:50:00.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.770+0000 7f46db3c2700 1 -- 172.21.15.123:0/3485528764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d4071eb0 con 0x7f46d40b3c30 2023-03-08T15:50:00.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.771+0000 7f46db3c2700 1 -- 172.21.15.123:0/3485528764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d40bd960 con 0x7f46d40b3c30 2023-03-08T15:50:00.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.771+0000 7f46c9ffb700 1 -- 172.21.15.123:0/3485528764 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f46c4019030 con 0x7f46d40b3c30 2023-03-08T15:50:00.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.771+0000 7f46c9ffb700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f46b80698d0 0x7f46b806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:00.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.771+0000 7f46c9ffb700 1 -- 172.21.15.123:0/3485528764 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46c40869f0 con 0x7f46d40b3c30 2023-03-08T15:50:00.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.771+0000 7f46d895d700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f46b80698d0 0x7f46b806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:00.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.772+0000 7f46d895d700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f46b80698d0 0x7f46b806bd80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f46d406fa20 tx=0x7f46d0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:00.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.776+0000 7f46c9ffb700 1 -- 172.21.15.123:0/3485528764 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f46c4088e60 con 0x7f46d40b3c30 2023-03-08T15:50:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.959+0000 7f46db3c2700 1 -- 172.21.15.123:0/3485528764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46d4142a60 con 0x7f46d40b3c30 2023-03-08T15:50:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.960+0000 7f46c9ffb700 1 -- 172.21.15.123:0/3485528764 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f46c40170a0 con 0x7f46d40b3c30 2023-03-08T15:50:00.962 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-03-08T15:50:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.962+0000 7f46db3c2700 1 -- 172.21.15.123:0/3485528764 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f46b80698d0 msgr2=0x7f46b806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.962+0000 7f46db3c2700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f46b80698d0 0x7f46b806bd80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f46d406fa20 tx=0x7f46d0008030 comp rx=0 tx=0).stop 2023-03-08T15:50:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.962+0000 7f46db3c2700 1 -- 172.21.15.123:0/3485528764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d40b3c30 msgr2=0x7f46d4144650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.962+0000 7f46db3c2700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d40b3c30 0x7f46d4144650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f46c400c4a0 tx=0x7f46c400c860 comp rx=0 tx=0).stop 2023-03-08T15:50:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.962+0000 7f46db3c2700 1 -- 172.21.15.123:0/3485528764 shutdown_connections 2023-03-08T15:50:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.962+0000 7f46db3c2700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f46b80698d0 0x7f46b806bd80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.962+0000 7f46db3c2700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d4148130 0x7f46d41e0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.962+0000 7f46db3c2700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d40b3c30 0x7f46d4144650 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.962+0000 7f46db3c2700 1 --2- 172.21.15.123:0/3485528764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46d4147510 0x7f46d40acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.962+0000 7f46db3c2700 1 -- 172.21.15.123:0/3485528764 >> 172.21.15.123:0/3485528764 conn(0x7f46d40ba3c0 msgr2=0x7f46d41465d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.962+0000 7f46db3c2700 1 -- 172.21.15.123:0/3485528764 shutdown_connections 2023-03-08T15:50:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:00.962+0000 7f46db3c2700 1 -- 172.21.15.123:0/3485528764 wait complete. 2023-03-08T15:50:00.975 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-08T15:50:01.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.099+0000 7f1449c45700 1 Processor -- start 2023-03-08T15:50:01.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.099+0000 7f1449c45700 1 -- start start 2023-03-08T15:50:01.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f1449c45700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1444072010 0x7f1444144740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f1449c45700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1444144c80 0x7f14440bad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f1449c45700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14440ba8f0 con 0x7f1444071c40 2023-03-08T15:50:01.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f1449c45700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1444072460 con 0x7f1444144c80 2023-03-08T15:50:01.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f1449c45700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144406bc00 con 0x7f1444072010 2023-03-08T15:50:01.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14437fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1444071c40 0x7f144414dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42392/0 (socket says 172.21.15.123:42392) 2023-03-08T15:50:01.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14437fe700 1 -- 172.21.15.123:0/3224554412 learned_addr learned my addr 172.21.15.123:0/3224554412 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:01.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 -- 172.21.15.123:0/3224554412 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742290054 0 0) 0x7f14440ba8f0 con 0x7f1444071c40 2023-03-08T15:50:01.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 -- 172.21.15.123:0/3224554412 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f142c0035b0 con 0x7f1444071c40 2023-03-08T15:50:01.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f1442ffd700 1 --2- 172.21.15.123:0/3224554412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1444072010 0x7f1444144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f1443fff700 1 --2- 172.21.15.123:0/3224554412 >> v2:172.21.15.175:3300/0 conn(0x7f1444144c80 0x7f14440bad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 -- 172.21.15.123:0/3224554412 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2057294131 0 0) 0x7f142c0035b0 con 0x7f1444071c40 2023-03-08T15:50:01.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 -- 172.21.15.123:0/3224554412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1444072010 msgr2=0x7f1444144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:01.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 --2- 172.21.15.123:0/3224554412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1444072010 0x7f1444144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 -- 172.21.15.123:0/3224554412 >> v2:172.21.15.175:3300/0 conn(0x7f1444144c80 msgr2=0x7f14440bad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:01.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 --2- 172.21.15.123:0/3224554412 >> v2:172.21.15.175:3300/0 conn(0x7f1444144c80 0x7f14440bad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 -- 172.21.15.123:0/3224554412 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144414e4b0 con 0x7f1444071c40 2023-03-08T15:50:01.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 -- 172.21.15.123:0/3224554412 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f1438001670 con 0x7f1444071c40 2023-03-08T15:50:01.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 -- 172.21.15.123:0/3224554412 >> v1:172.21.15.123:6789/0 conn(0x7f1444071c40 legacy=0x7f144414dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 --2- 172.21.15.123:0/3224554412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f142c003a00 0x7f142c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 --2- 172.21.15.123:0/3224554412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1444072010 0x7f142c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 --2- 172.21.15.123:0/3224554412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f142c004d90 0x7f142c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 -- 172.21.15.123:0/3224554412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1444072460 con 0x7f142c003a00 2023-03-08T15:50:01.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 -- 172.21.15.123:0/3224554412 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144406bc00 con 0x7f142c004d90 2023-03-08T15:50:01.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.100+0000 7f14427fc700 1 -- 172.21.15.123:0/3224554412 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c014220 con 0x7f1444072010 2023-03-08T15:50:01.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.101+0000 7f14437fe700 1 --2- 172.21.15.123:0/3224554412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f142c003a00 0x7f142c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.101+0000 7f1442ffd700 1 --2- 172.21.15.123:0/3224554412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1444072010 0x7f142c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.101+0000 7f1443fff700 1 --2- 172.21.15.123:0/3224554412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f142c004d90 0x7f142c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.101+0000 7f14437fe700 1 -- 172.21.15.123:0/3224554412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1444072010 msgr2=0x7f142c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:01.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.101+0000 7f14437fe700 1 --2- 172.21.15.123:0/3224554412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1444072010 0x7f142c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.101+0000 7f14437fe700 1 -- 172.21.15.123:0/3224554412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f142c004d90 msgr2=0x7f142c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:01.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.101+0000 7f14437fe700 1 --2- 172.21.15.123:0/3224554412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f142c004d90 0x7f142c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.101+0000 7f14437fe700 1 -- 172.21.15.123:0/3224554412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c0035b0 con 0x7f142c003a00 2023-03-08T15:50:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.101+0000 7f1443fff700 1 --2- 172.21.15.123:0/3224554412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f142c004d90 0x7f142c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.101+0000 7f14437fe700 1 --2- 172.21.15.123:0/3224554412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f142c003a00 0x7f142c003e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f143800c320 tx=0x7f142c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d2479c356fd9da server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.101+0000 7f14427fc700 1 -- 172.21.15.123:0/3224554412 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143800cdc0 con 0x7f142c003a00 2023-03-08T15:50:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.101+0000 7f14427fc700 1 -- 172.21.15.123:0/3224554412 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1438005960 con 0x7f142c003a00 2023-03-08T15:50:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.101+0000 7f14427fc700 1 -- 172.21.15.123:0/3224554412 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438005d10 con 0x7f142c003a00 2023-03-08T15:50:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.102+0000 7f1449c45700 1 -- 172.21.15.123:0/3224554412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f142c003a00 msgr2=0x7f142c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.102+0000 7f1449c45700 1 --2- 172.21.15.123:0/3224554412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f142c003a00 0x7f142c003e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f143800c320 tx=0x7f142c005880 comp rx=0 tx=0).stop 2023-03-08T15:50:01.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.102+0000 7f1443fff700 1 -- 172.21.15.123:0/3224554412 reap_dead start 2023-03-08T15:50:01.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.102+0000 7f1449c45700 1 -- 172.21.15.123:0/3224554412 shutdown_connections 2023-03-08T15:50:01.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.102+0000 7f1449c45700 1 -- 172.21.15.123:0/3224554412 >> 172.21.15.123:0/3224554412 conn(0x7f144406a250 msgr2=0x7f144406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:01.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.102+0000 7f1449c45700 1 -- 172.21.15.123:0/3224554412 shutdown_connections 2023-03-08T15:50:01.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.102+0000 7f1449c45700 1 -- 172.21.15.123:0/3224554412 wait complete. 2023-03-08T15:50:01.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.103+0000 7f1449c45700 1 Processor -- start 2023-03-08T15:50:01.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.103+0000 7f1449c45700 1 -- start start 2023-03-08T15:50:01.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.103+0000 7f1449c45700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f142c003a00 0x7f1444132fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.103+0000 7f1449c45700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14440bc4f0 0x7f1444139040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.103+0000 7f1449c45700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1444137ed0 0x7f1444138340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.103+0000 7f1449c45700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14441376d0 con 0x7f14440bc4f0 2023-03-08T15:50:01.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.103+0000 7f1449c45700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1444138880 con 0x7f142c003a00 2023-03-08T15:50:01.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.103+0000 7f1449c45700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14441379f0 con 0x7f1444137ed0 2023-03-08T15:50:01.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f1442ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14440bc4f0 0x7f1444139040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f1442ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14440bc4f0 0x7f1444139040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41902/0 (socket says 172.21.15.123:41902) 2023-03-08T15:50:01.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f1442ffd700 1 -- 172.21.15.123:0/2465010475 learned_addr learned my addr 172.21.15.123:0/2465010475 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:01.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f14437fe700 1 --2- 172.21.15.123:0/2465010475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f142c003a00 0x7f1444132fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f1443fff700 1 --2- 172.21.15.123:0/2465010475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1444137ed0 0x7f1444138340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f1442ffd700 1 -- 172.21.15.123:0/2465010475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1444137ed0 msgr2=0x7f1444138340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f1442ffd700 1 --2- 172.21.15.123:0/2465010475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1444137ed0 0x7f1444138340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f1442ffd700 1 -- 172.21.15.123:0/2465010475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f142c003a00 msgr2=0x7f1444132fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f1442ffd700 1 --2- 172.21.15.123:0/2465010475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f142c003a00 0x7f1444132fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f1442ffd700 1 -- 172.21.15.123:0/2465010475 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144414ea70 con 0x7f14440bc4f0 2023-03-08T15:50:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f1442ffd700 1 --2- 172.21.15.123:0/2465010475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14440bc4f0 0x7f1444139040 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1434011aa0 tx=0x7f1434011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f142bfff700 1 -- 172.21.15.123:0/2465010475 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1434011ee0 con 0x7f14440bc4f0 2023-03-08T15:50:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f142bfff700 1 -- 172.21.15.123:0/2465010475 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143400f940 con 0x7f14440bc4f0 2023-03-08T15:50:01.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f1449c45700 1 -- 172.21.15.123:0/2465010475 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144414e790 con 0x7f14440bc4f0 2023-03-08T15:50:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f142bfff700 1 -- 172.21.15.123:0/2465010475 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143400fcf0 con 0x7f14440bc4f0 2023-03-08T15:50:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.104+0000 7f1449c45700 1 -- 172.21.15.123:0/2465010475 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1444144740 con 0x7f14440bc4f0 2023-03-08T15:50:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.105+0000 7f1449c45700 1 -- 172.21.15.123:0/2465010475 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1444137d20 con 0x7f14440bc4f0 2023-03-08T15:50:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.106+0000 7f142bfff700 1 -- 172.21.15.123:0/2465010475 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f1434014440 con 0x7f14440bc4f0 2023-03-08T15:50:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.106+0000 7f142bfff700 1 --2- 172.21.15.123:0/2465010475 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f14300698d0 0x7f143006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.106+0000 7f14437fe700 1 --2- 172.21.15.123:0/2465010475 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f14300698d0 0x7f143006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.106+0000 7f142bfff700 1 -- 172.21.15.123:0/2465010475 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1434087da0 con 0x7f14440bc4f0 2023-03-08T15:50:01.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.106+0000 7f14437fe700 1 --2- 172.21.15.123:0/2465010475 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f14300698d0 0x7f143006bd80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1438015040 tx=0x7f143800a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:01.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.110+0000 7f142bfff700 1 -- 172.21.15.123:0/2465010475 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f1434053bd0 con 0x7f14440bc4f0 2023-03-08T15:50:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.294+0000 7f1449c45700 1 -- 172.21.15.123:0/2465010475 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1444137b60 con 0x7f14440bc4f0 2023-03-08T15:50:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.294+0000 7f142bfff700 1 -- 172.21.15.123:0/2465010475 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1444137b60 con 0x7f14440bc4f0 2023-03-08T15:50:01.296 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-03-08T15:50:01.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.296+0000 7f1449c45700 1 -- 172.21.15.123:0/2465010475 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f14300698d0 msgr2=0x7f143006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.296+0000 7f1449c45700 1 --2- 172.21.15.123:0/2465010475 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f14300698d0 0x7f143006bd80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1438015040 tx=0x7f143800a000 comp rx=0 tx=0).stop 2023-03-08T15:50:01.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.296+0000 7f1449c45700 1 -- 172.21.15.123:0/2465010475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14440bc4f0 msgr2=0x7f1444139040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.296+0000 7f1449c45700 1 --2- 172.21.15.123:0/2465010475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14440bc4f0 0x7f1444139040 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1434011aa0 tx=0x7f1434011db0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.296+0000 7f1449c45700 1 -- 172.21.15.123:0/2465010475 shutdown_connections 2023-03-08T15:50:01.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.296+0000 7f1449c45700 1 --2- 172.21.15.123:0/2465010475 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f14300698d0 0x7f143006bd80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.296+0000 7f1449c45700 1 --2- 172.21.15.123:0/2465010475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1444137ed0 0x7f1444138340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.296+0000 7f1449c45700 1 --2- 172.21.15.123:0/2465010475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f142c003a00 0x7f1444132fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.296+0000 7f1449c45700 1 --2- 172.21.15.123:0/2465010475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14440bc4f0 0x7f1444139040 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.296+0000 7f1449c45700 1 -- 172.21.15.123:0/2465010475 >> 172.21.15.123:0/2465010475 conn(0x7f144406a250 msgr2=0x7f144406c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.296+0000 7f1449c45700 1 -- 172.21.15.123:0/2465010475 shutdown_connections 2023-03-08T15:50:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.296+0000 7f1449c45700 1 -- 172.21.15.123:0/2465010475 wait complete. 2023-03-08T15:50:01.310 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:50:01.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.428+0000 7f18d4257700 1 Processor -- start 2023-03-08T15:50:01.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.428+0000 7f18d4257700 1 -- start start 2023-03-08T15:50:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.428+0000 7f18d4257700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f18cc144900 0x7f18cc14dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d4257700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18cc0b8e10 0x7f18cc0bd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d4257700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18cc0bd350 con 0x7f18cc0bc880 2023-03-08T15:50:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d4257700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18cc0badc0 con 0x7f18cc144900 2023-03-08T15:50:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d4257700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0ba580 con 0x7f18cc0b8e10 2023-03-08T15:50:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d1ff3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f18cc144900 0x7f18cc14dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d17f2700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f18cc0bc880 0x7f18cc0b8700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42406/0 (socket says 172.21.15.123:42406) 2023-03-08T15:50:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d17f2700 1 -- 172.21.15.123:0/3665301049 learned_addr learned my addr 172.21.15.123:0/3665301049 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d27f4700 1 --2- 172.21.15.123:0/3665301049 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18cc0b8e10 0x7f18cc0bd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d1ff3700 1 -- 172.21.15.123:0/3665301049 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18cc0b8e10 msgr2=0x7f18cc0bd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:01.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d1ff3700 1 --2- 172.21.15.123:0/3665301049 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18cc0b8e10 0x7f18cc0bd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d1ff3700 1 -- 172.21.15.123:0/3665301049 >> v1:172.21.15.123:6789/0 conn(0x7f18cc0bc880 legacy=0x7f18cc0b8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d1ff3700 1 -- 172.21.15.123:0/3665301049 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc144cd0 con 0x7f18cc144900 2023-03-08T15:50:01.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d0ff1700 1 -- 172.21.15.123:0/3665301049 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065217471 0 0) 0x7f18cc0bd350 con 0x7f18cc0bc880 2023-03-08T15:50:01.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d27f4700 1 --2- 172.21.15.123:0/3665301049 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18cc0b8e10 0x7f18cc0bd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:01.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d1ff3700 1 --2- 172.21.15.123:0/3665301049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18cc144900 0x7f18cc14dbb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009840 tx=0x7f18c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01c71f7968ded97 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:01.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d0ff1700 1 -- 172.21.15.123:0/3665301049 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8011830 con 0x7f18cc144900 2023-03-08T15:50:01.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d0ff1700 1 -- 172.21.15.123:0/3665301049 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c8011990 con 0x7f18cc144900 2023-03-08T15:50:01.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.429+0000 7f18d0ff1700 1 -- 172.21.15.123:0/3665301049 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8011d20 con 0x7f18cc144900 2023-03-08T15:50:01.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.430+0000 7f18d4257700 1 -- 172.21.15.123:0/3665301049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18cc144900 msgr2=0x7f18cc14dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.430+0000 7f18d4257700 1 --2- 172.21.15.123:0/3665301049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18cc144900 0x7f18cc14dbb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009840 tx=0x7f18c8009b50 comp rx=0 tx=0).stop 2023-03-08T15:50:01.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.430+0000 7f18d4257700 1 -- 172.21.15.123:0/3665301049 shutdown_connections 2023-03-08T15:50:01.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.430+0000 7f18d4257700 1 --2- 172.21.15.123:0/3665301049 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18cc0b8e10 0x7f18cc0bd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.430+0000 7f18d4257700 1 --2- 172.21.15.123:0/3665301049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18cc144900 0x7f18cc14dbb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.430+0000 7f18d4257700 1 -- 172.21.15.123:0/3665301049 >> 172.21.15.123:0/3665301049 conn(0x7f18cc071980 msgr2=0x7f18cc071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.430+0000 7f18d4257700 1 -- 172.21.15.123:0/3665301049 shutdown_connections 2023-03-08T15:50:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.430+0000 7f18d4257700 1 -- 172.21.15.123:0/3665301049 wait complete. 2023-03-08T15:50:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.431+0000 7f18d4257700 1 Processor -- start 2023-03-08T15:50:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.431+0000 7f18d4257700 1 -- start start 2023-03-08T15:50:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d4257700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18cc0b8e10 0x7f18cc1d40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d4257700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18cc0bc880 0x7f18cc1e40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d4257700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18cc144900 0x7f18cc1e4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d4257700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc1d4610 con 0x7f18cc144900 2023-03-08T15:50:01.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d4257700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc146910 con 0x7f18cc0bc880 2023-03-08T15:50:01.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d4257700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc145b20 con 0x7f18cc0b8e10 2023-03-08T15:50:01.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d27f4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18cc144900 0x7f18cc1e4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d27f4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18cc144900 0x7f18cc1e4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41924/0 (socket says 172.21.15.123:41924) 2023-03-08T15:50:01.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d27f4700 1 -- 172.21.15.123:0/1205498918 learned_addr learned my addr 172.21.15.123:0/1205498918 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:01.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d1ff3700 1 --2- 172.21.15.123:0/1205498918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18cc0b8e10 0x7f18cc1d40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d17f2700 1 --2- 172.21.15.123:0/1205498918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18cc0bc880 0x7f18cc1e40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d27f4700 1 -- 172.21.15.123:0/1205498918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18cc0b8e10 msgr2=0x7f18cc1d40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d27f4700 1 --2- 172.21.15.123:0/1205498918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18cc0b8e10 0x7f18cc1d40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d27f4700 1 -- 172.21.15.123:0/1205498918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18cc0bc880 msgr2=0x7f18cc1e40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d27f4700 1 --2- 172.21.15.123:0/1205498918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18cc0bc880 0x7f18cc1e40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d27f4700 1 -- 172.21.15.123:0/1205498918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c80094a0 con 0x7f18cc144900 2023-03-08T15:50:01.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d27f4700 1 --2- 172.21.15.123:0/1205498918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18cc144900 0x7f18cc1e4600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009fa0 tx=0x7f18c400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:01.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18c27fc700 1 -- 172.21.15.123:0/1205498918 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4003a20 con 0x7f18cc144900 2023-03-08T15:50:01.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18c27fc700 1 -- 172.21.15.123:0/1205498918 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c400f040 con 0x7f18cc144900 2023-03-08T15:50:01.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d4257700 1 -- 172.21.15.123:0/1205498918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18cc0baae0 con 0x7f18cc144900 2023-03-08T15:50:01.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18c27fc700 1 -- 172.21.15.123:0/1205498918 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4003de0 con 0x7f18cc144900 2023-03-08T15:50:01.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.432+0000 7f18d4257700 1 -- 172.21.15.123:0/1205498918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc0ba800 con 0x7f18cc144900 2023-03-08T15:50:01.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.433+0000 7f18d4257700 1 -- 172.21.15.123:0/1205498918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18cc0bcd40 con 0x7f18cc144900 2023-03-08T15:50:01.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.434+0000 7f18c27fc700 1 -- 172.21.15.123:0/1205498918 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f18c401c030 con 0x7f18cc144900 2023-03-08T15:50:01.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.434+0000 7f18c27fc700 1 --2- 172.21.15.123:0/1205498918 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f18b0069900 0x7f18b006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.434+0000 7f18c27fc700 1 -- 172.21.15.123:0/1205498918 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f18c40876d0 con 0x7f18cc144900 2023-03-08T15:50:01.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.434+0000 7f18d1ff3700 1 --2- 172.21.15.123:0/1205498918 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f18b0069900 0x7f18b006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.434+0000 7f18d1ff3700 1 --2- 172.21.15.123:0/1205498918 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f18b0069900 0x7f18b006bdb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f18c80090b0 tx=0x7f18c801c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:01.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.438+0000 7f18c27fc700 1 -- 172.21.15.123:0/1205498918 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f18c4053440 con 0x7f18cc144900 2023-03-08T15:50:01.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.624+0000 7f18d4257700 1 -- 172.21.15.123:0/1205498918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18cc0b9970 con 0x7f18cc144900 2023-03-08T15:50:01.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.625+0000 7f18c27fc700 1 -- 172.21.15.123:0/1205498918 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f18c4056a60 con 0x7f18cc144900 2023-03-08T15:50:01.627 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:01.627 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:40.490671+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:49:37.104720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-08T15:49:38.431537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:50:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.627+0000 7f18d4257700 1 -- 172.21.15.123:0/1205498918 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f18b0069900 msgr2=0x7f18b006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.627+0000 7f18d4257700 1 --2- 172.21.15.123:0/1205498918 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f18b0069900 0x7f18b006bdb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f18c80090b0 tx=0x7f18c801c040 comp rx=0 tx=0).stop 2023-03-08T15:50:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.627+0000 7f18d4257700 1 -- 172.21.15.123:0/1205498918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18cc144900 msgr2=0x7f18cc1e4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.627+0000 7f18d4257700 1 --2- 172.21.15.123:0/1205498918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18cc144900 0x7f18cc1e4600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009fa0 tx=0x7f18c400d460 comp rx=0 tx=0).stop 2023-03-08T15:50:01.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.627+0000 7f18d4257700 1 -- 172.21.15.123:0/1205498918 shutdown_connections 2023-03-08T15:50:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.627+0000 7f18d4257700 1 --2- 172.21.15.123:0/1205498918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18cc144900 0x7f18cc1e4600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.627+0000 7f18d4257700 1 --2- 172.21.15.123:0/1205498918 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f18b0069900 0x7f18b006bdb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.627+0000 7f18d4257700 1 --2- 172.21.15.123:0/1205498918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18cc0b8e10 0x7f18cc1d40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.627+0000 7f18d4257700 1 --2- 172.21.15.123:0/1205498918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18cc0bc880 0x7f18cc1e40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.627+0000 7f18d4257700 1 -- 172.21.15.123:0/1205498918 >> 172.21.15.123:0/1205498918 conn(0x7f18cc071980 msgr2=0x7f18cc071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.628+0000 7f18d4257700 1 -- 172.21.15.123:0/1205498918 shutdown_connections 2023-03-08T15:50:01.630 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.628+0000 7f18d4257700 1 -- 172.21.15.123:0/1205498918 wait complete. 2023-03-08T15:50:01.641 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-08T15:49:26.011228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-08T15:49:32.528343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-08T15:49:37.104720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-08T15:49:38.431537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-08T15:50:01.642 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-08T15:50:01.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.762+0000 7f32ac41c700 1 Processor -- start 2023-03-08T15:50:01.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.762+0000 7f32ac41c700 1 -- start start 2023-03-08T15:50:01.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.763+0000 7f32ac41c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4147e50 0x7f32a406a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.763+0000 7f32ac41c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f32a406fef0 0x7f32a414ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.763+0000 7f32ac41c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a414b6a0 con 0x7f32a414b250 2023-03-08T15:50:01.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.763+0000 7f32ac41c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a414a810 con 0x7f32a406fef0 2023-03-08T15:50:01.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.763+0000 7f32ac41c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a4071a40 con 0x7f32a4147e50 2023-03-08T15:50:01.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.763+0000 7f32aa9b9700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f32a414b250 0x7f32a414dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42412/0 (socket says 172.21.15.123:42412) 2023-03-08T15:50:01.767 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.763+0000 7f32aa9b9700 1 -- 172.21.15.123:0/2083684265 learned_addr learned my addr 172.21.15.123:0/2083684265 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:01.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.763+0000 7f32aa1b8700 1 --2- 172.21.15.123:0/2083684265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4147e50 0x7f32a406a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.763+0000 7f32a99b7700 1 --2- 172.21.15.123:0/2083684265 >> v2:172.21.15.175:3300/0 conn(0x7f32a406fef0 0x7f32a414ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.763+0000 7f32a91b6700 1 -- 172.21.15.123:0/2083684265 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490986261 0 0) 0x7f32a414b6a0 con 0x7f32a414b250 2023-03-08T15:50:01.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.763+0000 7f32a91b6700 1 -- 172.21.15.123:0/2083684265 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32900035b0 con 0x7f32a414b250 2023-03-08T15:50:01.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 -- 172.21.15.123:0/2083684265 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1292822937 0 0) 0x7f32900035b0 con 0x7f32a414b250 2023-03-08T15:50:01.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 -- 172.21.15.123:0/2083684265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4147e50 msgr2=0x7f32a406a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:01.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 --2- 172.21.15.123:0/2083684265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4147e50 0x7f32a406a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 -- 172.21.15.123:0/2083684265 >> v2:172.21.15.175:3300/0 conn(0x7f32a406fef0 msgr2=0x7f32a414ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:01.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 --2- 172.21.15.123:0/2083684265 >> v2:172.21.15.175:3300/0 conn(0x7f32a406fef0 0x7f32a414ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 -- 172.21.15.123:0/2083684265 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a4071d20 con 0x7f32a414b250 2023-03-08T15:50:01.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 -- 172.21.15.123:0/2083684265 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f329c0019f0 con 0x7f32a414b250 2023-03-08T15:50:01.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 -- 172.21.15.123:0/2083684265 >> v1:172.21.15.123:6789/0 conn(0x7f32a414b250 legacy=0x7f32a414dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 --2- 172.21.15.123:0/2083684265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3290003a00 0x7f3290003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 --2- 172.21.15.123:0/2083684265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3290004430 0x7f32900048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 --2- 172.21.15.123:0/2083684265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4147e50 0x7f3290004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 -- 172.21.15.123:0/2083684265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a414a810 con 0x7f3290004430 2023-03-08T15:50:01.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 -- 172.21.15.123:0/2083684265 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a4071a40 con 0x7f3290003a00 2023-03-08T15:50:01.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 -- 172.21.15.123:0/2083684265 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329000ba10 con 0x7f32a4147e50 2023-03-08T15:50:01.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a99b7700 1 --2- 172.21.15.123:0/2083684265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3290004430 0x7f32900048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32aa1b8700 1 --2- 172.21.15.123:0/2083684265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3290003a00 0x7f3290003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32aa9b9700 1 --2- 172.21.15.123:0/2083684265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4147e50 0x7f3290004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a99b7700 1 -- 172.21.15.123:0/2083684265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4147e50 msgr2=0x7f3290004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:01.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a99b7700 1 --2- 172.21.15.123:0/2083684265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4147e50 0x7f3290004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a99b7700 1 -- 172.21.15.123:0/2083684265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3290003a00 msgr2=0x7f3290003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:01.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a99b7700 1 --2- 172.21.15.123:0/2083684265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3290003a00 0x7f3290003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a99b7700 1 -- 172.21.15.123:0/2083684265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32900035b0 con 0x7f3290004430 2023-03-08T15:50:01.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a99b7700 1 --2- 172.21.15.123:0/2083684265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3290004430 0x7f32900048f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009b30 tx=0x7f3290005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee1053c32b9eaba server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:01.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 -- 172.21.15.123:0/2083684265 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000e6c0 con 0x7f3290004430 2023-03-08T15:50:01.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 -- 172.21.15.123:0/2083684265 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a000e820 con 0x7f3290004430 2023-03-08T15:50:01.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.764+0000 7f32a91b6700 1 -- 172.21.15.123:0/2083684265 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000eb90 con 0x7f3290004430 2023-03-08T15:50:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.765+0000 7f32ac41c700 1 -- 172.21.15.123:0/2083684265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3290004430 msgr2=0x7f32900048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.765+0000 7f32ac41c700 1 --2- 172.21.15.123:0/2083684265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3290004430 0x7f32900048f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009b30 tx=0x7f3290005880 comp rx=0 tx=0).stop 2023-03-08T15:50:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.765+0000 7f32aa9b9700 1 -- 172.21.15.123:0/2083684265 reap_dead start 2023-03-08T15:50:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.765+0000 7f32ac41c700 1 -- 172.21.15.123:0/2083684265 shutdown_connections 2023-03-08T15:50:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.765+0000 7f32ac41c700 1 -- 172.21.15.123:0/2083684265 >> 172.21.15.123:0/2083684265 conn(0x7f32a406b360 msgr2=0x7f32a406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.765+0000 7f32ac41c700 1 -- 172.21.15.123:0/2083684265 shutdown_connections 2023-03-08T15:50:01.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.765+0000 7f32ac41c700 1 -- 172.21.15.123:0/2083684265 wait complete. 2023-03-08T15:50:01.774 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.766+0000 7f32ac41c700 1 Processor -- start 2023-03-08T15:50:01.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.766+0000 7f32ac41c700 1 -- start start 2023-03-08T15:50:01.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32ac41c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3290004430 0x7f32a40b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32ac41c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32a40b5b70 0x7f32a40b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32ac41c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4140d00 0x7f32a4141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32ac41c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a40b4790 con 0x7f32a40b5b70 2023-03-08T15:50:01.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32ac41c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a40b60a0 con 0x7f3290004430 2023-03-08T15:50:01.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32ac41c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a40b8810 con 0x7f32a4140d00 2023-03-08T15:50:01.775 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32a99b7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32a40b5b70 0x7f32a40b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32a99b7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32a40b5b70 0x7f32a40b94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41946/0 (socket says 172.21.15.123:41946) 2023-03-08T15:50:01.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32a99b7700 1 -- 172.21.15.123:0/4073422908 learned_addr learned my addr 172.21.15.123:0/4073422908 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:01.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32aa9b9700 1 --2- 172.21.15.123:0/4073422908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4140d00 0x7f32a4141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32aa1b8700 1 --2- 172.21.15.123:0/4073422908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3290004430 0x7f32a40b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32a99b7700 1 -- 172.21.15.123:0/4073422908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4140d00 msgr2=0x7f32a4141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32a99b7700 1 --2- 172.21.15.123:0/4073422908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4140d00 0x7f32a4141170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.776 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32a99b7700 1 -- 172.21.15.123:0/4073422908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3290004430 msgr2=0x7f32a40b6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32a99b7700 1 --2- 172.21.15.123:0/4073422908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3290004430 0x7f32a40b6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32a99b7700 1 -- 172.21.15.123:0/4073422908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a4148220 con 0x7f32a40b5b70 2023-03-08T15:50:01.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32aa1b8700 1 --2- 172.21.15.123:0/4073422908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3290004430 0x7f32a40b6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:01.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32a99b7700 1 --2- 172.21.15.123:0/4073422908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32a40b5b70 0x7f32a40b94c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f32900056d0 tx=0x7f32a00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:01.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f329affd700 1 -- 172.21.15.123:0/4073422908 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000e6c0 con 0x7f32a40b5b70 2023-03-08T15:50:01.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f329affd700 1 -- 172.21.15.123:0/4073422908 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a0003ab0 con 0x7f32a40b5b70 2023-03-08T15:50:01.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32ac41c700 1 -- 172.21.15.123:0/4073422908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a4072000 con 0x7f32a40b5b70 2023-03-08T15:50:01.777 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f329affd700 1 -- 172.21.15.123:0/4073422908 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0003e40 con 0x7f32a40b5b70 2023-03-08T15:50:01.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.767+0000 7f32ac41c700 1 -- 172.21.15.123:0/4073422908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a40728f0 con 0x7f32a40b5b70 2023-03-08T15:50:01.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.768+0000 7f32ac41c700 1 -- 172.21.15.123:0/4073422908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a40b5030 con 0x7f32a40b5b70 2023-03-08T15:50:01.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.769+0000 7f329affd700 1 -- 172.21.15.123:0/4073422908 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f32a0025070 con 0x7f32a40b5b70 2023-03-08T15:50:01.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.769+0000 7f329affd700 1 --2- 172.21.15.123:0/4073422908 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f32880698d0 0x7f328806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:01.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.769+0000 7f329affd700 1 -- 172.21.15.123:0/4073422908 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f32a0088f70 con 0x7f32a40b5b70 2023-03-08T15:50:01.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.769+0000 7f32aa1b8700 1 --2- 172.21.15.123:0/4073422908 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f32880698d0 0x7f328806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:01.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.769+0000 7f32aa1b8700 1 --2- 172.21.15.123:0/4073422908 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f32880698d0 0x7f328806bd80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3294009b80 tx=0x7f3294008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:01.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.773+0000 7f329affd700 1 -- 172.21.15.123:0/4073422908 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f32a00bb150 con 0x7f32a40b5b70 2023-03-08T15:50:01.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.958+0000 7f32ac41c700 1 -- 172.21.15.123:0/4073422908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32a40b8480 con 0x7f32a40b5b70 2023-03-08T15:50:01.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.958+0000 7f329affd700 1 -- 172.21.15.123:0/4073422908 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32a0054d40 con 0x7f32a40b5b70 2023-03-08T15:50:01.960 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-03-08T15:50:01.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.960+0000 7f32ac41c700 1 -- 172.21.15.123:0/4073422908 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f32880698d0 msgr2=0x7f328806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.960+0000 7f32ac41c700 1 --2- 172.21.15.123:0/4073422908 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f32880698d0 0x7f328806bd80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3294009b80 tx=0x7f3294008040 comp rx=0 tx=0).stop 2023-03-08T15:50:01.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.960+0000 7f32ac41c700 1 -- 172.21.15.123:0/4073422908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32a40b5b70 msgr2=0x7f32a40b94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:01.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.960+0000 7f32ac41c700 1 --2- 172.21.15.123:0/4073422908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32a40b5b70 0x7f32a40b94c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f32900056d0 tx=0x7f32a00047c0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.960+0000 7f32ac41c700 1 -- 172.21.15.123:0/4073422908 shutdown_connections 2023-03-08T15:50:01.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.960+0000 7f32ac41c700 1 --2- 172.21.15.123:0/4073422908 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f32880698d0 0x7f328806bd80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.960+0000 7f32ac41c700 1 --2- 172.21.15.123:0/4073422908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4140d00 0x7f32a4141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.960+0000 7f32ac41c700 1 --2- 172.21.15.123:0/4073422908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3290004430 0x7f32a40b6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.960+0000 7f32ac41c700 1 --2- 172.21.15.123:0/4073422908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32a40b5b70 0x7f32a40b94c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:01.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.960+0000 7f32ac41c700 1 -- 172.21.15.123:0/4073422908 >> 172.21.15.123:0/4073422908 conn(0x7f32a406b360 msgr2=0x7f32a406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:01.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.960+0000 7f32ac41c700 1 -- 172.21.15.123:0/4073422908 shutdown_connections 2023-03-08T15:50:01.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:01.960+0000 7f32ac41c700 1 -- 172.21.15.123:0/4073422908 wait complete. 2023-03-08T15:50:01.973 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-08T15:50:02.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.096+0000 7f47208c5700 1 Processor -- start 2023-03-08T15:50:02.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.096+0000 7f47208c5700 1 -- start start 2023-03-08T15:50:02.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f47208c5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f471c0b3220 0x7f471c1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f47208c5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f471c0b6e00 0x7f471c155640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f47208c5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471c1482c0 con 0x7f471c0b47e0 2023-03-08T15:50:02.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f47208c5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f471c0b4620 con 0x7f471c0b6e00 2023-03-08T15:50:02.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f47208c5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471c14ae50 con 0x7f471c0b3220 2023-03-08T15:50:02.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f471ad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f471c0b6e00 0x7f471c155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f471a59c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f471c0b47e0 0x7f471c14b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42420/0 (socket says 172.21.15.123:42420) 2023-03-08T15:50:02.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f471a59c700 1 -- 172.21.15.123:0/165017930 learned_addr learned my addr 172.21.15.123:0/165017930 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:02.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f4719d9b700 1 --2- 172.21.15.123:0/165017930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f471c0b3220 0x7f471c1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f471ad9d700 1 -- 172.21.15.123:0/165017930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f471c0b3220 msgr2=0x7f471c1530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:02.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f471ad9d700 1 --2- 172.21.15.123:0/165017930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f471c0b3220 0x7f471c1530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f471ad9d700 1 -- 172.21.15.123:0/165017930 >> v1:172.21.15.123:6789/0 conn(0x7f471c0b47e0 legacy=0x7f471c14b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f471959a700 1 -- 172.21.15.123:0/165017930 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408913450 0 0) 0x7f471c1482c0 con 0x7f471c0b47e0 2023-03-08T15:50:02.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f471ad9d700 1 -- 172.21.15.123:0/165017930 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c0b4340 con 0x7f471c0b6e00 2023-03-08T15:50:02.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f471ad9d700 1 --2- 172.21.15.123:0/165017930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f471c0b6e00 0x7f471c155640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4714009dc0 tx=0x7f471400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7975789fb8b08315 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:02.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f471959a700 1 -- 172.21.15.123:0/165017930 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471400e070 con 0x7f471c0b6e00 2023-03-08T15:50:02.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f471959a700 1 -- 172.21.15.123:0/165017930 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471400bb90 con 0x7f471c0b6e00 2023-03-08T15:50:02.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.097+0000 7f471959a700 1 -- 172.21.15.123:0/165017930 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714012430 con 0x7f471c0b6e00 2023-03-08T15:50:02.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.098+0000 7f47208c5700 1 -- 172.21.15.123:0/165017930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f471c0b6e00 msgr2=0x7f471c155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.098+0000 7f47208c5700 1 --2- 172.21.15.123:0/165017930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f471c0b6e00 0x7f471c155640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4714009dc0 tx=0x7f471400b330 comp rx=0 tx=0).stop 2023-03-08T15:50:02.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.098+0000 7f47208c5700 1 -- 172.21.15.123:0/165017930 shutdown_connections 2023-03-08T15:50:02.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.098+0000 7f47208c5700 1 --2- 172.21.15.123:0/165017930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f471c0b6e00 0x7f471c155640 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.098+0000 7f47208c5700 1 --2- 172.21.15.123:0/165017930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f471c0b3220 0x7f471c1530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.098+0000 7f47208c5700 1 -- 172.21.15.123:0/165017930 >> 172.21.15.123:0/165017930 conn(0x7f471c0bc480 msgr2=0x7f471c0bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:02.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.098+0000 7f47208c5700 1 -- 172.21.15.123:0/165017930 shutdown_connections 2023-03-08T15:50:02.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.098+0000 7f47208c5700 1 -- 172.21.15.123:0/165017930 wait complete. 2023-03-08T15:50:02.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.099+0000 7f47208c5700 1 Processor -- start 2023-03-08T15:50:02.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.099+0000 7f47208c5700 1 -- start start 2023-03-08T15:50:02.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f47208c5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f471c0b3220 0x7f471c06e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f47208c5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f471c0b47e0 0x7f471c070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f47208c5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f471c0b6e00 0x7f471c06f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f47208c5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471c0723a0 con 0x7f471c0b6e00 2023-03-08T15:50:02.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f47208c5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471c071740 con 0x7f471c0b3220 2023-03-08T15:50:02.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f47208c5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471c1d7770 con 0x7f471c0b47e0 2023-03-08T15:50:02.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f471ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f471c0b6e00 0x7f471c06f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f4719d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f471c0b47e0 0x7f471c070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f471ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f471c0b6e00 0x7f471c06f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41962/0 (socket says 172.21.15.123:41962) 2023-03-08T15:50:02.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f471ad9d700 1 -- 172.21.15.123:0/1405306430 learned_addr learned my addr 172.21.15.123:0/1405306430 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:02.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f471a59c700 1 --2- 172.21.15.123:0/1405306430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f471c0b3220 0x7f471c06e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f471ad9d700 1 -- 172.21.15.123:0/1405306430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f471c0b47e0 msgr2=0x7f471c070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f471ad9d700 1 --2- 172.21.15.123:0/1405306430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f471c0b47e0 0x7f471c070c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f471ad9d700 1 -- 172.21.15.123:0/1405306430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f471c0b3220 msgr2=0x7f471c06e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f471ad9d700 1 --2- 172.21.15.123:0/1405306430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f471c0b3220 0x7f471c06e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f471ad9d700 1 -- 172.21.15.123:0/1405306430 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4714009a70 con 0x7f471c0b6e00 2023-03-08T15:50:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f471ad9d700 1 --2- 172.21.15.123:0/1405306430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f471c0b6e00 0x7f471c06f4c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4714014040 tx=0x7f4714004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f470affd700 1 -- 172.21.15.123:0/1405306430 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714004800 con 0x7f471c0b6e00 2023-03-08T15:50:02.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f470affd700 1 -- 172.21.15.123:0/1405306430 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4714020070 con 0x7f471c0b6e00 2023-03-08T15:50:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f470affd700 1 -- 172.21.15.123:0/1405306430 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47140276c0 con 0x7f471c0b6e00 2023-03-08T15:50:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.100+0000 7f47208c5700 1 -- 172.21.15.123:0/1405306430 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f471c0b6720 con 0x7f471c0b6e00 2023-03-08T15:50:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.101+0000 7f47208c5700 1 -- 172.21.15.123:0/1405306430 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471c14aa70 con 0x7f471c0b6e00 2023-03-08T15:50:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.101+0000 7f47208c5700 1 -- 172.21.15.123:0/1405306430 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471c06aee0 con 0x7f471c0b6e00 2023-03-08T15:50:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.102+0000 7f470affd700 1 -- 172.21.15.123:0/1405306430 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f4714012430 con 0x7f471c0b6e00 2023-03-08T15:50:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.102+0000 7f470affd700 1 --2- 172.21.15.123:0/1405306430 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f46fc0698d0 0x7f46fc06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.102+0000 7f470affd700 1 -- 172.21.15.123:0/1405306430 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4714022070 con 0x7f471c0b6e00 2023-03-08T15:50:02.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.102+0000 7f471a59c700 1 --2- 172.21.15.123:0/1405306430 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f46fc0698d0 0x7f46fc06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.102+0000 7f471a59c700 1 --2- 172.21.15.123:0/1405306430 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f46fc0698d0 0x7f46fc06bd80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4710007fd0 tx=0x7f4710007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:02.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.106+0000 7f470affd700 1 -- 172.21.15.123:0/1405306430 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f4714055620 con 0x7f471c0b6e00 2023-03-08T15:50:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.292+0000 7f47208c5700 1 -- 172.21.15.123:0/1405306430 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f471c0744c0 con 0x7f471c0b6e00 2023-03-08T15:50:02.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.292+0000 7f470affd700 1 -- 172.21.15.123:0/1405306430 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f471402c0a0 con 0x7f471c0b6e00 2023-03-08T15:50:02.294 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-03-08T15:50:02.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.294+0000 7f47208c5700 1 -- 172.21.15.123:0/1405306430 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f46fc0698d0 msgr2=0x7f46fc06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.294+0000 7f47208c5700 1 --2- 172.21.15.123:0/1405306430 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f46fc0698d0 0x7f46fc06bd80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4710007fd0 tx=0x7f4710007de0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.294+0000 7f47208c5700 1 -- 172.21.15.123:0/1405306430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f471c0b6e00 msgr2=0x7f471c06f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.294+0000 7f47208c5700 1 --2- 172.21.15.123:0/1405306430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f471c0b6e00 0x7f471c06f4c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4714014040 tx=0x7f4714004ad0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.294+0000 7f47208c5700 1 -- 172.21.15.123:0/1405306430 shutdown_connections 2023-03-08T15:50:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.294+0000 7f47208c5700 1 --2- 172.21.15.123:0/1405306430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f471c0b6e00 0x7f471c06f4c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.294+0000 7f47208c5700 1 --2- 172.21.15.123:0/1405306430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f471c0b3220 0x7f471c06e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.294+0000 7f47208c5700 1 --2- 172.21.15.123:0/1405306430 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f46fc0698d0 0x7f46fc06bd80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.294+0000 7f47208c5700 1 --2- 172.21.15.123:0/1405306430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f471c0b47e0 0x7f471c070c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.294+0000 7f47208c5700 1 -- 172.21.15.123:0/1405306430 >> 172.21.15.123:0/1405306430 conn(0x7f471c0bc480 msgr2=0x7f471c0b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:02.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.294+0000 7f47208c5700 1 -- 172.21.15.123:0/1405306430 shutdown_connections 2023-03-08T15:50:02.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.294+0000 7f47208c5700 1 -- 172.21.15.123:0/1405306430 wait complete. 2023-03-08T15:50:02.307 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-08T15:50:02.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.428+0000 7f25acf51700 1 Processor -- start 2023-03-08T15:50:02.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.428+0000 7f25acf51700 1 -- start start 2023-03-08T15:50:02.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.429+0000 7f25acf51700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f25a81427e0 0x7f25a80b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.429+0000 7f25acf51700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25a8070b00 0x7f25a8148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.429+0000 7f25acf51700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f25a80a0f70 0x7f25a806d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.429+0000 7f25acf51700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a81484d0 con 0x7f25a81427e0 2023-03-08T15:50:02.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.429+0000 7f25acf51700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a8148a30 con 0x7f25a80a0f70 2023-03-08T15:50:02.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.429+0000 7f25acf51700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a8072970 con 0x7f25a8070b00 2023-03-08T15:50:02.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.429+0000 7f25a659c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f25a81427e0 0x7f25a80b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.429+0000 7f25a659c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f25a81427e0 0x7f25a80b3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41978/0 (socket says 172.21.15.123:41978) 2023-03-08T15:50:02.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.429+0000 7f25a659c700 1 -- 172.21.15.123:0/2132818884 learned_addr learned my addr 172.21.15.123:0/2132818884 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:02.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.429+0000 7f25a6d9d700 1 --2- 172.21.15.123:0/2132818884 >> v2:172.21.15.175:3300/0 conn(0x7f25a80a0f70 0x7f25a806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.429+0000 7f25a5d9b700 1 --2- 172.21.15.123:0/2132818884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25a8070b00 0x7f25a8148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25a659c700 1 -- 172.21.15.123:0/2132818884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25a8070b00 msgr2=0x7f25a8148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25a659c700 1 --2- 172.21.15.123:0/2132818884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25a8070b00 0x7f25a8148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25a659c700 1 -- 172.21.15.123:0/2132818884 >> v2:172.21.15.175:3300/0 conn(0x7f25a80a0f70 msgr2=0x7f25a806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25a659c700 1 --2- 172.21.15.123:0/2132818884 >> v2:172.21.15.175:3300/0 conn(0x7f25a80a0f70 0x7f25a806d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25a659c700 1 -- 172.21.15.123:0/2132818884 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a8149400 con 0x7f25a81427e0 2023-03-08T15:50:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25a5d9b700 1 --2- 172.21.15.123:0/2132818884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25a8070b00 0x7f25a8148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25a6d9d700 1 --2- 172.21.15.123:0/2132818884 >> v2:172.21.15.175:3300/0 conn(0x7f25a80a0f70 0x7f25a806d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25a659c700 1 --2- 172.21.15.123:0/2132818884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25a81427e0 0x7f25a80b3a50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f25a8070a90 tx=0x7f259c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7690108dfe1f34e8 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:02.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25a559a700 1 -- 172.21.15.123:0/2132818884 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c00b870 con 0x7f25a81427e0 2023-03-08T15:50:02.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25a559a700 1 -- 172.21.15.123:0/2132818884 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c00b9d0 con 0x7f25a81427e0 2023-03-08T15:50:02.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25a559a700 1 -- 172.21.15.123:0/2132818884 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c00bd60 con 0x7f25a81427e0 2023-03-08T15:50:02.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25acf51700 1 -- 172.21.15.123:0/2132818884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25a81427e0 msgr2=0x7f25a80b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25acf51700 1 --2- 172.21.15.123:0/2132818884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25a81427e0 0x7f25a80b3a50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f25a8070a90 tx=0x7f259c009bd0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25acf51700 1 -- 172.21.15.123:0/2132818884 shutdown_connections 2023-03-08T15:50:02.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25acf51700 1 --2- 172.21.15.123:0/2132818884 >> v2:172.21.15.175:3300/0 conn(0x7f25a80a0f70 0x7f25a806d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25acf51700 1 --2- 172.21.15.123:0/2132818884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25a81427e0 0x7f25a80b3a50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25acf51700 1 --2- 172.21.15.123:0/2132818884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25a8070b00 0x7f25a8148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25acf51700 1 -- 172.21.15.123:0/2132818884 >> 172.21.15.123:0/2132818884 conn(0x7f25a80be6f0 msgr2=0x7f25a80beac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:02.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25acf51700 1 -- 172.21.15.123:0/2132818884 shutdown_connections 2023-03-08T15:50:02.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.430+0000 7f25acf51700 1 -- 172.21.15.123:0/2132818884 wait complete. 2023-03-08T15:50:02.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.432+0000 7f25acf51700 1 Processor -- start 2023-03-08T15:50:02.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.432+0000 7f25acf51700 1 -- start start 2023-03-08T15:50:02.438 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.432+0000 7f25acf51700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25a8070b00 0x7f25a81e1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.432+0000 7f25acf51700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25a80a0f70 0x7f25a80a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.432+0000 7f25acf51700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a81427e0 0x7f25a80a2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.432+0000 7f25acf51700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a80a1930 con 0x7f25a80a0f70 2023-03-08T15:50:02.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.432+0000 7f25acf51700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a81e1840 con 0x7f25a81427e0 2023-03-08T15:50:02.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.432+0000 7f25acf51700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a813b320 con 0x7f25a8070b00 2023-03-08T15:50:02.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.432+0000 7f25a5d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25a80a0f70 0x7f25a80a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.439 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.432+0000 7f25a5d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25a80a0f70 0x7f25a80a1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41988/0 (socket says 172.21.15.123:41988) 2023-03-08T15:50:02.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.432+0000 7f25a5d9b700 1 -- 172.21.15.123:0/3113844185 learned_addr learned my addr 172.21.15.123:0/3113844185 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:02.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.432+0000 7f25a659c700 1 --2- 172.21.15.123:0/3113844185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25a8070b00 0x7f25a81e1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.432+0000 7f25a6d9d700 1 --2- 172.21.15.123:0/3113844185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a81427e0 0x7f25a80a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.433+0000 7f25a5d9b700 1 -- 172.21.15.123:0/3113844185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25a8070b00 msgr2=0x7f25a81e1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.433+0000 7f25a5d9b700 1 --2- 172.21.15.123:0/3113844185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25a8070b00 0x7f25a81e1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.433+0000 7f25a5d9b700 1 -- 172.21.15.123:0/3113844185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a81427e0 msgr2=0x7f25a80a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.433+0000 7f25a5d9b700 1 --2- 172.21.15.123:0/3113844185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a81427e0 0x7f25a80a2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.440 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.433+0000 7f25a5d9b700 1 -- 172.21.15.123:0/3113844185 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c009550 con 0x7f25a80a0f70 2023-03-08T15:50:02.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.433+0000 7f25a5d9b700 1 --2- 172.21.15.123:0/3113844185 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25a80a0f70 0x7f25a80a1dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f259800e760 tx=0x7f259800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:02.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.433+0000 7f2596ffd700 1 -- 172.21.15.123:0/3113844185 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259800c070 con 0x7f25a80a0f70 2023-03-08T15:50:02.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.433+0000 7f2596ffd700 1 -- 172.21.15.123:0/3113844185 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2598013610 con 0x7f25a80a0f70 2023-03-08T15:50:02.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.433+0000 7f2596ffd700 1 -- 172.21.15.123:0/3113844185 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980139c0 con 0x7f25a80a0f70 2023-03-08T15:50:02.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.433+0000 7f25acf51700 1 -- 172.21.15.123:0/3113844185 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a80718a0 con 0x7f25a80a0f70 2023-03-08T15:50:02.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.433+0000 7f25acf51700 1 -- 172.21.15.123:0/3113844185 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a80715d0 con 0x7f25a80a0f70 2023-03-08T15:50:02.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.434+0000 7f25acf51700 1 -- 172.21.15.123:0/3113844185 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a81486c0 con 0x7f25a80a0f70 2023-03-08T15:50:02.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.434+0000 7f2596ffd700 1 -- 172.21.15.123:0/3113844185 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f2598023070 con 0x7f25a80a0f70 2023-03-08T15:50:02.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.435+0000 7f2596ffd700 1 --2- 172.21.15.123:0/3113844185 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f25880698d0 0x7f258806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.435+0000 7f2596ffd700 1 -- 172.21.15.123:0/3113844185 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2598087270 con 0x7f25a80a0f70 2023-03-08T15:50:02.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.435+0000 7f25a659c700 1 --2- 172.21.15.123:0/3113844185 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f25880698d0 0x7f258806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.435+0000 7f25a659c700 1 --2- 172.21.15.123:0/3113844185 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f25880698d0 0x7f258806bd80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f259c000c00 tx=0x7f259c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:02.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.439+0000 7f2596ffd700 1 -- 172.21.15.123:0/3113844185 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f2598053040 con 0x7f25a80a0f70 2023-03-08T15:50:02.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.622+0000 7f25acf51700 1 -- 172.21.15.123:0/3113844185 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25a80a1780 con 0x7f25a80a0f70 2023-03-08T15:50:02.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.622+0000 7f2596ffd700 1 -- 172.21.15.123:0/3113844185 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2598056660 con 0x7f25a80a0f70 2023-03-08T15:50:02.624 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-03-08T15:50:02.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.625+0000 7f25acf51700 1 -- 172.21.15.123:0/3113844185 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f25880698d0 msgr2=0x7f258806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.625+0000 7f25acf51700 1 --2- 172.21.15.123:0/3113844185 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f25880698d0 0x7f258806bd80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f259c000c00 tx=0x7f259c008030 comp rx=0 tx=0).stop 2023-03-08T15:50:02.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.625+0000 7f25acf51700 1 -- 172.21.15.123:0/3113844185 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25a80a0f70 msgr2=0x7f25a80a1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.625+0000 7f25acf51700 1 --2- 172.21.15.123:0/3113844185 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25a80a0f70 0x7f25a80a1dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f259800e760 tx=0x7f259800ea70 comp rx=0 tx=0).stop 2023-03-08T15:50:02.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.625+0000 7f25acf51700 1 -- 172.21.15.123:0/3113844185 shutdown_connections 2023-03-08T15:50:02.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.625+0000 7f25acf51700 1 --2- 172.21.15.123:0/3113844185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a81427e0 0x7f25a80a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.625+0000 7f25acf51700 1 --2- 172.21.15.123:0/3113844185 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f25880698d0 0x7f258806bd80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.625+0000 7f25acf51700 1 --2- 172.21.15.123:0/3113844185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25a8070b00 0x7f25a81e1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.625+0000 7f25acf51700 1 --2- 172.21.15.123:0/3113844185 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25a80a0f70 0x7f25a80a1dc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.625+0000 7f25acf51700 1 -- 172.21.15.123:0/3113844185 >> 172.21.15.123:0/3113844185 conn(0x7f25a80be6f0 msgr2=0x7f25a8141990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:02.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.625+0000 7f25acf51700 1 -- 172.21.15.123:0/3113844185 shutdown_connections 2023-03-08T15:50:02.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.625+0000 7f25acf51700 1 -- 172.21.15.123:0/3113844185 wait complete. 2023-03-08T15:50:02.638 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-08T15:50:02.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.759+0000 7fa6b7ed5700 1 Processor -- start 2023-03-08T15:50:02.761 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.760+0000 7fa6b7ed5700 1 -- start start 2023-03-08T15:50:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.760+0000 7fa6b7ed5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa6b00bb350 0x7fa6b01446b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.760+0000 7fa6b7ed5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa6b014e090 0x7fa6b014e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.760+0000 7fa6b7ed5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b014dc00 con 0x7fa6b0144bf0 2023-03-08T15:50:02.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.760+0000 7fa6b7ed5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b006bb70 con 0x7fa6b014e090 2023-03-08T15:50:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.760+0000 7fa6b7ed5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b00b9fc0 con 0x7fa6b00bb350 2023-03-08T15:50:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.760+0000 7fa6b6472700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa6b014e090 0x7fa6b014e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.760+0000 7fa6b6472700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa6b014e090 0x7fa6b014e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41996/0 (socket says 172.21.15.123:41996) 2023-03-08T15:50:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.760+0000 7fa6b6472700 1 -- 172.21.15.123:0/658671535 learned_addr learned my addr 172.21.15.123:0/658671535 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.761+0000 7fa6b5c71700 1 --2- 172.21.15.123:0/658671535 >> v2:172.21.15.175:3300/0 conn(0x7fa6b00bb350 0x7fa6b01446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.761+0000 7fa6b6472700 1 -- 172.21.15.123:0/658671535 >> v2:172.21.15.175:3300/0 conn(0x7fa6b00bb350 msgr2=0x7fa6b01446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:02.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.761+0000 7fa6b6472700 1 --2- 172.21.15.123:0/658671535 >> v2:172.21.15.175:3300/0 conn(0x7fa6b00bb350 0x7fa6b01446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.761+0000 7fa6b6472700 1 -- 172.21.15.123:0/658671535 >> v1:172.21.15.175:6789/0 conn(0x7fa6b0144bf0 legacy=0x7fa6b00bdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.761+0000 7fa6b6472700 1 -- 172.21.15.123:0/658671535 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b00ba2a0 con 0x7fa6b014e090 2023-03-08T15:50:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.761+0000 7fa6b5c71700 1 --2- 172.21.15.123:0/658671535 >> v2:172.21.15.175:3300/0 conn(0x7fa6b00bb350 0x7fa6b01446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.761+0000 7fa6b6472700 1 --2- 172.21.15.123:0/658671535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b014e090 0x7fa6b014e4b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00703b0 tx=0x7fa6a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffb8afcb6d97cd8 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.761+0000 7fa6b4c6f700 1 -- 172.21.15.123:0/658671535 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a800e070 con 0x7fa6b014e090 2023-03-08T15:50:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.761+0000 7fa6b4c6f700 1 -- 172.21.15.123:0/658671535 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a800b9c0 con 0x7fa6b014e090 2023-03-08T15:50:02.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.761+0000 7fa6b4c6f700 1 -- 172.21.15.123:0/658671535 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a800bd70 con 0x7fa6b014e090 2023-03-08T15:50:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.761+0000 7fa6b7ed5700 1 -- 172.21.15.123:0/658671535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b014e090 msgr2=0x7fa6b014e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.761+0000 7fa6b7ed5700 1 --2- 172.21.15.123:0/658671535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b014e090 0x7fa6b014e4b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa6b00703b0 tx=0x7fa6a800b330 comp rx=0 tx=0).stop 2023-03-08T15:50:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.761+0000 7fa6b7ed5700 1 -- 172.21.15.123:0/658671535 shutdown_connections 2023-03-08T15:50:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.762+0000 7fa6b7ed5700 1 --2- 172.21.15.123:0/658671535 >> v2:172.21.15.175:3300/0 conn(0x7fa6b00bb350 0x7fa6b01446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.762+0000 7fa6b7ed5700 1 --2- 172.21.15.123:0/658671535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b014e090 0x7fa6b014e4b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.762+0000 7fa6b7ed5700 1 -- 172.21.15.123:0/658671535 >> 172.21.15.123:0/658671535 conn(0x7fa6b006a250 msgr2=0x7fa6b006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.762+0000 7fa6b7ed5700 1 -- 172.21.15.123:0/658671535 shutdown_connections 2023-03-08T15:50:02.766 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.762+0000 7fa6b7ed5700 1 -- 172.21.15.123:0/658671535 wait complete. 2023-03-08T15:50:02.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.763+0000 7fa6b7ed5700 1 Processor -- start 2023-03-08T15:50:02.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.763+0000 7fa6b7ed5700 1 -- start start 2023-03-08T15:50:02.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.763+0000 7fa6b7ed5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6b00bb350 0x7fa6b0147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.763+0000 7fa6b7ed5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b0144bf0 0x7fa6b013ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.763+0000 7fa6b7ed5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6b014e090 0x7fa6b0143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.763+0000 7fa6b7ed5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b01404d0 con 0x7fa6b0144bf0 2023-03-08T15:50:02.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.763+0000 7fa6b7ed5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0143170 con 0x7fa6b014e090 2023-03-08T15:50:02.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.763+0000 7fa6b7ed5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b01457e0 con 0x7fa6b00bb350 2023-03-08T15:50:02.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.763+0000 7fa6b5470700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b0144bf0 0x7fa6b013ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.763+0000 7fa6b5470700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b0144bf0 0x7fa6b013ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42000/0 (socket says 172.21.15.123:42000) 2023-03-08T15:50:02.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.763+0000 7fa6b5470700 1 -- 172.21.15.123:0/1339867031 learned_addr learned my addr 172.21.15.123:0/1339867031 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:02.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.763+0000 7fa6b6472700 1 --2- 172.21.15.123:0/1339867031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6b014e090 0x7fa6b0143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.763+0000 7fa6b5c71700 1 --2- 172.21.15.123:0/1339867031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6b00bb350 0x7fa6b0147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.764+0000 7fa6b5470700 1 -- 172.21.15.123:0/1339867031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6b00bb350 msgr2=0x7fa6b0147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.764+0000 7fa6b5470700 1 --2- 172.21.15.123:0/1339867031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6b00bb350 0x7fa6b0147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.764+0000 7fa6b5470700 1 -- 172.21.15.123:0/1339867031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6b014e090 msgr2=0x7fa6b0143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.764+0000 7fa6b5470700 1 --2- 172.21.15.123:0/1339867031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6b014e090 0x7fa6b0143820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.764+0000 7fa6b5470700 1 -- 172.21.15.123:0/1339867031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a8009b30 con 0x7fa6b0144bf0 2023-03-08T15:50:02.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.764+0000 7fa6b5470700 1 --2- 172.21.15.123:0/1339867031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b0144bf0 0x7fa6b013ff90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000c4e0 tx=0x7fa6a000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:02.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.764+0000 7fa6a67fc700 1 -- 172.21.15.123:0/1339867031 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00052d0 con 0x7fa6b0144bf0 2023-03-08T15:50:02.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.764+0000 7fa6a67fc700 1 -- 172.21.15.123:0/1339867031 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a0005430 con 0x7fa6b0144bf0 2023-03-08T15:50:02.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.764+0000 7fa6b7ed5700 1 -- 172.21.15.123:0/1339867031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b014e9f0 con 0x7fa6b0144bf0 2023-03-08T15:50:02.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.764+0000 7fa6a67fc700 1 -- 172.21.15.123:0/1339867031 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00038c0 con 0x7fa6b0144bf0 2023-03-08T15:50:02.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.764+0000 7fa6b7ed5700 1 -- 172.21.15.123:0/1339867031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b00ba580 con 0x7fa6b0144bf0 2023-03-08T15:50:02.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.765+0000 7fa6b7ed5700 1 -- 172.21.15.123:0/1339867031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b00bb720 con 0x7fa6b0144bf0 2023-03-08T15:50:02.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.765+0000 7fa6a67fc700 1 -- 172.21.15.123:0/1339867031 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fa6a0019030 con 0x7fa6b0144bf0 2023-03-08T15:50:02.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.766+0000 7fa6a67fc700 1 --2- 172.21.15.123:0/1339867031 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa6940698d0 0x7fa69406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:02.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.766+0000 7fa6b5c71700 1 --2- 172.21.15.123:0/1339867031 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa6940698d0 0x7fa69406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:02.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.766+0000 7fa6a67fc700 1 -- 172.21.15.123:0/1339867031 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6a0086670 con 0x7fa6b0144bf0 2023-03-08T15:50:02.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.766+0000 7fa6b5c71700 1 --2- 172.21.15.123:0/1339867031 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa6940698d0 0x7fa69406bd80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac006f10 tx=0x7fa6ac008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:02.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.770+0000 7fa6a67fc700 1 -- 172.21.15.123:0/1339867031 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fa6a0052440 con 0x7fa6b0144bf0 2023-03-08T15:50:02.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.957+0000 7fa6b7ed5700 1 -- 172.21.15.123:0/1339867031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6b013a480 con 0x7fa6b0144bf0 2023-03-08T15:50:02.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.957+0000 7fa6a67fc700 1 -- 172.21.15.123:0/1339867031 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6a0084e60 con 0x7fa6b0144bf0 2023-03-08T15:50:02.959 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-03-08T15:50:02.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.959+0000 7fa6b7ed5700 1 -- 172.21.15.123:0/1339867031 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa6940698d0 msgr2=0x7fa69406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.959+0000 7fa6b7ed5700 1 --2- 172.21.15.123:0/1339867031 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa6940698d0 0x7fa69406bd80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac006f10 tx=0x7fa6ac008040 comp rx=0 tx=0).stop 2023-03-08T15:50:02.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.959+0000 7fa6b7ed5700 1 -- 172.21.15.123:0/1339867031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b0144bf0 msgr2=0x7fa6b013ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:02.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.959+0000 7fa6b7ed5700 1 --2- 172.21.15.123:0/1339867031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b0144bf0 0x7fa6b013ff90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000c4e0 tx=0x7fa6a000c7f0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.959+0000 7fa6b7ed5700 1 -- 172.21.15.123:0/1339867031 shutdown_connections 2023-03-08T15:50:02.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.959+0000 7fa6b7ed5700 1 --2- 172.21.15.123:0/1339867031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6b014e090 0x7fa6b0143820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.959+0000 7fa6b7ed5700 1 --2- 172.21.15.123:0/1339867031 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa6940698d0 0x7fa69406bd80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.959+0000 7fa6b7ed5700 1 --2- 172.21.15.123:0/1339867031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6b00bb350 0x7fa6b0147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.959+0000 7fa6b7ed5700 1 --2- 172.21.15.123:0/1339867031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b0144bf0 0x7fa6b013ff90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:02.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.959+0000 7fa6b7ed5700 1 -- 172.21.15.123:0/1339867031 >> 172.21.15.123:0/1339867031 conn(0x7fa6b006a250 msgr2=0x7fa6b0139d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:02.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.959+0000 7fa6b7ed5700 1 -- 172.21.15.123:0/1339867031 shutdown_connections 2023-03-08T15:50:02.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:02.959+0000 7fa6b7ed5700 1 -- 172.21.15.123:0/1339867031 wait complete. 2023-03-08T15:50:02.982 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-03-08T15:50:02.983 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-03-08T15:50:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.104+0000 7f3fd76f5700 1 Processor -- start 2023-03-08T15:50:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.104+0000 7f3fd76f5700 1 -- start start 2023-03-08T15:50:03.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fd76f5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3fd0072760 0x7f3fd006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:03.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fd76f5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3fd0071df0 0x7f3fd014aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fd76f5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd0070670 con 0x7f3fd00ba280 2023-03-08T15:50:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fd76f5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd0070a40 con 0x7f3fd0072760 2023-03-08T15:50:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fd76f5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd0070c50 con 0x7f3fd0071df0 2023-03-08T15:50:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fd4c90700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3fd0072760 0x7f3fd006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fd4c90700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3fd0072760 0x7f3fd006fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42006/0 (socket says 172.21.15.123:42006) 2023-03-08T15:50:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fd4c90700 1 -- 172.21.15.123:0/3426313188 learned_addr learned my addr 172.21.15.123:0/3426313188 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fd5c92700 1 --2- 172.21.15.123:0/3426313188 >> v2:172.21.15.175:3300/0 conn(0x7f3fd0071df0 0x7f3fd014aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fd4c90700 1 -- 172.21.15.123:0/3426313188 >> v2:172.21.15.175:3300/0 conn(0x7f3fd0071df0 msgr2=0x7f3fd014aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fd4c90700 1 --2- 172.21.15.123:0/3426313188 >> v2:172.21.15.175:3300/0 conn(0x7f3fd0071df0 0x7f3fd014aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fd4c90700 1 -- 172.21.15.123:0/3426313188 >> v1:172.21.15.175:6789/0 conn(0x7f3fd00ba280 legacy=0x7f3fd0141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fd4c90700 1 -- 172.21.15.123:0/3426313188 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd00ba650 con 0x7f3fd0072760 2023-03-08T15:50:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fd4c90700 1 --2- 172.21.15.123:0/3426313188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd0072760 0x7f3fd006fff0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00b99e0 tx=0x7f3fc000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e6efbd6b730443 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fc7fff700 1 -- 172.21.15.123:0/3426313188 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc000dcf0 con 0x7f3fd0072760 2023-03-08T15:50:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fc7fff700 1 -- 172.21.15.123:0/3426313188 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc000de50 con 0x7f3fd0072760 2023-03-08T15:50:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.105+0000 7f3fc7fff700 1 -- 172.21.15.123:0/3426313188 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0004250 con 0x7f3fd0072760 2023-03-08T15:50:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.106+0000 7f3fd76f5700 1 -- 172.21.15.123:0/3426313188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd0072760 msgr2=0x7f3fd006fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.106+0000 7f3fd76f5700 1 --2- 172.21.15.123:0/3426313188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd0072760 0x7f3fd006fff0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00b99e0 tx=0x7f3fc000be70 comp rx=0 tx=0).stop 2023-03-08T15:50:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.106+0000 7f3fd76f5700 1 -- 172.21.15.123:0/3426313188 shutdown_connections 2023-03-08T15:50:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.106+0000 7f3fd76f5700 1 --2- 172.21.15.123:0/3426313188 >> v2:172.21.15.175:3300/0 conn(0x7f3fd0071df0 0x7f3fd014aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.106+0000 7f3fd76f5700 1 --2- 172.21.15.123:0/3426313188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd0072760 0x7f3fd006fff0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.106+0000 7f3fd76f5700 1 -- 172.21.15.123:0/3426313188 >> 172.21.15.123:0/3426313188 conn(0x7f3fd006b360 msgr2=0x7f3fd006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.106+0000 7f3fd76f5700 1 -- 172.21.15.123:0/3426313188 shutdown_connections 2023-03-08T15:50:03.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.106+0000 7f3fd76f5700 1 -- 172.21.15.123:0/3426313188 wait complete. 2023-03-08T15:50:03.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.107+0000 7f3fd76f5700 1 Processor -- start 2023-03-08T15:50:03.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.107+0000 7f3fd76f5700 1 -- start start 2023-03-08T15:50:03.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.107+0000 7f3fd76f5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fd0071df0 0x7f3fd00bd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:03.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.107+0000 7f3fd76f5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd00ba280 0x7f3fd00bb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:03.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.107+0000 7f3fd76f5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fd013d480 0x7f3fd00b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:03.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.107+0000 7f3fd76f5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00bb920 con 0x7f3fd00ba280 2023-03-08T15:50:03.113 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.107+0000 7f3fd76f5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd013d920 con 0x7f3fd0071df0 2023-03-08T15:50:03.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.107+0000 7f3fd76f5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00b7060 con 0x7f3fd013d480 2023-03-08T15:50:03.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fd4c90700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd00ba280 0x7f3fd00bb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:03.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fd4c90700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd00ba280 0x7f3fd00bb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42010/0 (socket says 172.21.15.123:42010) 2023-03-08T15:50:03.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fd4c90700 1 -- 172.21.15.123:0/2347232897 learned_addr learned my addr 172.21.15.123:0/2347232897 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:03.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fd5491700 1 --2- 172.21.15.123:0/2347232897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fd0071df0 0x7f3fd00bd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:03.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fd5c92700 1 --2- 172.21.15.123:0/2347232897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fd013d480 0x7f3fd00b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:03.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fd4c90700 1 -- 172.21.15.123:0/2347232897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fd013d480 msgr2=0x7f3fd00b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:03.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fd4c90700 1 --2- 172.21.15.123:0/2347232897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fd013d480 0x7f3fd00b6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:03.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fd4c90700 1 -- 172.21.15.123:0/2347232897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fd0071df0 msgr2=0x7f3fd00bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:03.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fd4c90700 1 --2- 172.21.15.123:0/2347232897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fd0071df0 0x7f3fd00bd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:03.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fd4c90700 1 -- 172.21.15.123:0/2347232897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc000b7f0 con 0x7f3fd00ba280 2023-03-08T15:50:03.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fd5491700 1 --2- 172.21.15.123:0/2347232897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fd0071df0 0x7f3fd00bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:03.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fd4c90700 1 --2- 172.21.15.123:0/2347232897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd00ba280 0x7f3fd00bb3e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0004000 tx=0x7f3fc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:03.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fc5ffb700 1 -- 172.21.15.123:0/2347232897 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0020070 con 0x7f3fd00ba280 2023-03-08T15:50:03.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fc5ffb700 1 -- 172.21.15.123:0/2347232897 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc0004030 con 0x7f3fd00ba280 2023-03-08T15:50:03.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fd76f5700 1 -- 172.21.15.123:0/2347232897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd0141d20 con 0x7f3fd00ba280 2023-03-08T15:50:03.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fc5ffb700 1 -- 172.21.15.123:0/2347232897 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0010470 con 0x7f3fd00ba280 2023-03-08T15:50:03.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.108+0000 7f3fd76f5700 1 -- 172.21.15.123:0/2347232897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd0141b90 con 0x7f3fd00ba280 2023-03-08T15:50:03.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.109+0000 7f3fd76f5700 1 -- 172.21.15.123:0/2347232897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd014aff0 con 0x7f3fd00ba280 2023-03-08T15:50:03.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.110+0000 7f3fc5ffb700 1 -- 172.21.15.123:0/2347232897 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f3fc00193f0 con 0x7f3fd00ba280 2023-03-08T15:50:03.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.110+0000 7f3fc5ffb700 1 --2- 172.21.15.123:0/2347232897 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3fb4069900 0x7f3fb406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:03.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.110+0000 7f3fc5ffb700 1 -- 172.21.15.123:0/2347232897 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3fc008ae50 con 0x7f3fd00ba280 2023-03-08T15:50:03.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.110+0000 7f3fd5491700 1 --2- 172.21.15.123:0/2347232897 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3fb4069900 0x7f3fb406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:03.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.110+0000 7f3fd5491700 1 --2- 172.21.15.123:0/2347232897 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3fb4069900 0x7f3fb406bdb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009930 tx=0x7f3fcc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:03.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.114+0000 7f3fc5ffb700 1 -- 172.21.15.123:0/2347232897 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f3fc0056b40 con 0x7f3fd00ba280 2023-03-08T15:50:03.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:03.376+0000 7f3fd76f5700 1 -- 172.21.15.123:0/2347232897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f3fd00744c0 con 0x7f3fd00ba280 2023-03-08T15:50:04.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.051+0000 7f3fc5ffb700 1 -- 172.21.15.123:0/2347232897 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v46) v1 ==== 166+0+0 (secure 0 0 0) 0x7f3fc005a160 con 0x7f3fd00ba280 2023-03-08T15:50:04.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.054+0000 7f3fd76f5700 1 -- 172.21.15.123:0/2347232897 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3fb4069900 msgr2=0x7f3fb406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:04.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.054+0000 7f3fd76f5700 1 --2- 172.21.15.123:0/2347232897 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3fb4069900 0x7f3fb406bdb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009930 tx=0x7f3fcc008040 comp rx=0 tx=0).stop 2023-03-08T15:50:04.055 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.054+0000 7f3fd76f5700 1 -- 172.21.15.123:0/2347232897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd00ba280 msgr2=0x7f3fd00bb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:04.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.054+0000 7f3fd76f5700 1 --2- 172.21.15.123:0/2347232897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd00ba280 0x7f3fd00bb3e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0004000 tx=0x7f3fc0004750 comp rx=0 tx=0).stop 2023-03-08T15:50:04.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.054+0000 7f3fd76f5700 1 -- 172.21.15.123:0/2347232897 shutdown_connections 2023-03-08T15:50:04.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.054+0000 7f3fd76f5700 1 --2- 172.21.15.123:0/2347232897 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3fb4069900 0x7f3fb406bdb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:04.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.054+0000 7f3fd76f5700 1 --2- 172.21.15.123:0/2347232897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fd013d480 0x7f3fd00b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:04.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.054+0000 7f3fd76f5700 1 --2- 172.21.15.123:0/2347232897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fd0071df0 0x7f3fd00bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:04.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.054+0000 7f3fd76f5700 1 --2- 172.21.15.123:0/2347232897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd00ba280 0x7f3fd00bb3e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:04.056 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.054+0000 7f3fd76f5700 1 -- 172.21.15.123:0/2347232897 >> 172.21.15.123:0/2347232897 conn(0x7f3fd006b360 msgr2=0x7f3fd00b7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:04.057 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.054+0000 7f3fd76f5700 1 -- 172.21.15.123:0/2347232897 shutdown_connections 2023-03-08T15:50:04.057 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.054+0000 7f3fd76f5700 1 -- 172.21.15.123:0/2347232897 wait complete. 2023-03-08T15:50:04.069 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-03-08T15:50:04.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.196+0000 7fc2b6ac2700 1 Processor -- start 2023-03-08T15:50:04.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.197+0000 7fc2b6ac2700 1 -- start start 2023-03-08T15:50:04.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.197+0000 7fc2b6ac2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b00b7f80 0x7fc2b014b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:04.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.197+0000 7fc2b6ac2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc2b00b92f0 0x7fc2b0152d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:04.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2b6ac2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b00ba690 con 0x7fc2b0142680 2023-03-08T15:50:04.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2b6ac2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b00b9750 con 0x7fc2b00b92f0 2023-03-08T15:50:04.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2b6ac2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00b71e0 con 0x7fc2b00b7f80 2023-03-08T15:50:04.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2b505f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc2b00b92f0 0x7fc2b0152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:04.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2b485e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc2b0142680 0x7fc2b0071c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42434/0 (socket says 172.21.15.123:42434) 2023-03-08T15:50:04.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2b485e700 1 -- 172.21.15.123:0/1941004945 learned_addr learned my addr 172.21.15.123:0/1941004945 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:04.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2affff700 1 --2- 172.21.15.123:0/1941004945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b00b7f80 0x7fc2b014b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:04.201 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2b505f700 1 -- 172.21.15.123:0/1941004945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b00b7f80 msgr2=0x7fc2b014b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:04.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2b505f700 1 --2- 172.21.15.123:0/1941004945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b00b7f80 0x7fc2b014b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:04.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2b505f700 1 -- 172.21.15.123:0/1941004945 >> v1:172.21.15.123:6789/0 conn(0x7fc2b0142680 legacy=0x7fc2b0071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:04.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2b505f700 1 -- 172.21.15.123:0/1941004945 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b0072330 con 0x7fc2b00b92f0 2023-03-08T15:50:04.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2af7fe700 1 -- 172.21.15.123:0/1941004945 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864346324 0 0) 0x7fc2b00ba690 con 0x7fc2b0142680 2023-03-08T15:50:04.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2b505f700 1 --2- 172.21.15.123:0/1941004945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00b92f0 0x7fc2b0152d40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009d90 tx=0x7fc2a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4ac00e83e44385 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:04.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2af7fe700 1 -- 172.21.15.123:0/1941004945 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a800e070 con 0x7fc2b00b92f0 2023-03-08T15:50:04.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2af7fe700 1 -- 172.21.15.123:0/1941004945 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a800bbd0 con 0x7fc2b00b92f0 2023-03-08T15:50:04.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.198+0000 7fc2af7fe700 1 -- 172.21.15.123:0/1941004945 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8012430 con 0x7fc2b00b92f0 2023-03-08T15:50:04.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.199+0000 7fc2b6ac2700 1 -- 172.21.15.123:0/1941004945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00b92f0 msgr2=0x7fc2b0152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:04.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.199+0000 7fc2b6ac2700 1 --2- 172.21.15.123:0/1941004945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00b92f0 0x7fc2b0152d40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009d90 tx=0x7fc2a800b330 comp rx=0 tx=0).stop 2023-03-08T15:50:04.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.199+0000 7fc2b6ac2700 1 -- 172.21.15.123:0/1941004945 shutdown_connections 2023-03-08T15:50:04.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.199+0000 7fc2b6ac2700 1 --2- 172.21.15.123:0/1941004945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00b92f0 0x7fc2b0152d40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:04.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.199+0000 7fc2b6ac2700 1 --2- 172.21.15.123:0/1941004945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b00b7f80 0x7fc2b014b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:04.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.199+0000 7fc2b6ac2700 1 -- 172.21.15.123:0/1941004945 >> 172.21.15.123:0/1941004945 conn(0x7fc2b006b360 msgr2=0x7fc2b006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:04.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.199+0000 7fc2b6ac2700 1 -- 172.21.15.123:0/1941004945 shutdown_connections 2023-03-08T15:50:04.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.199+0000 7fc2b6ac2700 1 -- 172.21.15.123:0/1941004945 wait complete. 2023-03-08T15:50:04.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.200+0000 7fc2b6ac2700 1 Processor -- start 2023-03-08T15:50:04.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.200+0000 7fc2b6ac2700 1 -- start start 2023-03-08T15:50:04.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.200+0000 7fc2b6ac2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b00b7f80 0x7fc2b00bb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:04.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.200+0000 7fc2b6ac2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00b92f0 0x7fc2b00bc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:04.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2b6ac2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b0142680 0x7fc2b00bdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:04.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2b6ac2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00bd7c0 con 0x7fc2b00b92f0 2023-03-08T15:50:04.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2b6ac2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00be450 con 0x7fc2b00b7f80 2023-03-08T15:50:04.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2b6ac2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00bbfe0 con 0x7fc2b0142680 2023-03-08T15:50:04.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2affff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00b92f0 0x7fc2b00bc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:04.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2affff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00b92f0 0x7fc2b00bc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42038/0 (socket says 172.21.15.123:42038) 2023-03-08T15:50:04.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2affff700 1 -- 172.21.15.123:0/2479068087 learned_addr learned my addr 172.21.15.123:0/2479068087 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:04.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2b505f700 1 --2- 172.21.15.123:0/2479068087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b0142680 0x7fc2b00bdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:04.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2b485e700 1 --2- 172.21.15.123:0/2479068087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b00b7f80 0x7fc2b00bb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:04.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2affff700 1 -- 172.21.15.123:0/2479068087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b0142680 msgr2=0x7fc2b00bdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:04.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2affff700 1 --2- 172.21.15.123:0/2479068087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b0142680 0x7fc2b00bdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:04.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2affff700 1 -- 172.21.15.123:0/2479068087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b00b7f80 msgr2=0x7fc2b00bb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:04.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2affff700 1 --2- 172.21.15.123:0/2479068087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b00b7f80 0x7fc2b00bb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:04.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2affff700 1 -- 172.21.15.123:0/2479068087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a8009a70 con 0x7fc2b00b92f0 2023-03-08T15:50:04.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2affff700 1 --2- 172.21.15.123:0/2479068087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00b92f0 0x7fc2b00bc2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00d800 tx=0x7fc29c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:04.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2ad7fa700 1 -- 172.21.15.123:0/2479068087 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c0125f0 con 0x7fc2b00b92f0 2023-03-08T15:50:04.208 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2ad7fa700 1 -- 172.21.15.123:0/2479068087 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c012750 con 0x7fc2b00b92f0 2023-03-08T15:50:04.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2ad7fa700 1 -- 172.21.15.123:0/2479068087 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c012b00 con 0x7fc2b00b92f0 2023-03-08T15:50:04.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2b6ac2700 1 -- 172.21.15.123:0/2479068087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b00b8dd0 con 0x7fc2b00b92f0 2023-03-08T15:50:04.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.201+0000 7fc2b6ac2700 1 -- 172.21.15.123:0/2479068087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b00ba8e0 con 0x7fc2b00b92f0 2023-03-08T15:50:04.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.202+0000 7fc2b6ac2700 1 -- 172.21.15.123:0/2479068087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b0142a50 con 0x7fc2b00b92f0 2023-03-08T15:50:04.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.202+0000 7fc2ad7fa700 1 -- 172.21.15.123:0/2479068087 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fc29c012c60 con 0x7fc2b00b92f0 2023-03-08T15:50:04.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.203+0000 7fc2ad7fa700 1 --2- 172.21.15.123:0/2479068087 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc2940698d0 0x7fc29406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:04.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.203+0000 7fc2ad7fa700 1 -- 172.21.15.123:0/2479068087 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc29c087ab0 con 0x7fc2b00b92f0 2023-03-08T15:50:04.209 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.203+0000 7fc2b485e700 1 --2- 172.21.15.123:0/2479068087 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc2940698d0 0x7fc29406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:04.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.203+0000 7fc2b485e700 1 --2- 172.21.15.123:0/2479068087 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc2940698d0 0x7fc29406bd80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4000f60 tx=0x7fc2a4007c00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:04.210 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.207+0000 7fc2ad7fa700 1 -- 172.21.15.123:0/2479068087 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fc29c053880 con 0x7fc2b00b92f0 2023-03-08T15:50:04.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.393+0000 7fc2b6ac2700 1 -- 172.21.15.123:0/2479068087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc2b00bcf30 con 0x7fc2b00b92f0 2023-03-08T15:50:04.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.396+0000 7fc2ad7fa700 1 -- 172.21.15.123:0/2479068087 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc29c056ea0 con 0x7fc2b00b92f0 2023-03-08T15:50:04.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.398+0000 7fc2b6ac2700 1 -- 172.21.15.123:0/2479068087 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc2940698d0 msgr2=0x7fc29406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:04.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.398+0000 7fc2b6ac2700 1 --2- 172.21.15.123:0/2479068087 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc2940698d0 0x7fc29406bd80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4000f60 tx=0x7fc2a4007c00 comp rx=0 tx=0).stop 2023-03-08T15:50:04.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.398+0000 7fc2b6ac2700 1 -- 172.21.15.123:0/2479068087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00b92f0 msgr2=0x7fc2b00bc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:04.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.398+0000 7fc2b6ac2700 1 --2- 172.21.15.123:0/2479068087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00b92f0 0x7fc2b00bc2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00d800 tx=0x7fc29c00dbc0 comp rx=0 tx=0).stop 2023-03-08T15:50:04.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.398+0000 7fc2b6ac2700 1 -- 172.21.15.123:0/2479068087 shutdown_connections 2023-03-08T15:50:04.400 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.398+0000 7fc2b6ac2700 1 --2- 172.21.15.123:0/2479068087 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc2940698d0 0x7fc29406bd80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:04.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.398+0000 7fc2b6ac2700 1 --2- 172.21.15.123:0/2479068087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b0142680 0x7fc2b00bdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:04.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.398+0000 7fc2b6ac2700 1 --2- 172.21.15.123:0/2479068087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b00b7f80 0x7fc2b00bb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:04.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.398+0000 7fc2b6ac2700 1 --2- 172.21.15.123:0/2479068087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2b00b92f0 0x7fc2b00bc2f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:04.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.398+0000 7fc2b6ac2700 1 -- 172.21.15.123:0/2479068087 >> 172.21.15.123:0/2479068087 conn(0x7fc2b006b360 msgr2=0x7fc2b01401e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:04.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.398+0000 7fc2b6ac2700 1 -- 172.21.15.123:0/2479068087 shutdown_connections 2023-03-08T15:50:04.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:04.398+0000 7fc2b6ac2700 1 -- 172.21.15.123:0/2479068087 wait complete. 2023-03-08T15:50:04.411 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-03-08T15:50:04.412 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-08T15:50:04.520 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-08T15:50:04.624 DEBUG:teuthology.orchestra.run.smithi182:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-08T15:50:04.761 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-03-08T15:50:04.761 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:50:04.762 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-08T15:50:04.830 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:50:04.830 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-08T15:50:04.896 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:50:04.897 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-08T15:50:04.963 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:50:05.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.086+0000 7f156135c700 1 Processor -- start 2023-03-08T15:50:05.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.086+0000 7f156135c700 1 -- start start 2023-03-08T15:50:05.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f156135c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f155c1446c0 0x7f155c0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f156135c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f155c144a90 0x7f155c0bd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f156135c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c0b7fa0 con 0x7f155c0ba560 2023-03-08T15:50:05.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f156135c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155c0b7130 con 0x7f155c144a90 2023-03-08T15:50:05.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f156135c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c0bc030 con 0x7f155c1446c0 2023-03-08T15:50:05.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f155b7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f155c0ba560 0x7f155c0b5a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42442/0 (socket says 172.21.15.123:42442) 2023-03-08T15:50:05.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f155b7fe700 1 -- 172.21.15.123:0/3393763222 learned_addr learned my addr 172.21.15.123:0/3393763222 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:05.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 -- 172.21.15.123:0/3393763222 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606413842 0 0) 0x7f155c0b7fa0 con 0x7f155c0ba560 2023-03-08T15:50:05.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 -- 172.21.15.123:0/3393763222 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15440035b0 con 0x7f155c0ba560 2023-03-08T15:50:05.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f155affd700 1 --2- 172.21.15.123:0/3393763222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f155c1446c0 0x7f155c0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f155a7fc700 1 --2- 172.21.15.123:0/3393763222 >> v2:172.21.15.175:3300/0 conn(0x7f155c144a90 0x7f155c0bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 -- 172.21.15.123:0/3393763222 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3435900563 0 0) 0x7f15440035b0 con 0x7f155c0ba560 2023-03-08T15:50:05.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 -- 172.21.15.123:0/3393763222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f155c1446c0 msgr2=0x7f155c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:05.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 --2- 172.21.15.123:0/3393763222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f155c1446c0 0x7f155c0b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 -- 172.21.15.123:0/3393763222 >> v2:172.21.15.175:3300/0 conn(0x7f155c144a90 msgr2=0x7f155c0bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:05.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 --2- 172.21.15.123:0/3393763222 >> v2:172.21.15.175:3300/0 conn(0x7f155c144a90 0x7f155c0bd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 -- 172.21.15.123:0/3393763222 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0bc310 con 0x7f155c0ba560 2023-03-08T15:50:05.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 -- 172.21.15.123:0/3393763222 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f15540019f0 con 0x7f155c0ba560 2023-03-08T15:50:05.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 -- 172.21.15.123:0/3393763222 >> v1:172.21.15.123:6789/0 conn(0x7f155c0ba560 legacy=0x7f155c0b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 --2- 172.21.15.123:0/3393763222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1544003a00 0x7f1544003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 --2- 172.21.15.123:0/3393763222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f155c1446c0 0x7f1544004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 --2- 172.21.15.123:0/3393763222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1544004d90 0x7f1544005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 -- 172.21.15.123:0/3393763222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c0b7130 con 0x7f1544004d90 2023-03-08T15:50:05.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 -- 172.21.15.123:0/3393763222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c0bc030 con 0x7f1544003a00 2023-03-08T15:50:05.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f1559ffb700 1 -- 172.21.15.123:0/3393763222 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154400bac0 con 0x7f155c1446c0 2023-03-08T15:50:05.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f155affd700 1 --2- 172.21.15.123:0/3393763222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1544003a00 0x7f1544003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f155a7fc700 1 --2- 172.21.15.123:0/3393763222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f155c1446c0 0x7f1544004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.087+0000 7f155b7fe700 1 --2- 172.21.15.123:0/3393763222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1544004d90 0x7f1544005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.088+0000 7f155b7fe700 1 -- 172.21.15.123:0/3393763222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f155c1446c0 msgr2=0x7f1544004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:05.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.088+0000 7f155b7fe700 1 --2- 172.21.15.123:0/3393763222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f155c1446c0 0x7f1544004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.088+0000 7f155b7fe700 1 -- 172.21.15.123:0/3393763222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1544003a00 msgr2=0x7f1544003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:05.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.088+0000 7f155b7fe700 1 --2- 172.21.15.123:0/3393763222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1544003a00 0x7f1544003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.088+0000 7f155b7fe700 1 -- 172.21.15.123:0/3393763222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15440035b0 con 0x7f1544004d90 2023-03-08T15:50:05.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.088+0000 7f155affd700 1 --2- 172.21.15.123:0/3393763222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1544003a00 0x7f1544003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:50:05.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.088+0000 7f155b7fe700 1 --2- 172.21.15.123:0/3393763222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1544004d90 0x7f1544005200 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f155400a830 tx=0x7f1544005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ce1f5d1ba36b04 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:05.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.088+0000 7f1559ffb700 1 -- 172.21.15.123:0/3393763222 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155400a320 con 0x7f1544004d90 2023-03-08T15:50:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.088+0000 7f1559ffb700 1 -- 172.21.15.123:0/3393763222 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1554012600 con 0x7f1544004d90 2023-03-08T15:50:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.088+0000 7f1559ffb700 1 -- 172.21.15.123:0/3393763222 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15540129b0 con 0x7f1544004d90 2023-03-08T15:50:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.088+0000 7f156135c700 1 -- 172.21.15.123:0/3393763222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1544004d90 msgr2=0x7f1544005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.088+0000 7f156135c700 1 --2- 172.21.15.123:0/3393763222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1544004d90 0x7f1544005200 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f155400a830 tx=0x7f1544005880 comp rx=0 tx=0).stop 2023-03-08T15:50:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.088+0000 7f155b7fe700 1 -- 172.21.15.123:0/3393763222 reap_dead start 2023-03-08T15:50:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.089+0000 7f156135c700 1 -- 172.21.15.123:0/3393763222 shutdown_connections 2023-03-08T15:50:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.089+0000 7f156135c700 1 -- 172.21.15.123:0/3393763222 >> 172.21.15.123:0/3393763222 conn(0x7f155c071980 msgr2=0x7f155c071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.089+0000 7f156135c700 1 -- 172.21.15.123:0/3393763222 shutdown_connections 2023-03-08T15:50:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.089+0000 7f156135c700 1 -- 172.21.15.123:0/3393763222 wait complete. 2023-03-08T15:50:05.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.090+0000 7f156135c700 1 Processor -- start 2023-03-08T15:50:05.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.090+0000 7f156135c700 1 -- start start 2023-03-08T15:50:05.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.090+0000 7f156135c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f155c1d6e50 0x7f155c1e3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.090+0000 7f156135c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f155c1e42a0 0x7f155c139480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.090+0000 7f156135c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c1399c0 0x7f155c0bf670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.090+0000 7f156135c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c14d350 con 0x7f155c1e42a0 2023-03-08T15:50:05.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.090+0000 7f156135c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c1e4710 con 0x7f155c1399c0 2023-03-08T15:50:05.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.090+0000 7f156135c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c14b900 con 0x7f155c1d6e50 2023-03-08T15:50:05.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f155a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f155c1e42a0 0x7f155c139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f155a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f155c1e42a0 0x7f155c139480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42062/0 (socket says 172.21.15.123:42062) 2023-03-08T15:50:05.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f155a7fc700 1 -- 172.21.15.123:0/3175879742 learned_addr learned my addr 172.21.15.123:0/3175879742 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:05.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f155affd700 1 --2- 172.21.15.123:0/3175879742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f155c1d6e50 0x7f155c1e3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f155b7fe700 1 --2- 172.21.15.123:0/3175879742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c1399c0 0x7f155c0bf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f155a7fc700 1 -- 172.21.15.123:0/3175879742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f155c1d6e50 msgr2=0x7f155c1e3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f155a7fc700 1 --2- 172.21.15.123:0/3175879742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f155c1d6e50 0x7f155c1e3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f155a7fc700 1 -- 172.21.15.123:0/3175879742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c1399c0 msgr2=0x7f155c0bf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f155a7fc700 1 --2- 172.21.15.123:0/3175879742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c1399c0 0x7f155c0bf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f155a7fc700 1 -- 172.21.15.123:0/3175879742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c14db90 con 0x7f155c1e42a0 2023-03-08T15:50:05.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f155a7fc700 1 --2- 172.21.15.123:0/3175879742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f155c1e42a0 0x7f155c139480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f154c0116b0 tx=0x7f154c0119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:05.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f15437fe700 1 -- 172.21.15.123:0/3175879742 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c00c070 con 0x7f155c1e42a0 2023-03-08T15:50:05.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f15437fe700 1 -- 172.21.15.123:0/3175879742 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c015870 con 0x7f155c1e42a0 2023-03-08T15:50:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f156135c700 1 -- 172.21.15.123:0/3175879742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155c0bc5f0 con 0x7f155c1e42a0 2023-03-08T15:50:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f15437fe700 1 -- 172.21.15.123:0/3175879742 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c009590 con 0x7f155c1e42a0 2023-03-08T15:50:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.091+0000 7f156135c700 1 -- 172.21.15.123:0/3175879742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155c14bec0 con 0x7f155c1e42a0 2023-03-08T15:50:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.092+0000 7f156135c700 1 -- 172.21.15.123:0/3175879742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c1e3bb0 con 0x7f155c1e42a0 2023-03-08T15:50:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.093+0000 7f15437fe700 1 -- 172.21.15.123:0/3175879742 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f154c025070 con 0x7f155c1e42a0 2023-03-08T15:50:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.093+0000 7f15437fe700 1 --2- 172.21.15.123:0/3175879742 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f15480698d0 0x7f154806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.093+0000 7f155affd700 1 --2- 172.21.15.123:0/3175879742 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f15480698d0 0x7f154806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.093+0000 7f15437fe700 1 -- 172.21.15.123:0/3175879742 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f154c087790 con 0x7f155c1e42a0 2023-03-08T15:50:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.093+0000 7f155affd700 1 --2- 172.21.15.123:0/3175879742 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f15480698d0 0x7f154806bd80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1550009a00 tx=0x7f1550008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.097+0000 7f15437fe700 1 -- 172.21.15.123:0/3175879742 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f154c053560 con 0x7f155c1e42a0 2023-03-08T15:50:05.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.282+0000 7f156135c700 1 -- 172.21.15.123:0/3175879742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f155c14dd20 con 0x7f155c1e42a0 2023-03-08T15:50:05.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.284+0000 7f15437fe700 1 -- 172.21.15.123:0/3175879742 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f155c14dd20 con 0x7f155c1e42a0 2023-03-08T15:50:05.285 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:05.286 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:40.490671+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:49:37.104720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-08T15:49:38.431537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:50:05.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.286+0000 7f156135c700 1 -- 172.21.15.123:0/3175879742 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f15480698d0 msgr2=0x7f154806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.286+0000 7f156135c700 1 --2- 172.21.15.123:0/3175879742 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f15480698d0 0x7f154806bd80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1550009a00 tx=0x7f1550008040 comp rx=0 tx=0).stop 2023-03-08T15:50:05.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.286+0000 7f156135c700 1 -- 172.21.15.123:0/3175879742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f155c1e42a0 msgr2=0x7f155c139480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.286+0000 7f156135c700 1 --2- 172.21.15.123:0/3175879742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f155c1e42a0 0x7f155c139480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f154c0116b0 tx=0x7f154c0119c0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.286+0000 7f156135c700 1 -- 172.21.15.123:0/3175879742 shutdown_connections 2023-03-08T15:50:05.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.286+0000 7f156135c700 1 --2- 172.21.15.123:0/3175879742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c1399c0 0x7f155c0bf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.286+0000 7f156135c700 1 --2- 172.21.15.123:0/3175879742 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f15480698d0 0x7f154806bd80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.286+0000 7f156135c700 1 --2- 172.21.15.123:0/3175879742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f155c1d6e50 0x7f155c1e3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.286+0000 7f156135c700 1 --2- 172.21.15.123:0/3175879742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f155c1e42a0 0x7f155c139480 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.286+0000 7f156135c700 1 -- 172.21.15.123:0/3175879742 >> 172.21.15.123:0/3175879742 conn(0x7f155c071980 msgr2=0x7f155c0b94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:05.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.286+0000 7f156135c700 1 -- 172.21.15.123:0/3175879742 shutdown_connections 2023-03-08T15:50:05.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.286+0000 7f156135c700 1 -- 172.21.15.123:0/3175879742 wait complete. 2023-03-08T15:50:05.299 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-08T15:49:26.011228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-08T15:49:32.528343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-08T15:49:37.104720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-08T15:49:38.431537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-08T15:50:05.300 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-08T15:50:05.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.421+0000 7f21eb9ee700 1 Processor -- start 2023-03-08T15:50:05.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.421+0000 7f21eb9ee700 1 -- start start 2023-03-08T15:50:05.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.422+0000 7f21eb9ee700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21e4147e50 0x7f21e406a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.422+0000 7f21eb9ee700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f21e414b420 0x7f21e4155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.422+0000 7f21eb9ee700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e414a810 con 0x7f21e406fef0 2023-03-08T15:50:05.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.422+0000 7f21eb9ee700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e4071a40 con 0x7f21e414b420 2023-03-08T15:50:05.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.422+0000 7f21eb9ee700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e4071d20 con 0x7f21e4147e50 2023-03-08T15:50:05.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.422+0000 7f21e978a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21e4147e50 0x7f21e406a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.422+0000 7f21e9f8b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f21e414b420 0x7f21e4155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.422+0000 7f21e978a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21e4147e50 0x7f21e406a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:41248/0 (socket says 172.21.15.123:41248) 2023-03-08T15:50:05.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.422+0000 7f21e8f89700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f21e406fef0 0x7f21e414ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.123:47310/0 (socket says 172.21.15.123:47310) 2023-03-08T15:50:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.422+0000 7f21e9f8b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f21e414b420 0x7f21e4155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:45650/0 (socket says 172.21.15.123:45650) 2023-03-08T15:50:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.422+0000 7f21e978a700 1 -- 172.21.15.123:0/2180568347 learned_addr learned my addr 172.21.15.123:0/2180568347 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.423+0000 7f21e9f8b700 1 -- 172.21.15.123:0/2180568347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21e4147e50 msgr2=0x7f21e406a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.423+0000 7f21e9f8b700 1 --2- 172.21.15.123:0/2180568347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21e4147e50 0x7f21e406a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.423+0000 7f21e9f8b700 1 -- 172.21.15.123:0/2180568347 >> v1:172.21.15.175:6789/0 conn(0x7f21e406fef0 legacy=0x7f21e414ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.423+0000 7f21e9f8b700 1 -- 172.21.15.123:0/2180568347 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e4072000 con 0x7f21e414b420 2023-03-08T15:50:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.423+0000 7f21dbfff700 1 -- 172.21.15.123:0/2180568347 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697563998 0 0) 0x7f21e414a810 con 0x7f21e406fef0 2023-03-08T15:50:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.423+0000 7f21e9f8b700 1 --2- 172.21.15.123:0/2180568347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21e414b420 0x7f21e4155040 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009d90 tx=0x7f21dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15d41624d6a3adbd server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:05.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.423+0000 7f21dbfff700 1 -- 172.21.15.123:0/2180568347 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00e070 con 0x7f21e414b420 2023-03-08T15:50:05.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.423+0000 7f21dbfff700 1 -- 172.21.15.123:0/2180568347 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc00bb20 con 0x7f21e414b420 2023-03-08T15:50:05.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.423+0000 7f21dbfff700 1 -- 172.21.15.123:0/2180568347 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc012430 con 0x7f21e414b420 2023-03-08T15:50:05.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.424+0000 7f21eb9ee700 1 -- 172.21.15.123:0/2180568347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21e414b420 msgr2=0x7f21e4155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.424+0000 7f21eb9ee700 1 --2- 172.21.15.123:0/2180568347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21e414b420 0x7f21e4155040 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009d90 tx=0x7f21dc00b330 comp rx=0 tx=0).stop 2023-03-08T15:50:05.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.424+0000 7f21eb9ee700 1 -- 172.21.15.123:0/2180568347 shutdown_connections 2023-03-08T15:50:05.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.424+0000 7f21eb9ee700 1 --2- 172.21.15.123:0/2180568347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21e414b420 0x7f21e4155040 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.424+0000 7f21eb9ee700 1 --2- 172.21.15.123:0/2180568347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21e4147e50 0x7f21e406a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.424+0000 7f21eb9ee700 1 -- 172.21.15.123:0/2180568347 >> 172.21.15.123:0/2180568347 conn(0x7f21e406b360 msgr2=0x7f21e406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:05.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.424+0000 7f21eb9ee700 1 -- 172.21.15.123:0/2180568347 shutdown_connections 2023-03-08T15:50:05.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.424+0000 7f21eb9ee700 1 -- 172.21.15.123:0/2180568347 wait complete. 2023-03-08T15:50:05.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.425+0000 7f21eb9ee700 1 Processor -- start 2023-03-08T15:50:05.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.425+0000 7f21eb9ee700 1 -- start start 2023-03-08T15:50:05.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.425+0000 7f21eb9ee700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e406fef0 0x7f21e41d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.425+0000 7f21eb9ee700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21e4147e50 0x7f21e40b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.425+0000 7f21eb9ee700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21e414b420 0x7f21e40bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.425+0000 7f21eb9ee700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40b6820 con 0x7f21e406fef0 2023-03-08T15:50:05.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.425+0000 7f21eb9ee700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40b6400 con 0x7f21e4147e50 2023-03-08T15:50:05.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.425+0000 7f21eb9ee700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e41d2770 con 0x7f21e414b420 2023-03-08T15:50:05.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.425+0000 7f21e978a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e406fef0 0x7f21e41d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.426+0000 7f21e978a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e406fef0 0x7f21e41d1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42064/0 (socket says 172.21.15.123:42064) 2023-03-08T15:50:05.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.426+0000 7f21e978a700 1 -- 172.21.15.123:0/2196890750 learned_addr learned my addr 172.21.15.123:0/2196890750 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:05.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.426+0000 7f21e8f89700 1 --2- 172.21.15.123:0/2196890750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21e4147e50 0x7f21e40b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.426+0000 7f21e9f8b700 1 --2- 172.21.15.123:0/2196890750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21e414b420 0x7f21e40bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.426+0000 7f21e978a700 1 -- 172.21.15.123:0/2196890750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21e414b420 msgr2=0x7f21e40bceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.426+0000 7f21e978a700 1 --2- 172.21.15.123:0/2196890750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21e414b420 0x7f21e40bceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.426+0000 7f21e978a700 1 -- 172.21.15.123:0/2196890750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21e4147e50 msgr2=0x7f21e40b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.426+0000 7f21e978a700 1 --2- 172.21.15.123:0/2196890750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21e4147e50 0x7f21e40b6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.426+0000 7f21e978a700 1 -- 172.21.15.123:0/2196890750 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc009a70 con 0x7f21e406fef0 2023-03-08T15:50:05.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.426+0000 7f21e978a700 1 --2- 172.21.15.123:0/2196890750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e406fef0 0x7f21e41d1b80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f21d400e910 tx=0x7f21d400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:05.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.426+0000 7f21d9ffb700 1 -- 172.21.15.123:0/2196890750 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d40096a0 con 0x7f21e406fef0 2023-03-08T15:50:05.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.426+0000 7f21d9ffb700 1 -- 172.21.15.123:0/2196890750 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d4013680 con 0x7f21e406fef0 2023-03-08T15:50:05.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.426+0000 7f21eb9ee700 1 -- 172.21.15.123:0/2196890750 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e40728f0 con 0x7f21e406fef0 2023-03-08T15:50:05.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.426+0000 7f21d9ffb700 1 -- 172.21.15.123:0/2196890750 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4013a30 con 0x7f21e406fef0 2023-03-08T15:50:05.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.426+0000 7f21eb9ee700 1 -- 172.21.15.123:0/2196890750 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e4148220 con 0x7f21e406fef0 2023-03-08T15:50:05.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.427+0000 7f21eb9ee700 1 -- 172.21.15.123:0/2196890750 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e40b45f0 con 0x7f21e406fef0 2023-03-08T15:50:05.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.428+0000 7f21d9ffb700 1 -- 172.21.15.123:0/2196890750 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f21d4019030 con 0x7f21e406fef0 2023-03-08T15:50:05.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.428+0000 7f21d9ffb700 1 --2- 172.21.15.123:0/2196890750 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f21c80698d0 0x7f21c806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.428+0000 7f21e8f89700 1 --2- 172.21.15.123:0/2196890750 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f21c80698d0 0x7f21c806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.428+0000 7f21d9ffb700 1 -- 172.21.15.123:0/2196890750 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f21d4087560 con 0x7f21e406fef0 2023-03-08T15:50:05.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.429+0000 7f21e8f89700 1 --2- 172.21.15.123:0/2196890750 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f21c80698d0 0x7f21c806bd80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f21e41d22e0 tx=0x7f21e0007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:05.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.433+0000 7f21d9ffb700 1 -- 172.21.15.123:0/2196890750 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f21d40531b0 con 0x7f21e406fef0 2023-03-08T15:50:05.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.616+0000 7f21eb9ee700 1 -- 172.21.15.123:0/2196890750 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21e40744c0 con 0x7f21e406fef0 2023-03-08T15:50:05.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.616+0000 7f21d9ffb700 1 -- 172.21.15.123:0/2196890750 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21d40170a0 con 0x7f21e406fef0 2023-03-08T15:50:05.711 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-03-08T15:50:05.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.618+0000 7f21eb9ee700 1 -- 172.21.15.123:0/2196890750 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f21c80698d0 msgr2=0x7f21c806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.618+0000 7f21eb9ee700 1 --2- 172.21.15.123:0/2196890750 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f21c80698d0 0x7f21c806bd80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f21e41d22e0 tx=0x7f21e0007de0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.618+0000 7f21eb9ee700 1 -- 172.21.15.123:0/2196890750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e406fef0 msgr2=0x7f21e41d1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.618+0000 7f21eb9ee700 1 --2- 172.21.15.123:0/2196890750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e406fef0 0x7f21e41d1b80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f21d400e910 tx=0x7f21d400ec20 comp rx=0 tx=0).stop 2023-03-08T15:50:05.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.618+0000 7f21eb9ee700 1 -- 172.21.15.123:0/2196890750 shutdown_connections 2023-03-08T15:50:05.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.618+0000 7f21eb9ee700 1 --2- 172.21.15.123:0/2196890750 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f21c80698d0 0x7f21c806bd80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.618+0000 7f21eb9ee700 1 --2- 172.21.15.123:0/2196890750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21e414b420 0x7f21e40bceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.618+0000 7f21eb9ee700 1 --2- 172.21.15.123:0/2196890750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e406fef0 0x7f21e41d1b80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.618+0000 7f21eb9ee700 1 --2- 172.21.15.123:0/2196890750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21e4147e50 0x7f21e40b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.619+0000 7f21eb9ee700 1 -- 172.21.15.123:0/2196890750 >> 172.21.15.123:0/2196890750 conn(0x7f21e406b360 msgr2=0x7f21e40b86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:05.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.619+0000 7f21eb9ee700 1 -- 172.21.15.123:0/2196890750 shutdown_connections 2023-03-08T15:50:05.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.619+0000 7f21eb9ee700 1 -- 172.21.15.123:0/2196890750 wait complete. 2023-03-08T15:50:05.714 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-08T15:50:05.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.835+0000 7f071647e700 1 Processor -- start 2023-03-08T15:50:05.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.835+0000 7f071647e700 1 -- start start 2023-03-08T15:50:05.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.836+0000 7f071647e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07100ba560 0x7f0710155f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.836+0000 7f071647e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07100b7fa0 con 0x7f07101446c0 2023-03-08T15:50:05.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.836+0000 7f071647e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07100bc030 con 0x7f0710144a90 2023-03-08T15:50:05.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.836+0000 7f071647e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07100bdc90 con 0x7f07100ba560 2023-03-08T15:50:05.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.836+0000 7f070ffff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f07101446c0 0x7f07100b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42444/0 (socket says 172.21.15.123:42444) 2023-03-08T15:50:05.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.836+0000 7f070ffff700 1 -- 172.21.15.123:0/3325383585 learned_addr learned my addr 172.21.15.123:0/3325383585 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:05.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.836+0000 7f0714a1b700 1 --2- 172.21.15.123:0/3325383585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07100ba560 0x7f0710155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.836+0000 7f070effd700 1 -- 172.21.15.123:0/3325383585 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077676842 0 0) 0x7f07100b7fa0 con 0x7f07101446c0 2023-03-08T15:50:05.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.836+0000 7f070effd700 1 -- 172.21.15.123:0/3325383585 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06f80035b0 con 0x7f07101446c0 2023-03-08T15:50:05.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.836+0000 7f070effd700 1 -- 172.21.15.123:0/3325383585 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599245666 0 0) 0x7f07100bc030 con 0x7f0710144a90 2023-03-08T15:50:05.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.836+0000 7f070effd700 1 -- 172.21.15.123:0/3325383585 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07100b7fa0 con 0x7f0710144a90 2023-03-08T15:50:05.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.836+0000 7f070effd700 1 -- 172.21.15.123:0/3325383585 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4287156928 0 0) 0x7f06f80035b0 con 0x7f07101446c0 2023-03-08T15:50:05.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.836+0000 7f0714a1b700 1 -- 172.21.15.123:0/3325383585 >> v1:172.21.15.175:6789/0 conn(0x7f0710144a90 legacy=0x7f07100bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.836+0000 7f0714a1b700 1 -- 172.21.15.123:0/3325383585 >> v1:172.21.15.123:6789/0 conn(0x7f07101446c0 legacy=0x7f07100b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.836+0000 7f0714a1b700 1 -- 172.21.15.123:0/3325383585 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07100bc310 con 0x7f07100ba560 2023-03-08T15:50:05.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.837+0000 7f0714a1b700 1 --2- 172.21.15.123:0/3325383585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07100ba560 0x7f0710155f30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0708009dc0 tx=0x7f070800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6050fa7fc7995265 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:05.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.837+0000 7f070effd700 1 -- 172.21.15.123:0/3325383585 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070800e070 con 0x7f07100ba560 2023-03-08T15:50:05.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.837+0000 7f070effd700 1 -- 172.21.15.123:0/3325383585 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0708003a20 con 0x7f07100ba560 2023-03-08T15:50:05.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.837+0000 7f070effd700 1 -- 172.21.15.123:0/3325383585 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704001670 con 0x7f07100ba560 2023-03-08T15:50:05.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.837+0000 7f071647e700 1 -- 172.21.15.123:0/3325383585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07100ba560 msgr2=0x7f0710155f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.837+0000 7f071647e700 1 --2- 172.21.15.123:0/3325383585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07100ba560 0x7f0710155f30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0708009dc0 tx=0x7f070800b330 comp rx=0 tx=0).stop 2023-03-08T15:50:05.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.837+0000 7f071647e700 1 -- 172.21.15.123:0/3325383585 shutdown_connections 2023-03-08T15:50:05.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.837+0000 7f071647e700 1 --2- 172.21.15.123:0/3325383585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07100ba560 0x7f0710155f30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.837+0000 7f071647e700 1 -- 172.21.15.123:0/3325383585 >> 172.21.15.123:0/3325383585 conn(0x7f0710071980 msgr2=0x7f0710071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:05.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.837+0000 7f071647e700 1 -- 172.21.15.123:0/3325383585 shutdown_connections 2023-03-08T15:50:05.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.837+0000 7f071647e700 1 -- 172.21.15.123:0/3325383585 wait complete. 2023-03-08T15:50:05.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.838+0000 7f071647e700 1 Processor -- start 2023-03-08T15:50:05.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.839+0000 7f071647e700 1 -- start start 2023-03-08T15:50:05.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.839+0000 7f071647e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07100ba560 0x7f071013b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.839+0000 7f071647e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07101446c0 0x7f071013c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.839+0000 7f071647e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0710144a90 0x7f07101d6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.839+0000 7f071647e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07101d7280 con 0x7f0710144a90 2023-03-08T15:50:05.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.839+0000 7f071647e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071013b810 con 0x7f07101446c0 2023-03-08T15:50:05.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.839+0000 7f071647e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0710140a20 con 0x7f07100ba560 2023-03-08T15:50:05.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.839+0000 7f0714a1b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0710144a90 0x7f07101d6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.839+0000 7f0714a1b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0710144a90 0x7f07101d6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42076/0 (socket says 172.21.15.123:42076) 2023-03-08T15:50:05.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.839+0000 7f0714a1b700 1 -- 172.21.15.123:0/1834683595 learned_addr learned my addr 172.21.15.123:0/1834683595 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:05.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.839+0000 7f070ffff700 1 --2- 172.21.15.123:0/1834683595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07100ba560 0x7f071013b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.839+0000 7f070f7fe700 1 --2- 172.21.15.123:0/1834683595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07101446c0 0x7f071013c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.840+0000 7f0714a1b700 1 -- 172.21.15.123:0/1834683595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07100ba560 msgr2=0x7f071013b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.840+0000 7f0714a1b700 1 --2- 172.21.15.123:0/1834683595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07100ba560 0x7f071013b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.840+0000 7f0714a1b700 1 -- 172.21.15.123:0/1834683595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07101446c0 msgr2=0x7f071013c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:05.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.840+0000 7f0714a1b700 1 --2- 172.21.15.123:0/1834683595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07101446c0 0x7f071013c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:05.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.840+0000 7f0714a1b700 1 -- 172.21.15.123:0/1834683595 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0708009a70 con 0x7f0710144a90 2023-03-08T15:50:05.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.840+0000 7f0714a1b700 1 --2- 172.21.15.123:0/1834683595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0710144a90 0x7f07101d6d40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0708009d90 tx=0x7f0708004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:05.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.840+0000 7f070cff9700 1 -- 172.21.15.123:0/1834683595 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07080044c0 con 0x7f0710144a90 2023-03-08T15:50:05.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.840+0000 7f070cff9700 1 -- 172.21.15.123:0/1834683595 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0708004620 con 0x7f0710144a90 2023-03-08T15:50:05.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.840+0000 7f070cff9700 1 -- 172.21.15.123:0/1834683595 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070801d470 con 0x7f0710144a90 2023-03-08T15:50:05.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.840+0000 7f071647e700 1 -- 172.21.15.123:0/1834683595 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071014db90 con 0x7f0710144a90 2023-03-08T15:50:05.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.840+0000 7f071647e700 1 -- 172.21.15.123:0/1834683595 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07100bc5f0 con 0x7f0710144a90 2023-03-08T15:50:05.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.841+0000 7f071647e700 1 -- 172.21.15.123:0/1834683595 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071014dd20 con 0x7f0710144a90 2023-03-08T15:50:05.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.842+0000 7f070cff9700 1 -- 172.21.15.123:0/1834683595 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f0708023030 con 0x7f0710144a90 2023-03-08T15:50:05.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.842+0000 7f070cff9700 1 --2- 172.21.15.123:0/1834683595 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f06fc0698d0 0x7f06fc06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:05.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.842+0000 7f070cff9700 1 -- 172.21.15.123:0/1834683595 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f07080891b0 con 0x7f0710144a90 2023-03-08T15:50:05.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.842+0000 7f070ffff700 1 --2- 172.21.15.123:0/1834683595 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f06fc0698d0 0x7f06fc06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:05.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.842+0000 7f070ffff700 1 --2- 172.21.15.123:0/1834683595 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f06fc0698d0 0x7f06fc06bd80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0704001380 tx=0x7f0704000f10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:05.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:05.846+0000 7f070cff9700 1 -- 172.21.15.123:0/1834683595 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f071014dd20 con 0x7f0710144a90 2023-03-08T15:50:06.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.030+0000 7f071647e700 1 -- 172.21.15.123:0/1834683595 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f071014dd20 con 0x7f0710144a90 2023-03-08T15:50:06.032 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.031+0000 7f070cff9700 1 -- 172.21.15.123:0/1834683595 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f071014dd20 con 0x7f0710144a90 2023-03-08T15:50:06.032 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-03-08T15:50:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.033+0000 7f071647e700 1 -- 172.21.15.123:0/1834683595 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f06fc0698d0 msgr2=0x7f06fc06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.033+0000 7f071647e700 1 --2- 172.21.15.123:0/1834683595 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f06fc0698d0 0x7f06fc06bd80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0704001380 tx=0x7f0704000f10 comp rx=0 tx=0).stop 2023-03-08T15:50:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.033+0000 7f071647e700 1 -- 172.21.15.123:0/1834683595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0710144a90 msgr2=0x7f07101d6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.033+0000 7f071647e700 1 --2- 172.21.15.123:0/1834683595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0710144a90 0x7f07101d6d40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0708009d90 tx=0x7f0708004ad0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.033+0000 7f071647e700 1 -- 172.21.15.123:0/1834683595 shutdown_connections 2023-03-08T15:50:06.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.033+0000 7f071647e700 1 --2- 172.21.15.123:0/1834683595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0710144a90 0x7f07101d6d40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.033+0000 7f071647e700 1 --2- 172.21.15.123:0/1834683595 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f06fc0698d0 0x7f06fc06bd80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.033+0000 7f071647e700 1 --2- 172.21.15.123:0/1834683595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07100ba560 0x7f071013b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.033+0000 7f071647e700 1 --2- 172.21.15.123:0/1834683595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07101446c0 0x7f071013c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.035 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.033+0000 7f071647e700 1 -- 172.21.15.123:0/1834683595 >> 172.21.15.123:0/1834683595 conn(0x7f0710071980 msgr2=0x7f0710071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:06.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.033+0000 7f071647e700 1 -- 172.21.15.123:0/1834683595 shutdown_connections 2023-03-08T15:50:06.036 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.033+0000 7f071647e700 1 -- 172.21.15.123:0/1834683595 wait complete. 2023-03-08T15:50:06.046 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-08T15:50:06.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.170+0000 7f87a19e7700 1 Processor -- start 2023-03-08T15:50:06.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.171+0000 7f87a19e7700 1 -- start start 2023-03-08T15:50:06.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.171+0000 7f87a19e7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f879c148130 0x7f879c06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.171+0000 7f87a19e7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f879c147510 0x7f879c0bd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.171+0000 7f87a19e7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879c0b7180 con 0x7f879c0b3c30 2023-03-08T15:50:06.174 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.171+0000 7f87a19e7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879c141cd0 con 0x7f879c148130 2023-03-08T15:50:06.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.171+0000 7f87a19e7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0b8c40 con 0x7f879c147510 2023-03-08T15:50:06.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.171+0000 7f879affd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f879c148130 0x7f879c06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.171+0000 7f879b7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f879c0b3c30 0x7f879c14aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35990/0 (socket says 172.21.15.123:35990) 2023-03-08T15:50:06.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.171+0000 7f879b7fe700 1 -- 172.21.15.123:0/1308680746 learned_addr learned my addr 172.21.15.123:0/1308680746 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:06.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.171+0000 7f879a7fc700 1 --2- 172.21.15.123:0/1308680746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f879c147510 0x7f879c0bd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f879affd700 1 -- 172.21.15.123:0/1308680746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f879c147510 msgr2=0x7f879c0bd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:06.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f879affd700 1 --2- 172.21.15.123:0/1308680746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f879c147510 0x7f879c0bd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f879affd700 1 -- 172.21.15.123:0/1308680746 >> v1:172.21.15.123:6789/0 conn(0x7f879c0b3c30 legacy=0x7f879c14aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f8799ffb700 1 -- 172.21.15.123:0/1308680746 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279830146 0 0) 0x7f879c0b7180 con 0x7f879c0b3c30 2023-03-08T15:50:06.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f879affd700 1 -- 172.21.15.123:0/1308680746 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c06ba10 con 0x7f879c148130 2023-03-08T15:50:06.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f879affd700 1 --2- 172.21.15.123:0/1308680746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f879c148130 0x7f879c06b4d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8790009870 tx=0x7f8790009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f653eb4e25c27c5 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:06.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f8799ffb700 1 -- 172.21.15.123:0/1308680746 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790011830 con 0x7f879c148130 2023-03-08T15:50:06.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f8799ffb700 1 -- 172.21.15.123:0/1308680746 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8790011990 con 0x7f879c148130 2023-03-08T15:50:06.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f8799ffb700 1 -- 172.21.15.123:0/1308680746 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790011d20 con 0x7f879c148130 2023-03-08T15:50:06.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f87a19e7700 1 -- 172.21.15.123:0/1308680746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f879c148130 msgr2=0x7f879c06b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f87a19e7700 1 --2- 172.21.15.123:0/1308680746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f879c148130 0x7f879c06b4d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8790009870 tx=0x7f8790009b80 comp rx=0 tx=0).stop 2023-03-08T15:50:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f87a19e7700 1 -- 172.21.15.123:0/1308680746 shutdown_connections 2023-03-08T15:50:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f87a19e7700 1 --2- 172.21.15.123:0/1308680746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f879c148130 0x7f879c06b4d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f87a19e7700 1 --2- 172.21.15.123:0/1308680746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f879c147510 0x7f879c0bd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f87a19e7700 1 -- 172.21.15.123:0/1308680746 >> 172.21.15.123:0/1308680746 conn(0x7f879c0ba3c0 msgr2=0x7f879c0bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f87a19e7700 1 -- 172.21.15.123:0/1308680746 shutdown_connections 2023-03-08T15:50:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.172+0000 7f87a19e7700 1 -- 172.21.15.123:0/1308680746 wait complete. 2023-03-08T15:50:06.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.174+0000 7f87a19e7700 1 Processor -- start 2023-03-08T15:50:06.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.174+0000 7f87a19e7700 1 -- start start 2023-03-08T15:50:06.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f87a19e7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f879c0b3c30 0x7f879c146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f87a19e7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f879c147510 0x7f879c142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f87a19e7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f879c148130 0x7f879c13d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f87a19e7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c146c40 con 0x7f879c148130 2023-03-08T15:50:06.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f87a19e7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0baca0 con 0x7f879c147510 2023-03-08T15:50:06.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f87a19e7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c1447e0 con 0x7f879c0b3c30 2023-03-08T15:50:06.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f879b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f879c148130 0x7f879c13d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f879b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f879c148130 0x7f879c13d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57386/0 (socket says 172.21.15.123:57386) 2023-03-08T15:50:06.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f879b7fe700 1 -- 172.21.15.123:0/1951841989 learned_addr learned my addr 172.21.15.123:0/1951841989 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:06.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f879affd700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f879c0b3c30 0x7f879c146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f879a7fc700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f879c147510 0x7f879c142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f879b7fe700 1 -- 172.21.15.123:0/1951841989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f879c0b3c30 msgr2=0x7f879c146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f879b7fe700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f879c0b3c30 0x7f879c146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f879b7fe700 1 -- 172.21.15.123:0/1951841989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f879c147510 msgr2=0x7f879c142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f879b7fe700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f879c147510 0x7f879c142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f879b7fe700 1 -- 172.21.15.123:0/1951841989 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87900094a0 con 0x7f879c148130 2023-03-08T15:50:06.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f879affd700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f879c0b3c30 0x7f879c146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:06.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f879a7fc700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f879c147510 0x7f879c142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:06.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.175+0000 7f879b7fe700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f879c148130 0x7f879c13d150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f879400cba0 tx=0x7f879400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:06.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.176+0000 7f8783fff700 1 -- 172.21.15.123:0/1951841989 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879400ab20 con 0x7f879c148130 2023-03-08T15:50:06.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.176+0000 7f8783fff700 1 -- 172.21.15.123:0/1951841989 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879400aca0 con 0x7f879c148130 2023-03-08T15:50:06.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.176+0000 7f87a19e7700 1 -- 172.21.15.123:0/1951841989 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879c0b6e10 con 0x7f879c148130 2023-03-08T15:50:06.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.176+0000 7f8783fff700 1 -- 172.21.15.123:0/1951841989 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794007310 con 0x7f879c148130 2023-03-08T15:50:06.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.176+0000 7f87a19e7700 1 -- 172.21.15.123:0/1951841989 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c0b8960 con 0x7f879c148130 2023-03-08T15:50:06.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.176+0000 7f87a19e7700 1 -- 172.21.15.123:0/1951841989 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c071eb0 con 0x7f879c148130 2023-03-08T15:50:06.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.177+0000 7f8783fff700 1 -- 172.21.15.123:0/1951841989 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f879401a030 con 0x7f879c148130 2023-03-08T15:50:06.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.177+0000 7f8783fff700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f87880698d0 0x7f878806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.177+0000 7f8783fff700 1 -- 172.21.15.123:0/1951841989 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8794087300 con 0x7f879c148130 2023-03-08T15:50:06.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.177+0000 7f879affd700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f87880698d0 0x7f878806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.178+0000 7f879affd700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f87880698d0 0x7f878806bd80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f87900090b0 tx=0x7f8790008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:06.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.181+0000 7f8783fff700 1 -- 172.21.15.123:0/1951841989 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f87940530d0 con 0x7f879c148130 2023-03-08T15:50:06.370 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.369+0000 7f87a19e7700 1 -- 172.21.15.123:0/1951841989 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f879c0744c0 con 0x7f879c148130 2023-03-08T15:50:06.371 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.369+0000 7f8783fff700 1 -- 172.21.15.123:0/1951841989 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87940566f0 con 0x7f879c148130 2023-03-08T15:50:06.371 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-03-08T15:50:06.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.371+0000 7f87a19e7700 1 -- 172.21.15.123:0/1951841989 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f87880698d0 msgr2=0x7f878806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.371+0000 7f87a19e7700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f87880698d0 0x7f878806bd80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f87900090b0 tx=0x7f8790008030 comp rx=0 tx=0).stop 2023-03-08T15:50:06.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.371+0000 7f87a19e7700 1 -- 172.21.15.123:0/1951841989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f879c148130 msgr2=0x7f879c13d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.373 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.371+0000 7f87a19e7700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f879c148130 0x7f879c13d150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f879400cba0 tx=0x7f879400cf60 comp rx=0 tx=0).stop 2023-03-08T15:50:06.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.372+0000 7f87a19e7700 1 -- 172.21.15.123:0/1951841989 shutdown_connections 2023-03-08T15:50:06.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.372+0000 7f87a19e7700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f879c148130 0x7f879c13d150 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.372+0000 7f87a19e7700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f87880698d0 0x7f878806bd80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.372+0000 7f87a19e7700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f879c0b3c30 0x7f879c146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.372+0000 7f87a19e7700 1 --2- 172.21.15.123:0/1951841989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f879c147510 0x7f879c142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.372+0000 7f87a19e7700 1 -- 172.21.15.123:0/1951841989 >> 172.21.15.123:0/1951841989 conn(0x7f879c0ba3c0 msgr2=0x7f879c0b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:06.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.372+0000 7f87a19e7700 1 -- 172.21.15.123:0/1951841989 shutdown_connections 2023-03-08T15:50:06.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.372+0000 7f87a19e7700 1 -- 172.21.15.123:0/1951841989 wait complete. 2023-03-08T15:50:06.385 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-08T15:50:06.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.506+0000 7ff09901f700 1 Processor -- start 2023-03-08T15:50:06.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.506+0000 7ff09901f700 1 -- start start 2023-03-08T15:50:06.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.506+0000 7ff09901f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff09414b420 0x7ff094156050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.506+0000 7ff09901f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09406a960 con 0x7ff09406fef0 2023-03-08T15:50:06.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.506+0000 7ff09901f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09414a810 con 0x7ff094147e50 2023-03-08T15:50:06.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.506+0000 7ff09901f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff094071a40 con 0x7ff09414b420 2023-03-08T15:50:06.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.507+0000 7ff09259c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff09406fef0 0x7ff09414ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36000/0 (socket says 172.21.15.123:36000) 2023-03-08T15:50:06.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.507+0000 7ff09259c700 1 -- 172.21.15.123:0/2452369647 learned_addr learned my addr 172.21.15.123:0/2452369647 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:06.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.507+0000 7ff09359e700 1 --2- 172.21.15.123:0/2452369647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff09414b420 0x7ff094156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.507+0000 7ff091d9b700 1 -- 172.21.15.123:0/2452369647 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858548718 0 0) 0x7ff09406a960 con 0x7ff09406fef0 2023-03-08T15:50:06.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.507+0000 7ff091d9b700 1 -- 172.21.15.123:0/2452369647 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff07c0035b0 con 0x7ff09406fef0 2023-03-08T15:50:06.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.507+0000 7ff091d9b700 1 -- 172.21.15.123:0/2452369647 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809120307 0 0) 0x7ff09414a810 con 0x7ff094147e50 2023-03-08T15:50:06.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.507+0000 7ff091d9b700 1 -- 172.21.15.123:0/2452369647 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff09406a960 con 0x7ff094147e50 2023-03-08T15:50:06.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.507+0000 7ff09359e700 1 -- 172.21.15.123:0/2452369647 >> v1:172.21.15.175:6789/0 conn(0x7ff094147e50 legacy=0x7ff09406a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.507+0000 7ff09359e700 1 -- 172.21.15.123:0/2452369647 >> v1:172.21.15.123:6789/0 conn(0x7ff09406fef0 legacy=0x7ff09414ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.507+0000 7ff09359e700 1 -- 172.21.15.123:0/2452369647 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff094071d20 con 0x7ff09414b420 2023-03-08T15:50:06.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.507+0000 7ff09359e700 1 --2- 172.21.15.123:0/2452369647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff09414b420 0x7ff094156050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009dc0 tx=0x7ff08c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5621c217ac15c1e3 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:06.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.507+0000 7ff091d9b700 1 -- 172.21.15.123:0/2452369647 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c00e070 con 0x7ff09414b420 2023-03-08T15:50:06.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.507+0000 7ff091d9b700 1 -- 172.21.15.123:0/2452369647 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c00bb20 con 0x7ff09414b420 2023-03-08T15:50:06.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.508+0000 7ff091d9b700 1 -- 172.21.15.123:0/2452369647 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c00be90 con 0x7ff09414b420 2023-03-08T15:50:06.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.508+0000 7ff09901f700 1 -- 172.21.15.123:0/2452369647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff09414b420 msgr2=0x7ff094156050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.508+0000 7ff09901f700 1 --2- 172.21.15.123:0/2452369647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff09414b420 0x7ff094156050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009dc0 tx=0x7ff08c00b330 comp rx=0 tx=0).stop 2023-03-08T15:50:06.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.508+0000 7ff09901f700 1 -- 172.21.15.123:0/2452369647 shutdown_connections 2023-03-08T15:50:06.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.508+0000 7ff09901f700 1 --2- 172.21.15.123:0/2452369647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff09414b420 0x7ff094156050 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.508+0000 7ff09901f700 1 -- 172.21.15.123:0/2452369647 >> 172.21.15.123:0/2452369647 conn(0x7ff09406b360 msgr2=0x7ff09406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:06.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.508+0000 7ff09901f700 1 -- 172.21.15.123:0/2452369647 shutdown_connections 2023-03-08T15:50:06.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.508+0000 7ff09901f700 1 -- 172.21.15.123:0/2452369647 wait complete. 2023-03-08T15:50:06.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.509+0000 7ff09901f700 1 Processor -- start 2023-03-08T15:50:06.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.509+0000 7ff09901f700 1 -- start start 2023-03-08T15:50:06.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09901f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff09406fef0 0x7ff0940bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09901f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff094147e50 0x7ff0940bd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09901f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff09414b420 0x7ff094144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09901f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940bc2c0 con 0x7ff094147e50 2023-03-08T15:50:06.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09901f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940bb740 con 0x7ff09414b420 2023-03-08T15:50:06.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09901f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940bc750 con 0x7ff09406fef0 2023-03-08T15:50:06.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff094147e50 0x7ff0940bd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff094147e50 0x7ff0940bd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57394/0 (socket says 172.21.15.123:57394) 2023-03-08T15:50:06.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09259c700 1 -- 172.21.15.123:0/3756041674 learned_addr learned my addr 172.21.15.123:0/3756041674 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:06.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09359e700 1 --2- 172.21.15.123:0/3756041674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff09414b420 0x7ff094144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff092d9d700 1 --2- 172.21.15.123:0/3756041674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff09406fef0 0x7ff0940bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09259c700 1 -- 172.21.15.123:0/3756041674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff09406fef0 msgr2=0x7ff0940bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09259c700 1 --2- 172.21.15.123:0/3756041674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff09406fef0 0x7ff0940bdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09259c700 1 -- 172.21.15.123:0/3756041674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff09414b420 msgr2=0x7ff094144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09259c700 1 --2- 172.21.15.123:0/3756041674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff09414b420 0x7ff094144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09259c700 1 -- 172.21.15.123:0/3756041674 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c009a70 con 0x7ff094147e50 2023-03-08T15:50:06.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.510+0000 7ff09259c700 1 --2- 172.21.15.123:0/3756041674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff094147e50 0x7ff0940bd280 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff08800c520 tx=0x7ff08800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:06.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.511+0000 7ff07b7fe700 1 -- 172.21.15.123:0/3756041674 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088005d70 con 0x7ff094147e50 2023-03-08T15:50:06.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.511+0000 7ff07b7fe700 1 -- 172.21.15.123:0/3756041674 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0880070d0 con 0x7ff094147e50 2023-03-08T15:50:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.511+0000 7ff07b7fe700 1 -- 172.21.15.123:0/3756041674 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088007440 con 0x7ff094147e50 2023-03-08T15:50:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.511+0000 7ff09901f700 1 -- 172.21.15.123:0/3756041674 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff094148220 con 0x7ff094147e50 2023-03-08T15:50:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.511+0000 7ff09901f700 1 -- 172.21.15.123:0/3756041674 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff094072000 con 0x7ff094147e50 2023-03-08T15:50:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.512+0000 7ff09901f700 1 -- 172.21.15.123:0/3756041674 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0940bc470 con 0x7ff094147e50 2023-03-08T15:50:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.512+0000 7ff07b7fe700 1 -- 172.21.15.123:0/3756041674 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7ff088019030 con 0x7ff094147e50 2023-03-08T15:50:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.512+0000 7ff07b7fe700 1 --2- 172.21.15.123:0/3756041674 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff0800698d0 0x7ff08006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.513+0000 7ff07b7fe700 1 -- 172.21.15.123:0/3756041674 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0880868d0 con 0x7ff094147e50 2023-03-08T15:50:06.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.513+0000 7ff092d9d700 1 --2- 172.21.15.123:0/3756041674 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff0800698d0 0x7ff08006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.513+0000 7ff092d9d700 1 --2- 172.21.15.123:0/3756041674 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff0800698d0 0x7ff08006bd80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff084001220 tx=0x7ff084009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:06.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.517+0000 7ff07b7fe700 1 -- 172.21.15.123:0/3756041674 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7ff08804c150 con 0x7ff094147e50 2023-03-08T15:50:06.702 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.701+0000 7ff09901f700 1 -- 172.21.15.123:0/3756041674 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff0940703e0 con 0x7ff094147e50 2023-03-08T15:50:06.703 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.701+0000 7ff07b7fe700 1 -- 172.21.15.123:0/3756041674 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff088017020 con 0x7ff094147e50 2023-03-08T15:50:06.703 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-03-08T15:50:06.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.703+0000 7ff09901f700 1 -- 172.21.15.123:0/3756041674 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff0800698d0 msgr2=0x7ff08006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.703+0000 7ff09901f700 1 --2- 172.21.15.123:0/3756041674 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff0800698d0 0x7ff08006bd80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff084001220 tx=0x7ff084009040 comp rx=0 tx=0).stop 2023-03-08T15:50:06.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.703+0000 7ff09901f700 1 -- 172.21.15.123:0/3756041674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff094147e50 msgr2=0x7ff0940bd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.703+0000 7ff09901f700 1 --2- 172.21.15.123:0/3756041674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff094147e50 0x7ff0940bd280 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff08800c520 tx=0x7ff08800c8e0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.705 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.703+0000 7ff09901f700 1 -- 172.21.15.123:0/3756041674 shutdown_connections 2023-03-08T15:50:06.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.703+0000 7ff09901f700 1 --2- 172.21.15.123:0/3756041674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff09414b420 0x7ff094144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.703+0000 7ff09901f700 1 --2- 172.21.15.123:0/3756041674 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff0800698d0 0x7ff08006bd80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.703+0000 7ff09901f700 1 --2- 172.21.15.123:0/3756041674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff09406fef0 0x7ff0940bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.703+0000 7ff09901f700 1 --2- 172.21.15.123:0/3756041674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff094147e50 0x7ff0940bd280 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.703+0000 7ff09901f700 1 -- 172.21.15.123:0/3756041674 >> 172.21.15.123:0/3756041674 conn(0x7ff09406b360 msgr2=0x7ff0940b86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:06.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.703+0000 7ff09901f700 1 -- 172.21.15.123:0/3756041674 shutdown_connections 2023-03-08T15:50:06.706 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.704+0000 7ff09901f700 1 -- 172.21.15.123:0/3756041674 wait complete. 2023-03-08T15:50:06.717 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-08T15:50:06.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.836+0000 7f634e8cd700 1 Processor -- start 2023-03-08T15:50:06.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.836+0000 7f634e8cd700 1 -- start start 2023-03-08T15:50:06.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.837+0000 7f634e8cd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6348147510 0x7f63480bd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.837+0000 7f634e8cd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f63480b3c30 0x7f6348151d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.837+0000 7f634e8cd700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63480b7180 con 0x7f6348148130 2023-03-08T15:50:06.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.837+0000 7f634e8cd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6348141cd0 con 0x7f6348147510 2023-03-08T15:50:06.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.837+0000 7f634e8cd700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63480b8c40 con 0x7f63480b3c30 2023-03-08T15:50:06.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.837+0000 7f63477fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6348147510 0x7f63480bd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.837+0000 7f6347fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6348148130 0x7f634806b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36012/0 (socket says 172.21.15.123:36012) 2023-03-08T15:50:06.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.837+0000 7f6347fff700 1 -- 172.21.15.123:0/3262381189 learned_addr learned my addr 172.21.15.123:0/3262381189 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:06.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.837+0000 7f634ce6a700 1 --2- 172.21.15.123:0/3262381189 >> v2:172.21.15.175:3300/0 conn(0x7f63480b3c30 0x7f6348151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f63477fe700 1 -- 172.21.15.123:0/3262381189 >> v2:172.21.15.175:3300/0 conn(0x7f63480b3c30 msgr2=0x7f6348151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:06.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f63477fe700 1 --2- 172.21.15.123:0/3262381189 >> v2:172.21.15.175:3300/0 conn(0x7f63480b3c30 0x7f6348151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f63477fe700 1 -- 172.21.15.123:0/3262381189 >> v1:172.21.15.123:6789/0 conn(0x7f6348148130 legacy=0x7f634806b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f63477fe700 1 -- 172.21.15.123:0/3262381189 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63480b8960 con 0x7f6348147510 2023-03-08T15:50:06.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f6346ffd700 1 -- 172.21.15.123:0/3262381189 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061854950 0 0) 0x7f63480b7180 con 0x7f6348148130 2023-03-08T15:50:06.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f63477fe700 1 --2- 172.21.15.123:0/3262381189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6348147510 0x7f63480bd420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f63481450b0 tx=0x7f6330009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb75ec4f681fe2b server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:06.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f6346ffd700 1 -- 172.21.15.123:0/3262381189 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330011830 con 0x7f6348147510 2023-03-08T15:50:06.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f6346ffd700 1 -- 172.21.15.123:0/3262381189 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6330011990 con 0x7f6348147510 2023-03-08T15:50:06.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f6346ffd700 1 -- 172.21.15.123:0/3262381189 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330011d20 con 0x7f6348147510 2023-03-08T15:50:06.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f634e8cd700 1 -- 172.21.15.123:0/3262381189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6348147510 msgr2=0x7f63480bd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f634e8cd700 1 --2- 172.21.15.123:0/3262381189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6348147510 0x7f63480bd420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f63481450b0 tx=0x7f6330009b20 comp rx=0 tx=0).stop 2023-03-08T15:50:06.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f634e8cd700 1 -- 172.21.15.123:0/3262381189 shutdown_connections 2023-03-08T15:50:06.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f634e8cd700 1 --2- 172.21.15.123:0/3262381189 >> v2:172.21.15.175:3300/0 conn(0x7f63480b3c30 0x7f6348151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f634e8cd700 1 --2- 172.21.15.123:0/3262381189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6348147510 0x7f63480bd420 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f634e8cd700 1 -- 172.21.15.123:0/3262381189 >> 172.21.15.123:0/3262381189 conn(0x7f63480ba3c0 msgr2=0x7f63480bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:06.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f634e8cd700 1 -- 172.21.15.123:0/3262381189 shutdown_connections 2023-03-08T15:50:06.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.838+0000 7f634e8cd700 1 -- 172.21.15.123:0/3262381189 wait complete. 2023-03-08T15:50:06.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.839+0000 7f634e8cd700 1 Processor -- start 2023-03-08T15:50:06.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.840+0000 7f634e8cd700 1 -- start start 2023-03-08T15:50:06.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.840+0000 7f634e8cd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63480b3c30 0x7f6348142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.840+0000 7f634e8cd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6348147510 0x7f634813f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.840+0000 7f634e8cd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6348148130 0x7f63481e3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.840+0000 7f634e8cd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63480bd570 con 0x7f63480b3c30 2023-03-08T15:50:06.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.840+0000 7f634e8cd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63480bd990 con 0x7f6348148130 2023-03-08T15:50:06.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.840+0000 7f634e8cd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63480bd1b0 con 0x7f6348147510 2023-03-08T15:50:06.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.840+0000 7f6347fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63480b3c30 0x7f6348142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.840+0000 7f6347fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63480b3c30 0x7f6348142260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57416/0 (socket says 172.21.15.123:57416) 2023-03-08T15:50:06.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.840+0000 7f6347fff700 1 -- 172.21.15.123:0/842926018 learned_addr learned my addr 172.21.15.123:0/842926018 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:06.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.840+0000 7f634ce6a700 1 --2- 172.21.15.123:0/842926018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6348148130 0x7f63481e3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.840+0000 7f63477fe700 1 --2- 172.21.15.123:0/842926018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6348147510 0x7f634813f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.841+0000 7f6347fff700 1 -- 172.21.15.123:0/842926018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6348147510 msgr2=0x7f634813f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.841+0000 7f6347fff700 1 --2- 172.21.15.123:0/842926018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6348147510 0x7f634813f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.841+0000 7f6347fff700 1 -- 172.21.15.123:0/842926018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6348148130 msgr2=0x7f63481e3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:06.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.841+0000 7f6347fff700 1 --2- 172.21.15.123:0/842926018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6348148130 0x7f63481e3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:06.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.841+0000 7f6347fff700 1 -- 172.21.15.123:0/842926018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63300094a0 con 0x7f63480b3c30 2023-03-08T15:50:06.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.841+0000 7f6347fff700 1 --2- 172.21.15.123:0/842926018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63480b3c30 0x7f6348142260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f633800c550 tx=0x7f633800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:06.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.841+0000 7f6344ff9700 1 -- 172.21.15.123:0/842926018 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6338004c80 con 0x7f63480b3c30 2023-03-08T15:50:06.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.841+0000 7f6344ff9700 1 -- 172.21.15.123:0/842926018 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6338004e00 con 0x7f63480b3c30 2023-03-08T15:50:06.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.841+0000 7f634e8cd700 1 -- 172.21.15.123:0/842926018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6348071eb0 con 0x7f63480b3c30 2023-03-08T15:50:06.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.841+0000 7f6344ff9700 1 -- 172.21.15.123:0/842926018 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6338007310 con 0x7f63480b3c30 2023-03-08T15:50:06.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.841+0000 7f634e8cd700 1 -- 172.21.15.123:0/842926018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63480b6e10 con 0x7f63480b3c30 2023-03-08T15:50:06.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.842+0000 7f634e8cd700 1 -- 172.21.15.123:0/842926018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6348072040 con 0x7f63480b3c30 2023-03-08T15:50:06.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.842+0000 7f6344ff9700 1 -- 172.21.15.123:0/842926018 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f633801a020 con 0x7f63480b3c30 2023-03-08T15:50:06.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.843+0000 7f6344ff9700 1 --2- 172.21.15.123:0/842926018 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f63280698d0 0x7f632806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:06.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.843+0000 7f63477fe700 1 --2- 172.21.15.123:0/842926018 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f63280698d0 0x7f632806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:06.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.843+0000 7f6344ff9700 1 -- 172.21.15.123:0/842926018 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63380872a0 con 0x7f63480b3c30 2023-03-08T15:50:06.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.843+0000 7f63477fe700 1 --2- 172.21.15.123:0/842926018 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f63280698d0 0x7f632806bd80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f63300090b0 tx=0x7f6330008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:06.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:06.847+0000 7f6344ff9700 1 -- 172.21.15.123:0/842926018 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f6338053120 con 0x7f63480b3c30 2023-03-08T15:50:07.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.048+0000 7f634e8cd700 1 -- 172.21.15.123:0/842926018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f63480bd2f0 con 0x7f63480b3c30 2023-03-08T15:50:07.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.048+0000 7f6344ff9700 1 -- 172.21.15.123:0/842926018 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6338056740 con 0x7f63480b3c30 2023-03-08T15:50:07.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.050+0000 7f634e8cd700 1 -- 172.21.15.123:0/842926018 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f63280698d0 msgr2=0x7f632806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:07.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.050+0000 7f634e8cd700 1 --2- 172.21.15.123:0/842926018 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f63280698d0 0x7f632806bd80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f63300090b0 tx=0x7f6330008030 comp rx=0 tx=0).stop 2023-03-08T15:50:07.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.050+0000 7f634e8cd700 1 -- 172.21.15.123:0/842926018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63480b3c30 msgr2=0x7f6348142260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:07.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.050+0000 7f634e8cd700 1 --2- 172.21.15.123:0/842926018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63480b3c30 0x7f6348142260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f633800c550 tx=0x7f633800c910 comp rx=0 tx=0).stop 2023-03-08T15:50:07.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.050+0000 7f634e8cd700 1 -- 172.21.15.123:0/842926018 shutdown_connections 2023-03-08T15:50:07.052 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.050+0000 7f634e8cd700 1 --2- 172.21.15.123:0/842926018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6348148130 0x7f63481e3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.050+0000 7f634e8cd700 1 --2- 172.21.15.123:0/842926018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63480b3c30 0x7f6348142260 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.050+0000 7f634e8cd700 1 --2- 172.21.15.123:0/842926018 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f63280698d0 0x7f632806bd80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.050+0000 7f634e8cd700 1 --2- 172.21.15.123:0/842926018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6348147510 0x7f634813f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.050+0000 7f634e8cd700 1 -- 172.21.15.123:0/842926018 >> 172.21.15.123:0/842926018 conn(0x7f63480ba3c0 msgr2=0x7f634806f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:07.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.050+0000 7f634e8cd700 1 -- 172.21.15.123:0/842926018 shutdown_connections 2023-03-08T15:50:07.053 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.050+0000 7f634e8cd700 1 -- 172.21.15.123:0/842926018 wait complete. 2023-03-08T15:50:07.054 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2023-03-08T15:50:07.064 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-03-08T15:50:07.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:07.065 DEBUG:teuthology.orchestra.run.smithi182:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-03-08T15:50:07.191 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi182.front.sepia.ceph.com 2023-03-08T15:50:07.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:07.192 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-03-08T15:50:07.350 INFO:tasks.cephfs.cephfs_test_case:[] 2023-03-08T15:50:07.351 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-08T15:50:07.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.469+0000 7fb98584a700 1 Processor -- start 2023-03-08T15:50:07.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.470+0000 7fb98584a700 1 -- start start 2023-03-08T15:50:07.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.470+0000 7fb98584a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb980071c40 0x7fb980072010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:07.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.470+0000 7fb98584a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9800bad80 0x7fb9800bb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:07.473 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.470+0000 7fb98584a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9800ba8f0 con 0x7fb98014dc90 2023-03-08T15:50:07.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.470+0000 7fb98584a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb98006bc00 con 0x7fb980071c40 2023-03-08T15:50:07.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.470+0000 7fb98584a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9800bb740 con 0x7fb9800bad80 2023-03-08T15:50:07.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.470+0000 7fb97f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9800bad80 0x7fb9800bb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:07.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.470+0000 7fb97f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9800bad80 0x7fb9800bb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:59394/0 (socket says 172.21.15.123:59394) 2023-03-08T15:50:07.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.470+0000 7fb97f7fe700 1 -- 172.21.15.123:0/3772921047 learned_addr learned my addr 172.21.15.123:0/3772921047 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:07.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.470+0000 7fb97effd700 1 --2- 172.21.15.123:0/3772921047 >> v2:172.21.15.175:3300/0 conn(0x7fb980071c40 0x7fb980072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:07.474 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.471+0000 7fb97effd700 1 -- 172.21.15.123:0/3772921047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9800bad80 msgr2=0x7fb9800bb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:07.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.471+0000 7fb97effd700 1 --2- 172.21.15.123:0/3772921047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9800bad80 0x7fb9800bb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.471+0000 7fb97effd700 1 -- 172.21.15.123:0/3772921047 >> v1:172.21.15.175:6789/0 conn(0x7fb98014dc90 legacy=0x7fb980144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:07.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.471+0000 7fb97effd700 1 -- 172.21.15.123:0/3772921047 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb980144e50 con 0x7fb980071c40 2023-03-08T15:50:07.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.471+0000 7fb97f7fe700 1 --2- 172.21.15.123:0/3772921047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9800bad80 0x7fb9800bb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:50:07.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.471+0000 7fb97effd700 1 --2- 172.21.15.123:0/3772921047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb980071c40 0x7fb980072010 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb974009840 tx=0x7fb974009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a109961bf49828d2 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:07.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.471+0000 7fb97dffb700 1 -- 172.21.15.123:0/3772921047 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974011830 con 0x7fb980071c40 2023-03-08T15:50:07.475 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.471+0000 7fb97dffb700 1 -- 172.21.15.123:0/3772921047 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb974011990 con 0x7fb980071c40 2023-03-08T15:50:07.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.471+0000 7fb97dffb700 1 -- 172.21.15.123:0/3772921047 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974011d20 con 0x7fb980071c40 2023-03-08T15:50:07.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.472+0000 7fb98584a700 1 -- 172.21.15.123:0/3772921047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb980071c40 msgr2=0x7fb980072010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:07.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.472+0000 7fb98584a700 1 --2- 172.21.15.123:0/3772921047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb980071c40 0x7fb980072010 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb974009840 tx=0x7fb974009b50 comp rx=0 tx=0).stop 2023-03-08T15:50:07.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.472+0000 7fb98584a700 1 -- 172.21.15.123:0/3772921047 shutdown_connections 2023-03-08T15:50:07.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.472+0000 7fb98584a700 1 --2- 172.21.15.123:0/3772921047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9800bad80 0x7fb9800bb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.472+0000 7fb98584a700 1 --2- 172.21.15.123:0/3772921047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb980071c40 0x7fb980072010 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.472+0000 7fb98584a700 1 -- 172.21.15.123:0/3772921047 >> 172.21.15.123:0/3772921047 conn(0x7fb98006a250 msgr2=0x7fb98006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:07.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.472+0000 7fb98584a700 1 -- 172.21.15.123:0/3772921047 shutdown_connections 2023-03-08T15:50:07.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.472+0000 7fb98584a700 1 -- 172.21.15.123:0/3772921047 wait complete. 2023-03-08T15:50:07.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.473+0000 7fb98584a700 1 Processor -- start 2023-03-08T15:50:07.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.473+0000 7fb98584a700 1 -- start start 2023-03-08T15:50:07.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.473+0000 7fb98584a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb980071c40 0x7fb9801d70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:07.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.473+0000 7fb98584a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9800bad80 0x7fb98014cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:07.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb98584a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb98014dc90 0x7fb98014d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:07.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb98584a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9801d7630 con 0x7fb9800bad80 2023-03-08T15:50:07.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb98584a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98014c6f0 con 0x7fb98014dc90 2023-03-08T15:50:07.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb98584a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98014c880 con 0x7fb980071c40 2023-03-08T15:50:07.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb97e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9800bad80 0x7fb98014cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:07.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb97e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9800bad80 0x7fb98014cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57424/0 (socket says 172.21.15.123:57424) 2023-03-08T15:50:07.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb97e7fc700 1 -- 172.21.15.123:0/2722135758 learned_addr learned my addr 172.21.15.123:0/2722135758 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:07.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb97f7fe700 1 --2- 172.21.15.123:0/2722135758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb98014dc90 0x7fb98014d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:07.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb97effd700 1 --2- 172.21.15.123:0/2722135758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb980071c40 0x7fb9801d70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:07.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb97e7fc700 1 -- 172.21.15.123:0/2722135758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb980071c40 msgr2=0x7fb9801d70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:07.480 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb97e7fc700 1 --2- 172.21.15.123:0/2722135758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb980071c40 0x7fb9801d70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb97e7fc700 1 -- 172.21.15.123:0/2722135758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb98014dc90 msgr2=0x7fb98014d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:07.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb97e7fc700 1 --2- 172.21.15.123:0/2722135758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb98014dc90 0x7fb98014d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb97e7fc700 1 -- 172.21.15.123:0/2722135758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb978009b30 con 0x7fb9800bad80 2023-03-08T15:50:07.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb97e7fc700 1 --2- 172.21.15.123:0/2722135758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9800bad80 0x7fb98014cd10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb97000c450 tx=0x7fb97000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:07.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb967fff700 1 -- 172.21.15.123:0/2722135758 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9700052d0 con 0x7fb9800bad80 2023-03-08T15:50:07.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb967fff700 1 -- 172.21.15.123:0/2722135758 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb970005430 con 0x7fb9800bad80 2023-03-08T15:50:07.481 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb967fff700 1 -- 172.21.15.123:0/2722135758 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9700038c0 con 0x7fb9800bad80 2023-03-08T15:50:07.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb98584a700 1 -- 172.21.15.123:0/2722135758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9740094a0 con 0x7fb9800bad80 2023-03-08T15:50:07.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.474+0000 7fb98584a700 1 -- 172.21.15.123:0/2722135758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98014e790 con 0x7fb9800bad80 2023-03-08T15:50:07.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.475+0000 7fb98584a700 1 -- 172.21.15.123:0/2722135758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98014e4b0 con 0x7fb9800bad80 2023-03-08T15:50:07.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.476+0000 7fb967fff700 1 -- 172.21.15.123:0/2722135758 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fb970019030 con 0x7fb9800bad80 2023-03-08T15:50:07.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.476+0000 7fb967fff700 1 --2- 172.21.15.123:0/2722135758 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb96c0698d0 0x7fb96c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:07.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.476+0000 7fb967fff700 1 -- 172.21.15.123:0/2722135758 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb9700867d0 con 0x7fb9800bad80 2023-03-08T15:50:07.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.476+0000 7fb97effd700 1 --2- 172.21.15.123:0/2722135758 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb96c0698d0 0x7fb96c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:07.482 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.476+0000 7fb97effd700 1 --2- 172.21.15.123:0/2722135758 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb96c0698d0 0x7fb96c06bd80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb974000c00 tx=0x7fb974008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:07.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.480+0000 7fb967fff700 1 -- 172.21.15.123:0/2722135758 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fb9700525a0 con 0x7fb9800bad80 2023-03-08T15:50:07.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.705+0000 7fb98584a700 1 -- 172.21.15.123:0/2722135758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb98014ea70 con 0x7fb9800bad80 2023-03-08T15:50:07.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.706+0000 7fb967fff700 1 -- 172.21.15.123:0/2722135758 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3915 (secure 0 0 0) 0x7fb97000ce60 con 0x7fb9800bad80 2023-03-08T15:50:07.708 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:07.708 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/108043707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":108043707},{"type":"v1","addr":"172.21.15.123:6835","nonce":108043707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1787308526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1787308526},{"type":"v1","addr":"172.21.15.123:6837","nonce":1787308526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-08T15:49:39.489034+0000","modified":"2023-03-08T15:49:42.501407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6833/1018957090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1018957090},{"type":"v1","addr":"172.21.15.175:6833","nonce":1018957090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-08T15:50:07.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.708+0000 7fb98584a700 1 -- 172.21.15.123:0/2722135758 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb96c0698d0 msgr2=0x7fb96c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:07.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.708+0000 7fb98584a700 1 --2- 172.21.15.123:0/2722135758 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb96c0698d0 0x7fb96c06bd80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb974000c00 tx=0x7fb974008030 comp rx=0 tx=0).stop 2023-03-08T15:50:07.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.708+0000 7fb98584a700 1 -- 172.21.15.123:0/2722135758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9800bad80 msgr2=0x7fb98014cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:07.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.708+0000 7fb98584a700 1 --2- 172.21.15.123:0/2722135758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9800bad80 0x7fb98014cd10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb97000c450 tx=0x7fb97000c760 comp rx=0 tx=0).stop 2023-03-08T15:50:07.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.708+0000 7fb98584a700 1 -- 172.21.15.123:0/2722135758 shutdown_connections 2023-03-08T15:50:07.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.708+0000 7fb98584a700 1 --2- 172.21.15.123:0/2722135758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb98014dc90 0x7fb98014d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.708+0000 7fb98584a700 1 --2- 172.21.15.123:0/2722135758 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fb96c0698d0 0x7fb96c06bd80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.708+0000 7fb98584a700 1 --2- 172.21.15.123:0/2722135758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb980071c40 0x7fb9801d70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.708+0000 7fb98584a700 1 --2- 172.21.15.123:0/2722135758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9800bad80 0x7fb98014cd10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.708+0000 7fb98584a700 1 -- 172.21.15.123:0/2722135758 >> 172.21.15.123:0/2722135758 conn(0x7fb98006a250 msgr2=0x7fb9801438a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:07.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.708+0000 7fb98584a700 1 -- 172.21.15.123:0/2722135758 shutdown_connections 2023-03-08T15:50:07.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.708+0000 7fb98584a700 1 -- 172.21.15.123:0/2722135758 wait complete. 2023-03-08T15:50:07.711 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2023-03-08T15:50:07.721 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:50:07.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.840+0000 7f09a3e6b700 1 Processor -- start 2023-03-08T15:50:07.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.840+0000 7f09a3e6b700 1 -- start start 2023-03-08T15:50:07.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.841+0000 7f09a3e6b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f099c144a90 0x7f099c0bd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:07.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.841+0000 7f09a3e6b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f099c0ba560 0x7f099c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:07.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.841+0000 7f09a3e6b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099c0b7fa0 con 0x7f099c1446c0 2023-03-08T15:50:07.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.841+0000 7f09a3e6b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099c0bc030 con 0x7f099c0ba560 2023-03-08T15:50:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.841+0000 7f09a3e6b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099c0bc310 con 0x7f099c144a90 2023-03-08T15:50:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.841+0000 7f09a1406700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f099c144a90 0x7f099c0bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.841+0000 7f09a1c07700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f099c1446c0 0x7f099c0b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.123:56482/0 (socket says 172.21.15.123:56482) 2023-03-08T15:50:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.841+0000 7f09a1c07700 1 -- 172.21.15.123:0/3881318438 learned_addr learned my addr 172.21.15.123:0/3881318438 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.841+0000 7f09a2408700 1 --2- 172.21.15.123:0/3881318438 >> v2:172.21.15.175:3300/0 conn(0x7f099c0ba560 0x7f099c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.841+0000 7f09a1406700 1 -- 172.21.15.123:0/3881318438 >> v2:172.21.15.175:3300/0 conn(0x7f099c0ba560 msgr2=0x7f099c154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.841+0000 7f09a1406700 1 --2- 172.21.15.123:0/3881318438 >> v2:172.21.15.175:3300/0 conn(0x7f099c0ba560 0x7f099c154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.841+0000 7f09a1406700 1 -- 172.21.15.123:0/3881318438 >> v1:172.21.15.175:6789/0 conn(0x7f099c1446c0 legacy=0x7f099c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.841+0000 7f09a1406700 1 -- 172.21.15.123:0/3881318438 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c0bc5f0 con 0x7f099c144a90 2023-03-08T15:50:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.842+0000 7f09a1406700 1 --2- 172.21.15.123:0/3881318438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f099c144a90 0x7f099c0bd580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0998009840 tx=0x7f0998009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48a3325581ef9e52 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.842+0000 7f09a0c05700 1 -- 172.21.15.123:0/3881318438 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0998011830 con 0x7f099c144a90 2023-03-08T15:50:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.842+0000 7f09a0c05700 1 -- 172.21.15.123:0/3881318438 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0998011990 con 0x7f099c144a90 2023-03-08T15:50:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.842+0000 7f09a0c05700 1 -- 172.21.15.123:0/3881318438 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0998011d20 con 0x7f099c144a90 2023-03-08T15:50:07.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.842+0000 7f09a3e6b700 1 -- 172.21.15.123:0/3881318438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f099c144a90 msgr2=0x7f099c0bd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:07.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.842+0000 7f09a3e6b700 1 --2- 172.21.15.123:0/3881318438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f099c144a90 0x7f099c0bd580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0998009840 tx=0x7f0998009b50 comp rx=0 tx=0).stop 2023-03-08T15:50:07.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.842+0000 7f09a3e6b700 1 -- 172.21.15.123:0/3881318438 shutdown_connections 2023-03-08T15:50:07.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.842+0000 7f09a3e6b700 1 --2- 172.21.15.123:0/3881318438 >> v2:172.21.15.175:3300/0 conn(0x7f099c0ba560 0x7f099c154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.842+0000 7f09a3e6b700 1 --2- 172.21.15.123:0/3881318438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f099c144a90 0x7f099c0bd580 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.842+0000 7f09a3e6b700 1 -- 172.21.15.123:0/3881318438 >> 172.21.15.123:0/3881318438 conn(0x7f099c071980 msgr2=0x7f099c071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:07.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.842+0000 7f09a3e6b700 1 -- 172.21.15.123:0/3881318438 shutdown_connections 2023-03-08T15:50:07.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.842+0000 7f09a3e6b700 1 -- 172.21.15.123:0/3881318438 wait complete. 2023-03-08T15:50:07.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.844+0000 7f09a3e6b700 1 Processor -- start 2023-03-08T15:50:07.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.844+0000 7f09a3e6b700 1 -- start start 2023-03-08T15:50:07.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.844+0000 7f09a3e6b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f099c0ba560 0x7f099c13da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:07.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.844+0000 7f09a3e6b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f099c1446c0 0x7f099c13ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:07.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.844+0000 7f09a3e6b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f099c144a90 0x7f099c13c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:07.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.844+0000 7f09a3e6b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c13df70 con 0x7f099c1446c0 2023-03-08T15:50:07.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.844+0000 7f09a3e6b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c14bf80 con 0x7f099c0ba560 2023-03-08T15:50:07.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09a3e6b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099c1e13a0 con 0x7f099c144a90 2023-03-08T15:50:07.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09a1406700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f099c1446c0 0x7f099c13ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:07.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09a1406700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f099c1446c0 0x7f099c13ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57432/0 (socket says 172.21.15.123:57432) 2023-03-08T15:50:07.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09a1406700 1 -- 172.21.15.123:0/3369841882 learned_addr learned my addr 172.21.15.123:0/3369841882 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:07.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09a2408700 1 --2- 172.21.15.123:0/3369841882 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f099c144a90 0x7f099c13c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:07.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09a1c07700 1 --2- 172.21.15.123:0/3369841882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f099c0ba560 0x7f099c13da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:07.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09a1406700 1 -- 172.21.15.123:0/3369841882 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f099c144a90 msgr2=0x7f099c13c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:07.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09a1406700 1 --2- 172.21.15.123:0/3369841882 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f099c144a90 0x7f099c13c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09a1406700 1 -- 172.21.15.123:0/3369841882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f099c0ba560 msgr2=0x7f099c13da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:07.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09a1406700 1 --2- 172.21.15.123:0/3369841882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f099c0ba560 0x7f099c13da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:07.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09a1406700 1 -- 172.21.15.123:0/3369841882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09980094a0 con 0x7f099c1446c0 2023-03-08T15:50:07.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09a1c07700 1 --2- 172.21.15.123:0/3369841882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f099c0ba560 0x7f099c13da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:07.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09a1406700 1 --2- 172.21.15.123:0/3369841882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f099c1446c0 0x7f099c13ba10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f09980090b0 tx=0x7f0998004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:07.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09927fc700 1 -- 172.21.15.123:0/3369841882 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09980036a0 con 0x7f099c1446c0 2023-03-08T15:50:07.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09927fc700 1 -- 172.21.15.123:0/3369841882 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099801e070 con 0x7f099c1446c0 2023-03-08T15:50:07.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09927fc700 1 -- 172.21.15.123:0/3369841882 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0998003a40 con 0x7f099c1446c0 2023-03-08T15:50:07.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09a3e6b700 1 -- 172.21.15.123:0/3369841882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099c14db90 con 0x7f099c1446c0 2023-03-08T15:50:07.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.845+0000 7f09a3e6b700 1 -- 172.21.15.123:0/3369841882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099c0bdac0 con 0x7f099c1446c0 2023-03-08T15:50:07.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.846+0000 7f09a3e6b700 1 -- 172.21.15.123:0/3369841882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099c13b860 con 0x7f099c1446c0 2023-03-08T15:50:07.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.847+0000 7f09927fc700 1 -- 172.21.15.123:0/3369841882 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f099800f050 con 0x7f099c1446c0 2023-03-08T15:50:07.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.847+0000 7f09927fc700 1 --2- 172.21.15.123:0/3369841882 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f09800698d0 0x7f098006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:07.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.847+0000 7f09927fc700 1 -- 172.21.15.123:0/3369841882 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0998088700 con 0x7f099c1446c0 2023-03-08T15:50:07.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.847+0000 7f09a1c07700 1 --2- 172.21.15.123:0/3369841882 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f09800698d0 0x7f098006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:07.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.847+0000 7f09a1c07700 1 --2- 172.21.15.123:0/3369841882 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f09800698d0 0x7f098006bd80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f098c007fd0 tx=0x7f098c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:07.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:07.851+0000 7f09927fc700 1 -- 172.21.15.123:0/3369841882 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f09980544d0 con 0x7f099c1446c0 2023-03-08T15:50:08.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.038+0000 7f09a3e6b700 1 -- 172.21.15.123:0/3369841882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f099c14dd20 con 0x7f099c1446c0 2023-03-08T15:50:08.040 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.039+0000 7f09927fc700 1 -- 172.21.15.123:0/3369841882 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f099c14dd20 con 0x7f099c1446c0 2023-03-08T15:50:08.041 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:08.041 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:40.490671+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:49:37.104720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-08T15:49:38.431537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:50:08.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.041+0000 7f09a3e6b700 1 -- 172.21.15.123:0/3369841882 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f09800698d0 msgr2=0x7f098006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.041+0000 7f09a3e6b700 1 --2- 172.21.15.123:0/3369841882 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f09800698d0 0x7f098006bd80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f098c007fd0 tx=0x7f098c009040 comp rx=0 tx=0).stop 2023-03-08T15:50:08.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.041+0000 7f09a3e6b700 1 -- 172.21.15.123:0/3369841882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f099c1446c0 msgr2=0x7f099c13ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.041+0000 7f09a3e6b700 1 --2- 172.21.15.123:0/3369841882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f099c1446c0 0x7f099c13ba10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f09980090b0 tx=0x7f0998004750 comp rx=0 tx=0).stop 2023-03-08T15:50:08.043 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.041+0000 7f09a3e6b700 1 -- 172.21.15.123:0/3369841882 shutdown_connections 2023-03-08T15:50:08.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.041+0000 7f09a3e6b700 1 --2- 172.21.15.123:0/3369841882 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f09800698d0 0x7f098006bd80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.041+0000 7f09a3e6b700 1 --2- 172.21.15.123:0/3369841882 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f099c144a90 0x7f099c13c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.041+0000 7f09a3e6b700 1 --2- 172.21.15.123:0/3369841882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f099c0ba560 0x7f099c13da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.041+0000 7f09a3e6b700 1 --2- 172.21.15.123:0/3369841882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f099c1446c0 0x7f099c13ba10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.041+0000 7f09a3e6b700 1 -- 172.21.15.123:0/3369841882 >> 172.21.15.123:0/3369841882 conn(0x7f099c071980 msgr2=0x7f099c1d6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:08.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.041+0000 7f09a3e6b700 1 -- 172.21.15.123:0/3369841882 shutdown_connections 2023-03-08T15:50:08.044 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.041+0000 7f09a3e6b700 1 -- 172.21.15.123:0/3369841882 wait complete. 2023-03-08T15:50:08.055 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-08T15:49:26.011228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-08T15:49:32.528343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-08T15:49:37.104720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-08T15:49:38.431537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-08T15:50:08.055 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-08T15:50:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.176+0000 7fcb9682c700 1 Processor -- start 2023-03-08T15:50:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.176+0000 7fcb9682c700 1 -- start start 2023-03-08T15:50:08.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.176+0000 7fcb9682c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcb9014b1c0 0x7fcb9006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.180 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb9682c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb90070670 con 0x7fcb90072760 2023-03-08T15:50:08.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb9682c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb90070c50 con 0x7fcb900ba280 2023-03-08T15:50:08.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb9682c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb90070a40 con 0x7fcb9014b1c0 2023-03-08T15:50:08.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8f7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcb90072760 0x7fcb9014aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36016/0 (socket says 172.21.15.123:36016) 2023-03-08T15:50:08.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8f7fe700 1 -- 172.21.15.123:0/3737804943 learned_addr learned my addr 172.21.15.123:0/3737804943 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:08.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb94dc9700 1 --2- 172.21.15.123:0/3737804943 >> v2:172.21.15.175:3300/0 conn(0x7fcb9014b1c0 0x7fcb9006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855434467 0 0) 0x7fcb90070670 con 0x7fcb90072760 2023-03-08T15:50:08.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb780035b0 con 0x7fcb90072760 2023-03-08T15:50:08.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312180279 0 0) 0x7fcb90070c50 con 0x7fcb900ba280 2023-03-08T15:50:08.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb90070670 con 0x7fcb900ba280 2023-03-08T15:50:08.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 252391515 0 0) 0x7fcb780035b0 con 0x7fcb90072760 2023-03-08T15:50:08.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 >> v2:172.21.15.175:3300/0 conn(0x7fcb9014b1c0 msgr2=0x7fcb9006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:08.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 --2- 172.21.15.123:0/3737804943 >> v2:172.21.15.175:3300/0 conn(0x7fcb9014b1c0 0x7fcb9006fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 >> v1:172.21.15.175:6789/0 conn(0x7fcb900ba280 legacy=0x7fcb90141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb900ba650 con 0x7fcb90072760 2023-03-08T15:50:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7fcb84001670 con 0x7fcb90072760 2023-03-08T15:50:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 >> v1:172.21.15.123:6789/0 conn(0x7fcb90072760 legacy=0x7fcb9014aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 --2- 172.21.15.123:0/3737804943 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb78003b90 0x7fcb78003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 --2- 172.21.15.123:0/3737804943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb78004850 0x7fcb78004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 --2- 172.21.15.123:0/3737804943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb78005200 0x7fcb7800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90070a40 con 0x7fcb78004850 2023-03-08T15:50:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7800c110 con 0x7fcb78005200 2023-03-08T15:50:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7800c2d0 con 0x7fcb78003b90 2023-03-08T15:50:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8f7fe700 1 --2- 172.21.15.123:0/3737804943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb78004850 0x7fcb78004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb8ffff700 1 --2- 172.21.15.123:0/3737804943 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb78003b90 0x7fcb78003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.177+0000 7fcb94dc9700 1 --2- 172.21.15.123:0/3737804943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb78005200 0x7fcb7800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.178+0000 7fcb8f7fe700 1 -- 172.21.15.123:0/3737804943 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb78003b90 msgr2=0x7fcb78003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.178+0000 7fcb8f7fe700 1 --2- 172.21.15.123:0/3737804943 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb78003b90 0x7fcb78003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.178+0000 7fcb8f7fe700 1 -- 172.21.15.123:0/3737804943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb78005200 msgr2=0x7fcb7800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.178+0000 7fcb8f7fe700 1 --2- 172.21.15.123:0/3737804943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb78005200 0x7fcb7800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.178+0000 7fcb94dc9700 1 -- 172.21.15.123:0/3737804943 reap_dead start 2023-03-08T15:50:08.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.178+0000 7fcb8f7fe700 1 -- 172.21.15.123:0/3737804943 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb780035b0 con 0x7fcb78004850 2023-03-08T15:50:08.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.178+0000 7fcb8f7fe700 1 --2- 172.21.15.123:0/3737804943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb78004850 0x7fcb78004cc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcb84001eb0 tx=0x7fcb78005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98000248712e29ea server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:08.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.178+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8400ccb0 con 0x7fcb78004850 2023-03-08T15:50:08.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.178+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8400ce30 con 0x7fcb78004850 2023-03-08T15:50:08.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.178+0000 7fcb8effd700 1 -- 172.21.15.123:0/3737804943 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84005ba0 con 0x7fcb78004850 2023-03-08T15:50:08.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.178+0000 7fcb9682c700 1 -- 172.21.15.123:0/3737804943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb78004850 msgr2=0x7fcb78004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.178+0000 7fcb9682c700 1 --2- 172.21.15.123:0/3737804943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb78004850 0x7fcb78004cc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcb84001eb0 tx=0x7fcb78005880 comp rx=0 tx=0).stop 2023-03-08T15:50:08.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.178+0000 7fcb9682c700 1 -- 172.21.15.123:0/3737804943 shutdown_connections 2023-03-08T15:50:08.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.178+0000 7fcb9682c700 1 --2- 172.21.15.123:0/3737804943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb78004850 0x7fcb78004cc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.178+0000 7fcb9682c700 1 -- 172.21.15.123:0/3737804943 >> 172.21.15.123:0/3737804943 conn(0x7fcb9006b360 msgr2=0x7fcb9006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:08.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.179+0000 7fcb9682c700 1 -- 172.21.15.123:0/3737804943 shutdown_connections 2023-03-08T15:50:08.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.179+0000 7fcb9682c700 1 -- 172.21.15.123:0/3737804943 wait complete. 2023-03-08T15:50:08.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.180+0000 7fcb9682c700 1 Processor -- start 2023-03-08T15:50:08.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.180+0000 7fcb9682c700 1 -- start start 2023-03-08T15:50:08.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.180+0000 7fcb9682c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb78004850 0x7fcb900b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.180+0000 7fcb9682c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb900b48e0 0x7fcb90147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.180+0000 7fcb9682c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb9006a4c0 0x7fcb90146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.180+0000 7fcb9682c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900b79f0 con 0x7fcb78004850 2023-03-08T15:50:08.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.180+0000 7fcb9682c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90147b20 con 0x7fcb9006a4c0 2023-03-08T15:50:08.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.180+0000 7fcb9682c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900b4d50 con 0x7fcb900b48e0 2023-03-08T15:50:08.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.180+0000 7fcb8ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb78004850 0x7fcb900b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.180+0000 7fcb8ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb78004850 0x7fcb900b53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57444/0 (socket says 172.21.15.123:57444) 2023-03-08T15:50:08.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.180+0000 7fcb8ffff700 1 -- 172.21.15.123:0/408964516 learned_addr learned my addr 172.21.15.123:0/408964516 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:08.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.181+0000 7fcb8f7fe700 1 --2- 172.21.15.123:0/408964516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb900b48e0 0x7fcb90147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.181+0000 7fcb8ffff700 1 -- 172.21.15.123:0/408964516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb900b48e0 msgr2=0x7fcb90147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.181+0000 7fcb8ffff700 1 --2- 172.21.15.123:0/408964516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb900b48e0 0x7fcb90147fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.181+0000 7fcb8ffff700 1 -- 172.21.15.123:0/408964516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb9006a4c0 msgr2=0x7fcb90146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.181+0000 7fcb8ffff700 1 --2- 172.21.15.123:0/408964516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb9006a4c0 0x7fcb90146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.181+0000 7fcb8ffff700 1 -- 172.21.15.123:0/408964516 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb90071f80 con 0x7fcb78004850 2023-03-08T15:50:08.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.181+0000 7fcb8ffff700 1 --2- 172.21.15.123:0/408964516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb78004850 0x7fcb900b53f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000f770 tx=0x7fcb8000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:08.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.181+0000 7fcb8cff9700 1 -- 172.21.15.123:0/408964516 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb80005320 con 0x7fcb78004850 2023-03-08T15:50:08.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.181+0000 7fcb8cff9700 1 -- 172.21.15.123:0/408964516 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb800054a0 con 0x7fcb78004850 2023-03-08T15:50:08.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.181+0000 7fcb9682c700 1 -- 172.21.15.123:0/408964516 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb90071df0 con 0x7fcb78004850 2023-03-08T15:50:08.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.181+0000 7fcb8cff9700 1 -- 172.21.15.123:0/408964516 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb80006aa0 con 0x7fcb78004850 2023-03-08T15:50:08.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.181+0000 7fcb9682c700 1 -- 172.21.15.123:0/408964516 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb90072110 con 0x7fcb78004850 2023-03-08T15:50:08.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.182+0000 7fcb9682c700 1 -- 172.21.15.123:0/408964516 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9006a930 con 0x7fcb78004850 2023-03-08T15:50:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.182+0000 7fcb8cff9700 1 -- 172.21.15.123:0/408964516 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fcb8001c030 con 0x7fcb78004850 2023-03-08T15:50:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.183+0000 7fcb8cff9700 1 --2- 172.21.15.123:0/408964516 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fcb7c069900 0x7fcb7c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.183+0000 7fcb8cff9700 1 -- 172.21.15.123:0/408964516 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb80086cd0 con 0x7fcb78004850 2023-03-08T15:50:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.183+0000 7fcb8f7fe700 1 --2- 172.21.15.123:0/408964516 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fcb7c069900 0x7fcb7c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.183+0000 7fcb8f7fe700 1 --2- 172.21.15.123:0/408964516 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fcb7c069900 0x7fcb7c06bdb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcb900b84e0 tx=0x7fcb84007f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.187+0000 7fcb8cff9700 1 -- 172.21.15.123:0/408964516 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fcb80052aa0 con 0x7fcb78004850 2023-03-08T15:50:08.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.372+0000 7fcb9682c700 1 -- 172.21.15.123:0/408964516 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb900744c0 con 0x7fcb78004850 2023-03-08T15:50:08.374 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.373+0000 7fcb8cff9700 1 -- 172.21.15.123:0/408964516 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb800560c0 con 0x7fcb78004850 2023-03-08T15:50:08.375 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-03-08T15:50:08.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.375+0000 7fcb9682c700 1 -- 172.21.15.123:0/408964516 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fcb7c069900 msgr2=0x7fcb7c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.375+0000 7fcb9682c700 1 --2- 172.21.15.123:0/408964516 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fcb7c069900 0x7fcb7c06bdb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcb900b84e0 tx=0x7fcb84007f90 comp rx=0 tx=0).stop 2023-03-08T15:50:08.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.375+0000 7fcb9682c700 1 -- 172.21.15.123:0/408964516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb78004850 msgr2=0x7fcb900b53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.375+0000 7fcb9682c700 1 --2- 172.21.15.123:0/408964516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb78004850 0x7fcb900b53f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000f770 tx=0x7fcb8000fb30 comp rx=0 tx=0).stop 2023-03-08T15:50:08.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.375+0000 7fcb9682c700 1 -- 172.21.15.123:0/408964516 shutdown_connections 2023-03-08T15:50:08.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.375+0000 7fcb9682c700 1 --2- 172.21.15.123:0/408964516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb9006a4c0 0x7fcb90146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.375+0000 7fcb9682c700 1 --2- 172.21.15.123:0/408964516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb78004850 0x7fcb900b53f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.375+0000 7fcb9682c700 1 --2- 172.21.15.123:0/408964516 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fcb7c069900 0x7fcb7c06bdb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.377 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.375+0000 7fcb9682c700 1 --2- 172.21.15.123:0/408964516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb900b48e0 0x7fcb90147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.375+0000 7fcb9682c700 1 -- 172.21.15.123:0/408964516 >> 172.21.15.123:0/408964516 conn(0x7fcb9006b360 msgr2=0x7fcb9013e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:08.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.375+0000 7fcb9682c700 1 -- 172.21.15.123:0/408964516 shutdown_connections 2023-03-08T15:50:08.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.375+0000 7fcb9682c700 1 -- 172.21.15.123:0/408964516 wait complete. 2023-03-08T15:50:08.388 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-08T15:50:08.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.510+0000 7f822f879700 1 Processor -- start 2023-03-08T15:50:08.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.510+0000 7f822f879700 1 -- start start 2023-03-08T15:50:08.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.511+0000 7f822f879700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8228147e50 0x7f822806a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.511+0000 7f822f879700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f822806fef0 0x7f822814ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.511+0000 7f822f879700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822814b6a0 con 0x7f822814b250 2023-03-08T15:50:08.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.511+0000 7f822f879700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f822814a810 con 0x7f822806fef0 2023-03-08T15:50:08.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.511+0000 7f822f879700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8228071a40 con 0x7f8228147e50 2023-03-08T15:50:08.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.511+0000 7f822ce14700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f822806fef0 0x7f822814ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.511+0000 7f822de16700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f822814b250 0x7f822814dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36030/0 (socket says 172.21.15.123:36030) 2023-03-08T15:50:08.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.511+0000 7f822ce14700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f822806fef0 0x7f822814ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57448/0 (socket says 172.21.15.123:57448) 2023-03-08T15:50:08.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.511+0000 7f822de16700 1 -- 172.21.15.123:0/3323517009 learned_addr learned my addr 172.21.15.123:0/3323517009 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:08.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.511+0000 7f822d615700 1 --2- 172.21.15.123:0/3323517009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8228147e50 0x7f822806a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.511+0000 7f822ce14700 1 -- 172.21.15.123:0/3323517009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8228147e50 msgr2=0x7f822806a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:08.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.511+0000 7f822ce14700 1 --2- 172.21.15.123:0/3323517009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8228147e50 0x7f822806a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.511+0000 7f822ce14700 1 -- 172.21.15.123:0/3323517009 >> v1:172.21.15.123:6789/0 conn(0x7f822814b250 legacy=0x7f822814dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.515 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.511+0000 7f822ce14700 1 -- 172.21.15.123:0/3323517009 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8228071d20 con 0x7f822806fef0 2023-03-08T15:50:08.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.511+0000 7f821ffff700 1 -- 172.21.15.123:0/3323517009 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292982871 0 0) 0x7f822814b6a0 con 0x7f822814b250 2023-03-08T15:50:08.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.512+0000 7f822ce14700 1 --2- 172.21.15.123:0/3323517009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f822806fef0 0x7f822814ad10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8224009840 tx=0x7f8224009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8f6a467ad9890c server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:08.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.512+0000 7f821ffff700 1 -- 172.21.15.123:0/3323517009 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224011830 con 0x7f822806fef0 2023-03-08T15:50:08.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.512+0000 7f821ffff700 1 -- 172.21.15.123:0/3323517009 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8224011990 con 0x7f822806fef0 2023-03-08T15:50:08.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.512+0000 7f821ffff700 1 -- 172.21.15.123:0/3323517009 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224011d20 con 0x7f822806fef0 2023-03-08T15:50:08.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.512+0000 7f822f879700 1 -- 172.21.15.123:0/3323517009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f822806fef0 msgr2=0x7f822814ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.512+0000 7f822f879700 1 --2- 172.21.15.123:0/3323517009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f822806fef0 0x7f822814ad10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8224009840 tx=0x7f8224009b50 comp rx=0 tx=0).stop 2023-03-08T15:50:08.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.512+0000 7f822f879700 1 -- 172.21.15.123:0/3323517009 shutdown_connections 2023-03-08T15:50:08.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.512+0000 7f822f879700 1 --2- 172.21.15.123:0/3323517009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8228147e50 0x7f822806a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.512+0000 7f822f879700 1 --2- 172.21.15.123:0/3323517009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f822806fef0 0x7f822814ad10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.512+0000 7f822f879700 1 -- 172.21.15.123:0/3323517009 >> 172.21.15.123:0/3323517009 conn(0x7f822806b360 msgr2=0x7f822806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:08.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.512+0000 7f822f879700 1 -- 172.21.15.123:0/3323517009 shutdown_connections 2023-03-08T15:50:08.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.512+0000 7f822f879700 1 -- 172.21.15.123:0/3323517009 wait complete. 2023-03-08T15:50:08.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.514+0000 7f822f879700 1 Processor -- start 2023-03-08T15:50:08.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.514+0000 7f822f879700 1 -- start start 2023-03-08T15:50:08.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.514+0000 7f822f879700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f822806fef0 0x7f82280bdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.514+0000 7f822f879700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8228147e50 0x7f82281e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822f879700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f822814b250 0x7f82281423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822f879700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8228142920 con 0x7f822814b250 2023-03-08T15:50:08.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822f879700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280bb880 con 0x7f8228147e50 2023-03-08T15:50:08.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822f879700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82281e3b30 con 0x7f822806fef0 2023-03-08T15:50:08.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822de16700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f822814b250 0x7f82281423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822de16700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f822814b250 0x7f82281423e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57456/0 (socket says 172.21.15.123:57456) 2023-03-08T15:50:08.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822de16700 1 -- 172.21.15.123:0/2350334108 learned_addr learned my addr 172.21.15.123:0/2350334108 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:08.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822d615700 1 --2- 172.21.15.123:0/2350334108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f822806fef0 0x7f82280bdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822ce14700 1 --2- 172.21.15.123:0/2350334108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8228147e50 0x7f82281e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822de16700 1 -- 172.21.15.123:0/2350334108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f822806fef0 msgr2=0x7f82280bdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822de16700 1 --2- 172.21.15.123:0/2350334108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f822806fef0 0x7f82280bdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822de16700 1 -- 172.21.15.123:0/2350334108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8228147e50 msgr2=0x7f82281e34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822de16700 1 --2- 172.21.15.123:0/2350334108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8228147e50 0x7f82281e34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822de16700 1 -- 172.21.15.123:0/2350334108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82240094a0 con 0x7f822814b250 2023-03-08T15:50:08.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822ce14700 1 --2- 172.21.15.123:0/2350334108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8228147e50 0x7f82281e34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:08.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822de16700 1 --2- 172.21.15.123:0/2350334108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f822814b250 0x7f82281423e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f822000cc70 tx=0x7f822000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:08.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f821dffb700 1 -- 172.21.15.123:0/2350334108 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822000ada0 con 0x7f822814b250 2023-03-08T15:50:08.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f821dffb700 1 -- 172.21.15.123:0/2350334108 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822000ce70 con 0x7f822814b250 2023-03-08T15:50:08.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f822f879700 1 -- 172.21.15.123:0/2350334108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8228148220 con 0x7f822814b250 2023-03-08T15:50:08.522 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.515+0000 7f821dffb700 1 -- 172.21.15.123:0/2350334108 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82200072f0 con 0x7f822814b250 2023-03-08T15:50:08.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.516+0000 7f822f879700 1 -- 172.21.15.123:0/2350334108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8228072000 con 0x7f822814b250 2023-03-08T15:50:08.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.517+0000 7f822f879700 1 -- 172.21.15.123:0/2350334108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82280728f0 con 0x7f822814b250 2023-03-08T15:50:08.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.517+0000 7f821dffb700 1 -- 172.21.15.123:0/2350334108 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f8220010070 con 0x7f822814b250 2023-03-08T15:50:08.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.517+0000 7f821dffb700 1 --2- 172.21.15.123:0/2350334108 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f820c0698d0 0x7f820c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.517+0000 7f821dffb700 1 -- 172.21.15.123:0/2350334108 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f82200870e0 con 0x7f822814b250 2023-03-08T15:50:08.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.517+0000 7f822d615700 1 --2- 172.21.15.123:0/2350334108 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f820c0698d0 0x7f820c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.523 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.518+0000 7f822d615700 1 --2- 172.21.15.123:0/2350334108 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f820c0698d0 0x7f820c06bd80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8218009b70 tx=0x7f8218008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:08.524 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.522+0000 7f821dffb700 1 -- 172.21.15.123:0/2350334108 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f8220052e20 con 0x7f822814b250 2023-03-08T15:50:08.531 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:50:08.533 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:50:08.535 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:50:08.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.711+0000 7f822f879700 1 -- 172.21.15.123:0/2350334108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f82280744c0 con 0x7f822814b250 2023-03-08T15:50:08.712 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.711+0000 7f821dffb700 1 -- 172.21.15.123:0/2350334108 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8220018020 con 0x7f822814b250 2023-03-08T15:50:08.713 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-03-08T15:50:08.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.713+0000 7f822f879700 1 -- 172.21.15.123:0/2350334108 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f820c0698d0 msgr2=0x7f820c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.713+0000 7f822f879700 1 --2- 172.21.15.123:0/2350334108 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f820c0698d0 0x7f820c06bd80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8218009b70 tx=0x7f8218008040 comp rx=0 tx=0).stop 2023-03-08T15:50:08.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.713+0000 7f822f879700 1 -- 172.21.15.123:0/2350334108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f822814b250 msgr2=0x7f82281423e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.713+0000 7f822f879700 1 --2- 172.21.15.123:0/2350334108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f822814b250 0x7f82281423e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f822000cc70 tx=0x7f822000a340 comp rx=0 tx=0).stop 2023-03-08T15:50:08.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.713+0000 7f822f879700 1 -- 172.21.15.123:0/2350334108 shutdown_connections 2023-03-08T15:50:08.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.713+0000 7f822f879700 1 --2- 172.21.15.123:0/2350334108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f822814b250 0x7f82281423e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.713+0000 7f822f879700 1 --2- 172.21.15.123:0/2350334108 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f820c0698d0 0x7f820c06bd80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.713+0000 7f822f879700 1 --2- 172.21.15.123:0/2350334108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f822806fef0 0x7f82280bdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.713+0000 7f822f879700 1 --2- 172.21.15.123:0/2350334108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8228147e50 0x7f82281e34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.713+0000 7f822f879700 1 -- 172.21.15.123:0/2350334108 >> 172.21.15.123:0/2350334108 conn(0x7f822806b360 msgr2=0x7f82281484f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:08.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.713+0000 7f822f879700 1 -- 172.21.15.123:0/2350334108 shutdown_connections 2023-03-08T15:50:08.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.713+0000 7f822f879700 1 -- 172.21.15.123:0/2350334108 wait complete. 2023-03-08T15:50:08.727 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-08T15:50:08.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.848+0000 7f387bfa9700 1 Processor -- start 2023-03-08T15:50:08.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.848+0000 7f387bfa9700 1 -- start start 2023-03-08T15:50:08.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.849+0000 7f387bfa9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f38741410a0 0x7f3874152550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.849+0000 7f387bfa9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38740b59c0 con 0x7f387406aee0 2023-03-08T15:50:08.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.849+0000 7f387bfa9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38740b8b10 con 0x7f38740b7900 2023-03-08T15:50:08.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.849+0000 7f387bfa9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38740b56e0 con 0x7f38741410a0 2023-03-08T15:50:08.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.849+0000 7f3879544700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f387406aee0 0x7f3874146fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36032/0 (socket says 172.21.15.123:36032) 2023-03-08T15:50:08.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.849+0000 7f3879544700 1 -- 172.21.15.123:0/3533553040 learned_addr learned my addr 172.21.15.123:0/3533553040 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:08.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.849+0000 7f387a546700 1 --2- 172.21.15.123:0/3533553040 >> v2:172.21.15.175:3300/0 conn(0x7f38741410a0 0x7f3874152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.849+0000 7f3878d43700 1 -- 172.21.15.123:0/3533553040 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545971629 0 0) 0x7f38740b59c0 con 0x7f387406aee0 2023-03-08T15:50:08.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.849+0000 7f3878d43700 1 -- 172.21.15.123:0/3533553040 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38600035b0 con 0x7f387406aee0 2023-03-08T15:50:08.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 -- 172.21.15.123:0/3533553040 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1204943708 0 0) 0x7f38600035b0 con 0x7f387406aee0 2023-03-08T15:50:08.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 -- 172.21.15.123:0/3533553040 >> v2:172.21.15.175:3300/0 conn(0x7f38741410a0 msgr2=0x7f3874152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:08.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 --2- 172.21.15.123:0/3533553040 >> v2:172.21.15.175:3300/0 conn(0x7f38741410a0 0x7f3874152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 -- 172.21.15.123:0/3533553040 >> v1:172.21.15.175:6789/0 conn(0x7f38740b7900 legacy=0x7f3874140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 -- 172.21.15.123:0/3533553040 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38740b7cd0 con 0x7f387406aee0 2023-03-08T15:50:08.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 -- 172.21.15.123:0/3533553040 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f3870001670 con 0x7f387406aee0 2023-03-08T15:50:08.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 -- 172.21.15.123:0/3533553040 >> v1:172.21.15.123:6789/0 conn(0x7f387406aee0 legacy=0x7f3874146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 --2- 172.21.15.123:0/3533553040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3860003a00 0x7f3860003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 --2- 172.21.15.123:0/3533553040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38600043f0 0x7f38600048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 --2- 172.21.15.123:0/3533553040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3860005150 0x7f386000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 -- 172.21.15.123:0/3533553040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38740b56e0 con 0x7f3860003a00 2023-03-08T15:50:08.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3879d45700 1 --2- 172.21.15.123:0/3533553040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3860003a00 0x7f3860003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 -- 172.21.15.123:0/3533553040 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386000c080 con 0x7f3860005150 2023-03-08T15:50:08.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 -- 172.21.15.123:0/3533553040 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386000c240 con 0x7f38600043f0 2023-03-08T15:50:08.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3879544700 1 --2- 172.21.15.123:0/3533553040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38600043f0 0x7f38600048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f387a546700 1 --2- 172.21.15.123:0/3533553040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3860005150 0x7f386000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3879d45700 1 -- 172.21.15.123:0/3533553040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38600043f0 msgr2=0x7f38600048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:08.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3879d45700 1 --2- 172.21.15.123:0/3533553040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38600043f0 0x7f38600048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3879d45700 1 -- 172.21.15.123:0/3533553040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3860005150 msgr2=0x7f386000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:08.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3879d45700 1 --2- 172.21.15.123:0/3533553040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3860005150 0x7f386000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f387a546700 1 -- 172.21.15.123:0/3533553040 reap_dead start 2023-03-08T15:50:08.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3879d45700 1 -- 172.21.15.123:0/3533553040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38600035b0 con 0x7f3860003a00 2023-03-08T15:50:08.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3879544700 1 --2- 172.21.15.123:0/3533553040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38600043f0 0x7f38600048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:08.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3879d45700 1 --2- 172.21.15.123:0/3533553040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3860003a00 0x7f3860003dd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f38640018d0 tx=0x7f3860005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a0b03412a04e6c server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:08.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 -- 172.21.15.123:0/3533553040 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640052d0 con 0x7f3860003a00 2023-03-08T15:50:08.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 -- 172.21.15.123:0/3533553040 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3864005430 con 0x7f3860003a00 2023-03-08T15:50:08.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.850+0000 7f3878d43700 1 -- 172.21.15.123:0/3533553040 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640038c0 con 0x7f3860003a00 2023-03-08T15:50:08.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.851+0000 7f387bfa9700 1 -- 172.21.15.123:0/3533553040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3860003a00 msgr2=0x7f3860003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.851+0000 7f387bfa9700 1 --2- 172.21.15.123:0/3533553040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3860003a00 0x7f3860003dd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f38640018d0 tx=0x7f3860005880 comp rx=0 tx=0).stop 2023-03-08T15:50:08.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.851+0000 7f387bfa9700 1 -- 172.21.15.123:0/3533553040 shutdown_connections 2023-03-08T15:50:08.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.851+0000 7f387bfa9700 1 --2- 172.21.15.123:0/3533553040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3860003a00 0x7f3860003dd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.851+0000 7f387bfa9700 1 -- 172.21.15.123:0/3533553040 >> 172.21.15.123:0/3533553040 conn(0x7f38740bc480 msgr2=0x7f38740bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:08.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.851+0000 7f387bfa9700 1 -- 172.21.15.123:0/3533553040 shutdown_connections 2023-03-08T15:50:08.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.851+0000 7f387bfa9700 1 -- 172.21.15.123:0/3533553040 wait complete. 2023-03-08T15:50:08.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.852+0000 7f387bfa9700 1 Processor -- start 2023-03-08T15:50:08.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.852+0000 7f387bfa9700 1 -- start start 2023-03-08T15:50:08.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.853+0000 7f387bfa9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3860003a00 0x7f38741ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.853+0000 7f387bfa9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f387406edc0 0x7f387406f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.853+0000 7f387bfa9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f387406fe60 0x7f38740702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.853+0000 7f387bfa9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38741ce910 con 0x7f3860003a00 2023-03-08T15:50:08.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.853+0000 7f387bfa9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387413d660 con 0x7f387406fe60 2023-03-08T15:50:08.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.853+0000 7f387bfa9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38740715f0 con 0x7f387406edc0 2023-03-08T15:50:08.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.853+0000 7f3879d45700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3860003a00 0x7f38741ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.853+0000 7f3879d45700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3860003a00 0x7f38741ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57464/0 (socket says 172.21.15.123:57464) 2023-03-08T15:50:08.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.853+0000 7f3879d45700 1 -- 172.21.15.123:0/33550507 learned_addr learned my addr 172.21.15.123:0/33550507 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:08.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.853+0000 7f3879544700 1 --2- 172.21.15.123:0/33550507 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f387406edc0 0x7f387406f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.853+0000 7f387a546700 1 --2- 172.21.15.123:0/33550507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f387406fe60 0x7f38740702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.854+0000 7f3879d45700 1 -- 172.21.15.123:0/33550507 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f387406edc0 msgr2=0x7f387406f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.854+0000 7f3879d45700 1 --2- 172.21.15.123:0/33550507 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f387406edc0 0x7f387406f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.854+0000 7f3879d45700 1 -- 172.21.15.123:0/33550507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f387406fe60 msgr2=0x7f38740702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:08.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.854+0000 7f3879d45700 1 --2- 172.21.15.123:0/33550507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f387406fe60 0x7f38740702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:08.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.854+0000 7f3879d45700 1 -- 172.21.15.123:0/33550507 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38740bd360 con 0x7f3860003a00 2023-03-08T15:50:08.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.854+0000 7f387a546700 1 --2- 172.21.15.123:0/33550507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f387406fe60 0x7f38740702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:08.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.854+0000 7f3879d45700 1 --2- 172.21.15.123:0/33550507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3860003a00 0x7f38741ce3d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f386000c050 tx=0x7f3864001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:08.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.854+0000 7f386a7fc700 1 -- 172.21.15.123:0/33550507 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864020070 con 0x7f3860003a00 2023-03-08T15:50:08.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.854+0000 7f386a7fc700 1 -- 172.21.15.123:0/33550507 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3864001330 con 0x7f3860003a00 2023-03-08T15:50:08.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.854+0000 7f387bfa9700 1 -- 172.21.15.123:0/33550507 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38740bd1d0 con 0x7f3860003a00 2023-03-08T15:50:08.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.854+0000 7f386a7fc700 1 -- 172.21.15.123:0/33550507 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864006aa0 con 0x7f3860003a00 2023-03-08T15:50:08.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.854+0000 7f387bfa9700 1 -- 172.21.15.123:0/33550507 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38740b8320 con 0x7f3860003a00 2023-03-08T15:50:08.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.855+0000 7f387bfa9700 1 -- 172.21.15.123:0/33550507 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38740b61f0 con 0x7f3860003a00 2023-03-08T15:50:08.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.855+0000 7f386a7fc700 1 -- 172.21.15.123:0/33550507 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f3864010070 con 0x7f3860003a00 2023-03-08T15:50:08.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.856+0000 7f386a7fc700 1 --2- 172.21.15.123:0/33550507 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f38580698d0 0x7f385806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:08.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.856+0000 7f386a7fc700 1 -- 172.21.15.123:0/33550507 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3864089610 con 0x7f3860003a00 2023-03-08T15:50:08.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.856+0000 7f3879544700 1 --2- 172.21.15.123:0/33550507 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f38580698d0 0x7f385806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:08.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.856+0000 7f3879544700 1 --2- 172.21.15.123:0/33550507 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f38580698d0 0x7f385806bd80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3870001cb0 tx=0x7f3870007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:08.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:08.860+0000 7f386a7fc700 1 -- 172.21.15.123:0/33550507 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f3864055360 con 0x7f3860003a00 2023-03-08T15:50:09.045 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.044+0000 7f387bfa9700 1 -- 172.21.15.123:0/33550507 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38740744c0 con 0x7f3860003a00 2023-03-08T15:50:09.046 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.044+0000 7f386a7fc700 1 -- 172.21.15.123:0/33550507 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3864017030 con 0x7f3860003a00 2023-03-08T15:50:09.046 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2023-03-08T15:50:09.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.046+0000 7f387bfa9700 1 -- 172.21.15.123:0/33550507 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f38580698d0 msgr2=0x7f385806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.046+0000 7f387bfa9700 1 --2- 172.21.15.123:0/33550507 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f38580698d0 0x7f385806bd80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3870001cb0 tx=0x7f3870007040 comp rx=0 tx=0).stop 2023-03-08T15:50:09.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.046+0000 7f387bfa9700 1 -- 172.21.15.123:0/33550507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3860003a00 msgr2=0x7f38741ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.046+0000 7f387bfa9700 1 --2- 172.21.15.123:0/33550507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3860003a00 0x7f38741ce3d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f386000c050 tx=0x7f3864001230 comp rx=0 tx=0).stop 2023-03-08T15:50:09.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.046+0000 7f387bfa9700 1 -- 172.21.15.123:0/33550507 shutdown_connections 2023-03-08T15:50:09.048 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.046+0000 7f387bfa9700 1 --2- 172.21.15.123:0/33550507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f387406fe60 0x7f38740702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.046+0000 7f387bfa9700 1 --2- 172.21.15.123:0/33550507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3860003a00 0x7f38741ce3d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.046+0000 7f387bfa9700 1 --2- 172.21.15.123:0/33550507 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f38580698d0 0x7f385806bd80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.046+0000 7f387bfa9700 1 --2- 172.21.15.123:0/33550507 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f387406edc0 0x7f387406f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.046+0000 7f387bfa9700 1 -- 172.21.15.123:0/33550507 >> 172.21.15.123:0/33550507 conn(0x7f38740bc480 msgr2=0x7f3874144c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:09.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.046+0000 7f387bfa9700 1 -- 172.21.15.123:0/33550507 shutdown_connections 2023-03-08T15:50:09.049 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.046+0000 7f387bfa9700 1 -- 172.21.15.123:0/33550507 wait complete. 2023-03-08T15:50:09.059 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-08T15:50:09.181 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.180+0000 7f8137e4a700 1 Processor -- start 2023-03-08T15:50:09.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.180+0000 7f8137e4a700 1 -- start start 2023-03-08T15:50:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.181+0000 7f8137e4a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f813006aee0 0x7f8130146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.181+0000 7f8137e4a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81301410a0 0x7f8130147510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.181+0000 7f8137e4a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81300b59c0 con 0x7f81300b7900 2023-03-08T15:50:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.181+0000 7f8137e4a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81300b8b10 con 0x7f81301410a0 2023-03-08T15:50:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.181+0000 7f8137e4a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81300b56e0 con 0x7f813006aee0 2023-03-08T15:50:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.181+0000 7f81363e7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81301410a0 0x7f8130147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.181+0000 7f8135be6700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f81300b7900 0x7f8130140990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36040/0 (socket says 172.21.15.123:36040) 2023-03-08T15:50:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.181+0000 7f8135be6700 1 -- 172.21.15.123:0/1053516670 learned_addr learned my addr 172.21.15.123:0/1053516670 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.181+0000 7f81353e5700 1 --2- 172.21.15.123:0/1053516670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f813006aee0 0x7f8130146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.181+0000 7f8134be4700 1 -- 172.21.15.123:0/1053516670 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848407001 0 0) 0x7f81300b59c0 con 0x7f81300b7900 2023-03-08T15:50:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.181+0000 7f8134be4700 1 -- 172.21.15.123:0/1053516670 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f811c0057c0 con 0x7f81300b7900 2023-03-08T15:50:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.181+0000 7f81363e7700 1 -- 172.21.15.123:0/1053516670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f813006aee0 msgr2=0x7f8130146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.181+0000 7f81363e7700 1 --2- 172.21.15.123:0/1053516670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f813006aee0 0x7f8130146fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.181+0000 7f81363e7700 1 -- 172.21.15.123:0/1053516670 >> v1:172.21.15.123:6789/0 conn(0x7f81300b7900 legacy=0x7f8130140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.181+0000 7f81363e7700 1 -- 172.21.15.123:0/1053516670 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81300b7cd0 con 0x7f81301410a0 2023-03-08T15:50:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.182+0000 7f81363e7700 1 --2- 172.21.15.123:0/1053516670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81301410a0 0x7f8130147510 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8128009d90 tx=0x7f812800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ef075b8fdcb1ac server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.182+0000 7f8134be4700 1 -- 172.21.15.123:0/1053516670 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812800e070 con 0x7f81301410a0 2023-03-08T15:50:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.182+0000 7f8134be4700 1 -- 172.21.15.123:0/1053516670 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812800bb20 con 0x7f81301410a0 2023-03-08T15:50:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.182+0000 7f8134be4700 1 -- 172.21.15.123:0/1053516670 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128012430 con 0x7f81301410a0 2023-03-08T15:50:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.182+0000 7f8137e4a700 1 -- 172.21.15.123:0/1053516670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81301410a0 msgr2=0x7f8130147510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.182+0000 7f8137e4a700 1 --2- 172.21.15.123:0/1053516670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81301410a0 0x7f8130147510 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8128009d90 tx=0x7f812800b330 comp rx=0 tx=0).stop 2023-03-08T15:50:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.182+0000 7f8137e4a700 1 -- 172.21.15.123:0/1053516670 shutdown_connections 2023-03-08T15:50:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.182+0000 7f8137e4a700 1 --2- 172.21.15.123:0/1053516670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81301410a0 0x7f8130147510 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.182+0000 7f8137e4a700 1 --2- 172.21.15.123:0/1053516670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f813006aee0 0x7f8130146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.182+0000 7f8137e4a700 1 -- 172.21.15.123:0/1053516670 >> 172.21.15.123:0/1053516670 conn(0x7f81300bc480 msgr2=0x7f81300bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.182+0000 7f8137e4a700 1 -- 172.21.15.123:0/1053516670 shutdown_connections 2023-03-08T15:50:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.182+0000 7f8137e4a700 1 -- 172.21.15.123:0/1053516670 wait complete. 2023-03-08T15:50:09.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.183+0000 7f8137e4a700 1 Processor -- start 2023-03-08T15:50:09.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.183+0000 7f8137e4a700 1 -- start start 2023-03-08T15:50:09.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f8137e4a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f813006aee0 0x7f8130070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f8137e4a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81300b7900 0x7f813006f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f8137e4a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81301410a0 0x7f813006f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f8137e4a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8130071460 con 0x7f813006aee0 2023-03-08T15:50:09.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f8137e4a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81300bbf60 con 0x7f81301410a0 2023-03-08T15:50:09.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f8137e4a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8130136370 con 0x7f81300b7900 2023-03-08T15:50:09.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f8135be6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f813006aee0 0x7f8130070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f8135be6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f813006aee0 0x7f8130070f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57486/0 (socket says 172.21.15.123:57486) 2023-03-08T15:50:09.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f8135be6700 1 -- 172.21.15.123:0/3353360047 learned_addr learned my addr 172.21.15.123:0/3353360047 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:09.191 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f81353e5700 1 --2- 172.21.15.123:0/3353360047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81300b7900 0x7f813006f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f81363e7700 1 --2- 172.21.15.123:0/3353360047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81301410a0 0x7f813006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f8135be6700 1 -- 172.21.15.123:0/3353360047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81300b7900 msgr2=0x7f813006f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f8135be6700 1 --2- 172.21.15.123:0/3353360047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81300b7900 0x7f813006f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f8135be6700 1 -- 172.21.15.123:0/3353360047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81301410a0 msgr2=0x7f813006f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f8135be6700 1 --2- 172.21.15.123:0/3353360047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81301410a0 0x7f813006f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.184+0000 7f8135be6700 1 -- 172.21.15.123:0/3353360047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8128009a70 con 0x7f813006aee0 2023-03-08T15:50:09.192 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.185+0000 7f8135be6700 1 --2- 172.21.15.123:0/3353360047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f813006aee0 0x7f8130070f20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f812000c700 tx=0x7f812000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:09.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.185+0000 7f81267fc700 1 -- 172.21.15.123:0/3353360047 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120005d70 con 0x7f813006aee0 2023-03-08T15:50:09.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.185+0000 7f81267fc700 1 -- 172.21.15.123:0/3353360047 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81200070d0 con 0x7f813006aee0 2023-03-08T15:50:09.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.185+0000 7f8137e4a700 1 -- 172.21.15.123:0/3353360047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81300bd360 con 0x7f813006aee0 2023-03-08T15:50:09.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.185+0000 7f81267fc700 1 -- 172.21.15.123:0/3353360047 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120007460 con 0x7f813006aee0 2023-03-08T15:50:09.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.185+0000 7f8137e4a700 1 -- 172.21.15.123:0/3353360047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81300bd1d0 con 0x7f813006aee0 2023-03-08T15:50:09.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.186+0000 7f8137e4a700 1 -- 172.21.15.123:0/3353360047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81300b8320 con 0x7f813006aee0 2023-03-08T15:50:09.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.186+0000 7f81267fc700 1 -- 172.21.15.123:0/3353360047 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f8120019030 con 0x7f813006aee0 2023-03-08T15:50:09.193 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.186+0000 7f81267fc700 1 --2- 172.21.15.123:0/3353360047 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f81140698d0 0x7f811406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.187+0000 7f81267fc700 1 -- 172.21.15.123:0/3353360047 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8120086a00 con 0x7f813006aee0 2023-03-08T15:50:09.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.187+0000 7f81353e5700 1 --2- 172.21.15.123:0/3353360047 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f81140698d0 0x7f811406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.187+0000 7f81353e5700 1 --2- 172.21.15.123:0/3353360047 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f81140698d0 0x7f811406bd80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8130070000 tx=0x7f812c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:09.194 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.191+0000 7f81267fc700 1 -- 172.21.15.123:0/3353360047 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f81200527d0 con 0x7f813006aee0 2023-03-08T15:50:09.375 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.374+0000 7f8137e4a700 1 -- 172.21.15.123:0/3353360047 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81300b61f0 con 0x7f813006aee0 2023-03-08T15:50:09.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.374+0000 7f81267fc700 1 -- 172.21.15.123:0/3353360047 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8120055df0 con 0x7f813006aee0 2023-03-08T15:50:09.376 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2023-03-08T15:50:09.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.376+0000 7f8137e4a700 1 -- 172.21.15.123:0/3353360047 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f81140698d0 msgr2=0x7f811406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.376+0000 7f8137e4a700 1 --2- 172.21.15.123:0/3353360047 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f81140698d0 0x7f811406bd80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8130070000 tx=0x7f812c008040 comp rx=0 tx=0).stop 2023-03-08T15:50:09.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.376+0000 7f8137e4a700 1 -- 172.21.15.123:0/3353360047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f813006aee0 msgr2=0x7f8130070f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.376+0000 7f8137e4a700 1 --2- 172.21.15.123:0/3353360047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f813006aee0 0x7f8130070f20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f812000c700 tx=0x7f812000ca10 comp rx=0 tx=0).stop 2023-03-08T15:50:09.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.376+0000 7f8137e4a700 1 -- 172.21.15.123:0/3353360047 shutdown_connections 2023-03-08T15:50:09.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.376+0000 7f8137e4a700 1 --2- 172.21.15.123:0/3353360047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81301410a0 0x7f813006f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.376+0000 7f8137e4a700 1 --2- 172.21.15.123:0/3353360047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f813006aee0 0x7f8130070f20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.376+0000 7f8137e4a700 1 --2- 172.21.15.123:0/3353360047 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f81140698d0 0x7f811406bd80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.376+0000 7f8137e4a700 1 --2- 172.21.15.123:0/3353360047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81300b7900 0x7f813006f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.376+0000 7f8137e4a700 1 -- 172.21.15.123:0/3353360047 >> 172.21.15.123:0/3353360047 conn(0x7f81300bc480 msgr2=0x7f8130144b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:09.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.376+0000 7f8137e4a700 1 -- 172.21.15.123:0/3353360047 shutdown_connections 2023-03-08T15:50:09.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.376+0000 7f8137e4a700 1 -- 172.21.15.123:0/3353360047 wait complete. 2023-03-08T15:50:09.389 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-08T15:50:09.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.506+0000 7f708d032700 1 Processor -- start 2023-03-08T15:50:09.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.506+0000 7f708d032700 1 -- start start 2023-03-08T15:50:09.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.507+0000 7f708d032700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f70880b9000 0x7f708806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.510 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.507+0000 7f708d032700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7088070060 0x7f7088147710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f708d032700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7088147c50 0x7f708814a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f708d032700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70880704e0 con 0x7f7088070060 2023-03-08T15:50:09.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f708d032700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7088071a90 con 0x7f70880b9000 2023-03-08T15:50:09.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f708d032700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7088071fd0 con 0x7f7088147c50 2023-03-08T15:50:09.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f708659c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7088070060 0x7f7088147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f708659c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7088070060 0x7f7088147710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57500/0 (socket says 172.21.15.123:57500) 2023-03-08T15:50:09.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f708659c700 1 -- 172.21.15.123:0/371918584 learned_addr learned my addr 172.21.15.123:0/371918584 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:09.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f7086d9d700 1 --2- 172.21.15.123:0/371918584 >> v2:172.21.15.175:3300/0 conn(0x7f70880b9000 0x7f708806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f708759e700 1 --2- 172.21.15.123:0/371918584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7088147c50 0x7f708814a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f708659c700 1 -- 172.21.15.123:0/371918584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7088147c50 msgr2=0x7f708814a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:09.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f708659c700 1 --2- 172.21.15.123:0/371918584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7088147c50 0x7f708814a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f708659c700 1 -- 172.21.15.123:0/371918584 >> v2:172.21.15.175:3300/0 conn(0x7f70880b9000 msgr2=0x7f708806fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:09.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f708659c700 1 --2- 172.21.15.123:0/371918584 >> v2:172.21.15.175:3300/0 conn(0x7f70880b9000 0x7f708806fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f708659c700 1 -- 172.21.15.123:0/371918584 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70880b93d0 con 0x7f7088070060 2023-03-08T15:50:09.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f708659c700 1 --2- 172.21.15.123:0/371918584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088070060 0x7f7088147710 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7088066190 tx=0x7f707c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d741e49ef130c71 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:09.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f7085d9b700 1 -- 172.21.15.123:0/371918584 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c011830 con 0x7f7088070060 2023-03-08T15:50:09.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f7085d9b700 1 -- 172.21.15.123:0/371918584 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c011990 con 0x7f7088070060 2023-03-08T15:50:09.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.508+0000 7f7085d9b700 1 -- 172.21.15.123:0/371918584 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c011d20 con 0x7f7088070060 2023-03-08T15:50:09.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.509+0000 7f708d032700 1 -- 172.21.15.123:0/371918584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088070060 msgr2=0x7f7088147710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.509+0000 7f708d032700 1 --2- 172.21.15.123:0/371918584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088070060 0x7f7088147710 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7088066190 tx=0x7f707c009bd0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.509+0000 7f708d032700 1 -- 172.21.15.123:0/371918584 shutdown_connections 2023-03-08T15:50:09.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.509+0000 7f708d032700 1 --2- 172.21.15.123:0/371918584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7088147c50 0x7f708814a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.509+0000 7f708d032700 1 --2- 172.21.15.123:0/371918584 >> v2:172.21.15.175:3300/0 conn(0x7f70880b9000 0x7f708806fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.509+0000 7f708d032700 1 --2- 172.21.15.123:0/371918584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088070060 0x7f7088147710 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.509+0000 7f708d032700 1 -- 172.21.15.123:0/371918584 >> 172.21.15.123:0/371918584 conn(0x7f70880b9800 msgr2=0x7f70880b9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:09.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.509+0000 7f708d032700 1 -- 172.21.15.123:0/371918584 shutdown_connections 2023-03-08T15:50:09.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.509+0000 7f708d032700 1 -- 172.21.15.123:0/371918584 wait complete. 2023-03-08T15:50:09.516 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.510+0000 7f708d032700 1 Processor -- start 2023-03-08T15:50:09.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.510+0000 7f708d032700 1 -- start start 2023-03-08T15:50:09.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f708d032700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088070060 0x7f70881d40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f708d032700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70880b9000 0x7f70881d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f708d032700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7088147c50 0x7f70881d4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f708d032700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70880b6100 con 0x7f7088070060 2023-03-08T15:50:09.517 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f708d032700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70881d4610 con 0x7f70880b9000 2023-03-08T15:50:09.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f708d032700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70880b4f80 con 0x7f7088147c50 2023-03-08T15:50:09.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f7086d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088070060 0x7f70881d40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f7086d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088070060 0x7f70881d40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57508/0 (socket says 172.21.15.123:57508) 2023-03-08T15:50:09.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f7086d9d700 1 -- 172.21.15.123:0/1459185495 learned_addr learned my addr 172.21.15.123:0/1459185495 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:09.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f708759e700 1 --2- 172.21.15.123:0/1459185495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7088147c50 0x7f70881d4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f708659c700 1 --2- 172.21.15.123:0/1459185495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70880b9000 0x7f70881d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f7086d9d700 1 -- 172.21.15.123:0/1459185495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7088147c50 msgr2=0x7f70881d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f7086d9d700 1 --2- 172.21.15.123:0/1459185495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7088147c50 0x7f70881d4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f7086d9d700 1 -- 172.21.15.123:0/1459185495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70880b9000 msgr2=0x7f70881d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f7086d9d700 1 --2- 172.21.15.123:0/1459185495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70880b9000 0x7f70881d49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f7086d9d700 1 -- 172.21.15.123:0/1459185495 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c009550 con 0x7f7088070060 2023-03-08T15:50:09.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.511+0000 7f7086d9d700 1 --2- 172.21.15.123:0/1459185495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088070060 0x7f70881d40d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f707800e9b0 tx=0x7f707800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:09.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.512+0000 7f706f7fe700 1 -- 172.21.15.123:0/1459185495 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078009710 con 0x7f7088070060 2023-03-08T15:50:09.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.512+0000 7f706f7fe700 1 -- 172.21.15.123:0/1459185495 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707800c850 con 0x7f7088070060 2023-03-08T15:50:09.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.512+0000 7f708d032700 1 -- 172.21.15.123:0/1459185495 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70881480b0 con 0x7f7088070060 2023-03-08T15:50:09.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.512+0000 7f706f7fe700 1 -- 172.21.15.123:0/1459185495 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707800cbc0 con 0x7f7088070060 2023-03-08T15:50:09.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.512+0000 7f708d032700 1 -- 172.21.15.123:0/1459185495 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7088071ca0 con 0x7f7088070060 2023-03-08T15:50:09.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.513+0000 7f708d032700 1 -- 172.21.15.123:0/1459185495 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708806f0e0 con 0x7f7088070060 2023-03-08T15:50:09.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.513+0000 7f706f7fe700 1 -- 172.21.15.123:0/1459185495 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f7078023070 con 0x7f7088070060 2023-03-08T15:50:09.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.513+0000 7f706f7fe700 1 --2- 172.21.15.123:0/1459185495 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7074069900 0x7f707406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.514+0000 7f706f7fe700 1 -- 172.21.15.123:0/1459185495 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7078087960 con 0x7f7088070060 2023-03-08T15:50:09.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.514+0000 7f708659c700 1 --2- 172.21.15.123:0/1459185495 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7074069900 0x7f707406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.514+0000 7f708659c700 1 --2- 172.21.15.123:0/1459185495 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7074069900 0x7f707406bdb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f707c014040 tx=0x7f707c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:09.521 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.518+0000 7f706f7fe700 1 -- 172.21.15.123:0/1459185495 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f7078053730 con 0x7f7088070060 2023-03-08T15:50:09.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.743+0000 7f708d032700 1 -- 172.21.15.123:0/1459185495 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70880744c0 con 0x7f7088070060 2023-03-08T15:50:09.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.744+0000 7f706f7fe700 1 -- 172.21.15.123:0/1459185495 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3915 (secure 0 0 0) 0x7f7078056d50 con 0x7f7088070060 2023-03-08T15:50:09.746 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:09.746 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/108043707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":108043707},{"type":"v1","addr":"172.21.15.123:6835","nonce":108043707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1787308526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1787308526},{"type":"v1","addr":"172.21.15.123:6837","nonce":1787308526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-08T15:49:39.489034+0000","modified":"2023-03-08T15:49:42.501407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6833/1018957090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1018957090},{"type":"v1","addr":"172.21.15.175:6833","nonce":1018957090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-08T15:50:09.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.746+0000 7f708d032700 1 -- 172.21.15.123:0/1459185495 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7074069900 msgr2=0x7f707406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.746+0000 7f708d032700 1 --2- 172.21.15.123:0/1459185495 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7074069900 0x7f707406bdb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f707c014040 tx=0x7f707c008030 comp rx=0 tx=0).stop 2023-03-08T15:50:09.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.746+0000 7f708d032700 1 -- 172.21.15.123:0/1459185495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088070060 msgr2=0x7f70881d40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.746+0000 7f708d032700 1 --2- 172.21.15.123:0/1459185495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088070060 0x7f70881d40d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f707800e9b0 tx=0x7f707800ed70 comp rx=0 tx=0).stop 2023-03-08T15:50:09.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.746+0000 7f708d032700 1 -- 172.21.15.123:0/1459185495 shutdown_connections 2023-03-08T15:50:09.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.746+0000 7f708d032700 1 --2- 172.21.15.123:0/1459185495 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7074069900 0x7f707406bdb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.746+0000 7f708d032700 1 --2- 172.21.15.123:0/1459185495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7088147c50 0x7f70881d4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.746+0000 7f708d032700 1 --2- 172.21.15.123:0/1459185495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7088070060 0x7f70881d40d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.746+0000 7f708d032700 1 --2- 172.21.15.123:0/1459185495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70880b9000 0x7f70881d49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.746+0000 7f708d032700 1 -- 172.21.15.123:0/1459185495 >> 172.21.15.123:0/1459185495 conn(0x7f70880b9800 msgr2=0x7f70881457a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:09.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.746+0000 7f708d032700 1 -- 172.21.15.123:0/1459185495 shutdown_connections 2023-03-08T15:50:09.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.746+0000 7f708d032700 1 -- 172.21.15.123:0/1459185495 wait complete. 2023-03-08T15:50:09.750 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2023-03-08T15:50:09.759 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:50:09.879 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.878+0000 7f80ed627700 1 Processor -- start 2023-03-08T15:50:09.880 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.878+0000 7f80ed627700 1 -- start start 2023-03-08T15:50:09.881 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.878+0000 7f80ed627700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80e81446c0 0x7f80e80b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.878+0000 7f80ed627700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e80b7fa0 con 0x7f80e8144a90 2023-03-08T15:50:09.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.878+0000 7f80ed627700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e80b7130 con 0x7f80e80ba560 2023-03-08T15:50:09.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.878+0000 7f80ed627700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e80bdc90 con 0x7f80e81446c0 2023-03-08T15:50:09.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.879+0000 7f80e6ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80e81446c0 0x7f80e80b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.879+0000 7f80e67fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f80e8144a90 0x7f80e80bd580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36048/0 (socket says 172.21.15.123:36048) 2023-03-08T15:50:09.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.879+0000 7f80e67fc700 1 -- 172.21.15.123:0/2449664984 learned_addr learned my addr 172.21.15.123:0/2449664984 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:09.882 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.879+0000 7f80e6ffd700 1 -- 172.21.15.123:0/2449664984 >> v1:172.21.15.175:6789/0 conn(0x7f80e80ba560 legacy=0x7f80e8154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:09.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.879+0000 7f80e6ffd700 1 -- 172.21.15.123:0/2449664984 >> v1:172.21.15.123:6789/0 conn(0x7f80e8144a90 legacy=0x7f80e80bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.879+0000 7f80e6ffd700 1 -- 172.21.15.123:0/2449664984 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80bc030 con 0x7f80e81446c0 2023-03-08T15:50:09.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.879+0000 7f80e6ffd700 1 --2- 172.21.15.123:0/2449664984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e81446c0 0x7f80e80b6bf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009840 tx=0x7f80d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e809e350245c97 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:09.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.879+0000 7f80e5ffb700 1 -- 172.21.15.123:0/2449664984 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8004230 con 0x7f80e81446c0 2023-03-08T15:50:09.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.879+0000 7f80e5ffb700 1 -- 172.21.15.123:0/2449664984 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d8004390 con 0x7f80e81446c0 2023-03-08T15:50:09.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.879+0000 7f80e5ffb700 1 -- 172.21.15.123:0/2449664984 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d80036a0 con 0x7f80e81446c0 2023-03-08T15:50:09.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.880+0000 7f80ed627700 1 -- 172.21.15.123:0/2449664984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e81446c0 msgr2=0x7f80e80b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.883 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.880+0000 7f80ed627700 1 --2- 172.21.15.123:0/2449664984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e81446c0 0x7f80e80b6bf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009840 tx=0x7f80d8009b50 comp rx=0 tx=0).stop 2023-03-08T15:50:09.884 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.880+0000 7f80ed627700 1 -- 172.21.15.123:0/2449664984 shutdown_connections 2023-03-08T15:50:09.884 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.880+0000 7f80ed627700 1 --2- 172.21.15.123:0/2449664984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e81446c0 0x7f80e80b6bf0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.884 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.880+0000 7f80ed627700 1 -- 172.21.15.123:0/2449664984 >> 172.21.15.123:0/2449664984 conn(0x7f80e8071980 msgr2=0x7f80e8071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:09.884 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.880+0000 7f80ed627700 1 -- 172.21.15.123:0/2449664984 shutdown_connections 2023-03-08T15:50:09.884 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.880+0000 7f80ed627700 1 -- 172.21.15.123:0/2449664984 wait complete. 2023-03-08T15:50:09.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.881+0000 7f80ed627700 1 Processor -- start 2023-03-08T15:50:09.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.881+0000 7f80ed627700 1 -- start start 2023-03-08T15:50:09.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.881+0000 7f80ed627700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e80ba560 0x7f80e81d7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.886 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.881+0000 7f80ed627700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80e81446c0 0x7f80e8146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.881+0000 7f80ed627700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80e8144a90 0x7f80e81e3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.881+0000 7f80ed627700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e81d7ad0 con 0x7f80e80ba560 2023-03-08T15:50:09.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80ed627700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e8145220 con 0x7f80e8144a90 2023-03-08T15:50:09.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80ed627700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e8145da0 con 0x7f80e81446c0 2023-03-08T15:50:09.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80e6ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e80ba560 0x7f80e81d7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.887 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80e6ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e80ba560 0x7f80e81d7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57522/0 (socket says 172.21.15.123:57522) 2023-03-08T15:50:09.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80e6ffd700 1 -- 172.21.15.123:0/511949260 learned_addr learned my addr 172.21.15.123:0/511949260 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:09.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80e6ffd700 1 -- 172.21.15.123:0/511949260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80e81446c0 msgr2=0x7f80e8146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80e6ffd700 1 --2- 172.21.15.123:0/511949260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80e81446c0 0x7f80e8146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80e6ffd700 1 -- 172.21.15.123:0/511949260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80e8144a90 msgr2=0x7f80e81e3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:09.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80e6ffd700 1 --2- 172.21.15.123:0/511949260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80e8144a90 0x7f80e81e3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:09.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80e6ffd700 1 -- 172.21.15.123:0/511949260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d80094a0 con 0x7f80e80ba560 2023-03-08T15:50:09.888 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80e6ffd700 1 --2- 172.21.15.123:0/511949260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e80ba560 0x7f80e81d7590 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f80d80090b0 tx=0x7f80d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:09.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80cf7fe700 1 -- 172.21.15.123:0/511949260 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8011830 con 0x7f80e80ba560 2023-03-08T15:50:09.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80cf7fe700 1 -- 172.21.15.123:0/511949260 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d801e070 con 0x7f80e80ba560 2023-03-08T15:50:09.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80ed627700 1 -- 172.21.15.123:0/511949260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e80bc5f0 con 0x7f80e80ba560 2023-03-08T15:50:09.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80cf7fe700 1 -- 172.21.15.123:0/511949260 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8011bf0 con 0x7f80e80ba560 2023-03-08T15:50:09.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.882+0000 7f80ed627700 1 -- 172.21.15.123:0/511949260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e80bc310 con 0x7f80e80ba560 2023-03-08T15:50:09.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.883+0000 7f80ed627700 1 -- 172.21.15.123:0/511949260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e814db90 con 0x7f80e80ba560 2023-03-08T15:50:09.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.884+0000 7f80cf7fe700 1 -- 172.21.15.123:0/511949260 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f80d8017020 con 0x7f80e80ba560 2023-03-08T15:50:09.889 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.884+0000 7f80cf7fe700 1 --2- 172.21.15.123:0/511949260 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f80d40698d0 0x7f80d406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:09.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.884+0000 7f80e67fc700 1 --2- 172.21.15.123:0/511949260 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f80d40698d0 0x7f80d406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:09.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.884+0000 7f80cf7fe700 1 -- 172.21.15.123:0/511949260 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80d80889e0 con 0x7f80e80ba560 2023-03-08T15:50:09.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.884+0000 7f80e67fc700 1 --2- 172.21.15.123:0/511949260 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f80d40698d0 0x7f80d406bd80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f80dc000f60 tx=0x7f80dc007b10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:09.890 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:09.888+0000 7f80cf7fe700 1 -- 172.21.15.123:0/511949260 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f80d80547b0 con 0x7f80e80ba560 2023-03-08T15:50:10.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.076+0000 7f80ed627700 1 -- 172.21.15.123:0/511949260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80e80744c0 con 0x7f80e80ba560 2023-03-08T15:50:10.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.077+0000 7f80cf7fe700 1 -- 172.21.15.123:0/511949260 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f80d8020020 con 0x7f80e80ba560 2023-03-08T15:50:10.079 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:10.079 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:40.490671+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:49:37.104720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-08T15:49:38.431537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:50:10.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.079+0000 7f80ed627700 1 -- 172.21.15.123:0/511949260 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f80d40698d0 msgr2=0x7f80d406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.079+0000 7f80ed627700 1 --2- 172.21.15.123:0/511949260 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f80d40698d0 0x7f80d406bd80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f80dc000f60 tx=0x7f80dc007b10 comp rx=0 tx=0).stop 2023-03-08T15:50:10.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.079+0000 7f80ed627700 1 -- 172.21.15.123:0/511949260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e80ba560 msgr2=0x7f80e81d7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.079+0000 7f80ed627700 1 --2- 172.21.15.123:0/511949260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e80ba560 0x7f80e81d7590 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f80d80090b0 tx=0x7f80d8004750 comp rx=0 tx=0).stop 2023-03-08T15:50:10.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.079+0000 7f80ed627700 1 -- 172.21.15.123:0/511949260 shutdown_connections 2023-03-08T15:50:10.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.079+0000 7f80ed627700 1 --2- 172.21.15.123:0/511949260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80e8144a90 0x7f80e81e3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.079+0000 7f80ed627700 1 --2- 172.21.15.123:0/511949260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e80ba560 0x7f80e81d7590 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.079+0000 7f80ed627700 1 --2- 172.21.15.123:0/511949260 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f80d40698d0 0x7f80d406bd80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.080+0000 7f80ed627700 1 --2- 172.21.15.123:0/511949260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80e81446c0 0x7f80e8146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.080+0000 7f80ed627700 1 -- 172.21.15.123:0/511949260 >> 172.21.15.123:0/511949260 conn(0x7f80e8071980 msgr2=0x7f80e80b6420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:10.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.080+0000 7f80ed627700 1 -- 172.21.15.123:0/511949260 shutdown_connections 2023-03-08T15:50:10.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.080+0000 7f80ed627700 1 -- 172.21.15.123:0/511949260 wait complete. 2023-03-08T15:50:10.093 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-03-08T15:50:10.094 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-08T15:50:10.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.211+0000 7f0d85452700 1 Processor -- start 2023-03-08T15:50:10.213 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.211+0000 7f0d85452700 1 -- start start 2023-03-08T15:50:10.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.212+0000 7f0d85452700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0d800ba280 0x7f0d8006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.212+0000 7f0d85452700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0d80071df0 0x7f0d8014aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.212+0000 7f0d85452700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d80070670 con 0x7f0d80072760 2023-03-08T15:50:10.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.212+0000 7f0d85452700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d80070a40 con 0x7f0d800ba280 2023-03-08T15:50:10.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.212+0000 7f0d85452700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d80070c50 con 0x7f0d80071df0 2023-03-08T15:50:10.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.212+0000 7f0d7effd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0d800ba280 0x7f0d8006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.212+0000 7f0d7e7fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0d80072760 0x7f0d80141480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36056/0 (socket says 172.21.15.123:36056) 2023-03-08T15:50:10.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.212+0000 7f0d7e7fc700 1 -- 172.21.15.123:0/3815292450 learned_addr learned my addr 172.21.15.123:0/3815292450 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:10.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.213+0000 7f0d7f7fe700 1 --2- 172.21.15.123:0/3815292450 >> v2:172.21.15.175:3300/0 conn(0x7f0d80071df0 0x7f0d8014aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.213+0000 7f0d7effd700 1 -- 172.21.15.123:0/3815292450 >> v2:172.21.15.175:3300/0 conn(0x7f0d80071df0 msgr2=0x7f0d8014aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:10.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.213+0000 7f0d7effd700 1 --2- 172.21.15.123:0/3815292450 >> v2:172.21.15.175:3300/0 conn(0x7f0d80071df0 0x7f0d8014aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.213+0000 7f0d7effd700 1 -- 172.21.15.123:0/3815292450 >> v1:172.21.15.123:6789/0 conn(0x7f0d80072760 legacy=0x7f0d80141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.213+0000 7f0d7effd700 1 -- 172.21.15.123:0/3815292450 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d800ba650 con 0x7f0d800ba280 2023-03-08T15:50:10.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.213+0000 7f0d7f7fe700 1 --2- 172.21.15.123:0/3815292450 >> v2:172.21.15.175:3300/0 conn(0x7f0d80071df0 0x7f0d8014aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:10.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.213+0000 7f0d7effd700 1 --2- 172.21.15.123:0/3815292450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d800ba280 0x7f0d8006fff0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0d800b99e0 tx=0x7f0d74009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9fa2024a0de65a server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:10.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.213+0000 7f0d7dffb700 1 -- 172.21.15.123:0/3815292450 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74011830 con 0x7f0d800ba280 2023-03-08T15:50:10.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.213+0000 7f0d7dffb700 1 -- 172.21.15.123:0/3815292450 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d74011990 con 0x7f0d800ba280 2023-03-08T15:50:10.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.213+0000 7f0d7dffb700 1 -- 172.21.15.123:0/3815292450 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74011d20 con 0x7f0d800ba280 2023-03-08T15:50:10.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.213+0000 7f0d85452700 1 -- 172.21.15.123:0/3815292450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d800ba280 msgr2=0x7f0d8006fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.213+0000 7f0d85452700 1 --2- 172.21.15.123:0/3815292450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d800ba280 0x7f0d8006fff0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0d800b99e0 tx=0x7f0d74009b20 comp rx=0 tx=0).stop 2023-03-08T15:50:10.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.214+0000 7f0d85452700 1 -- 172.21.15.123:0/3815292450 shutdown_connections 2023-03-08T15:50:10.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.214+0000 7f0d85452700 1 --2- 172.21.15.123:0/3815292450 >> v2:172.21.15.175:3300/0 conn(0x7f0d80071df0 0x7f0d8014aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.214+0000 7f0d85452700 1 --2- 172.21.15.123:0/3815292450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d800ba280 0x7f0d8006fff0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.214+0000 7f0d85452700 1 -- 172.21.15.123:0/3815292450 >> 172.21.15.123:0/3815292450 conn(0x7f0d8006b360 msgr2=0x7f0d8006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:10.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.214+0000 7f0d85452700 1 -- 172.21.15.123:0/3815292450 shutdown_connections 2023-03-08T15:50:10.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.214+0000 7f0d85452700 1 -- 172.21.15.123:0/3815292450 wait complete. 2023-03-08T15:50:10.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.215+0000 7f0d85452700 1 Processor -- start 2023-03-08T15:50:10.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.215+0000 7f0d85452700 1 -- start start 2023-03-08T15:50:10.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.215+0000 7f0d85452700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d80071df0 0x7f0d801420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.215+0000 7f0d85452700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d800ba280 0x7f0d801dc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.215+0000 7f0d85452700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d801d2530 0x7f0d801388c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.215+0000 7f0d85452700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800bdc60 con 0x7f0d800ba280 2023-03-08T15:50:10.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.215+0000 7f0d85452700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800be220 con 0x7f0d80071df0 2023-03-08T15:50:10.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.215+0000 7f0d85452700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d801d29d0 con 0x7f0d801d2530 2023-03-08T15:50:10.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.215+0000 7f0d7e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d800ba280 0x7f0d801dc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.215+0000 7f0d7e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d800ba280 0x7f0d801dc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57546/0 (socket says 172.21.15.123:57546) 2023-03-08T15:50:10.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.215+0000 7f0d7e7fc700 1 -- 172.21.15.123:0/3519444716 learned_addr learned my addr 172.21.15.123:0/3519444716 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:10.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.216+0000 7f0d7f7fe700 1 --2- 172.21.15.123:0/3519444716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d801d2530 0x7f0d801388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.216+0000 7f0d7effd700 1 --2- 172.21.15.123:0/3519444716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d80071df0 0x7f0d801420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.216+0000 7f0d7e7fc700 1 -- 172.21.15.123:0/3519444716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d801d2530 msgr2=0x7f0d801388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.216+0000 7f0d7e7fc700 1 --2- 172.21.15.123:0/3519444716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d801d2530 0x7f0d801388c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.216+0000 7f0d7e7fc700 1 -- 172.21.15.123:0/3519444716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d80071df0 msgr2=0x7f0d801420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.216+0000 7f0d7e7fc700 1 --2- 172.21.15.123:0/3519444716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d80071df0 0x7f0d801420f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.216+0000 7f0d7e7fc700 1 -- 172.21.15.123:0/3519444716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d740094a0 con 0x7f0d800ba280 2023-03-08T15:50:10.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.216+0000 7f0d7effd700 1 --2- 172.21.15.123:0/3519444716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d80071df0 0x7f0d801420f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:10.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.216+0000 7f0d7e7fc700 1 --2- 172.21.15.123:0/3519444716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d800ba280 0x7f0d801dc900 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c530 tx=0x7f0d7000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:10.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.216+0000 7f0d677fe700 1 -- 172.21.15.123:0/3519444716 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70005d70 con 0x7f0d800ba280 2023-03-08T15:50:10.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.216+0000 7f0d677fe700 1 -- 172.21.15.123:0/3519444716 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d700070d0 con 0x7f0d800ba280 2023-03-08T15:50:10.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.216+0000 7f0d85452700 1 -- 172.21.15.123:0/3519444716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d80141d20 con 0x7f0d800ba280 2023-03-08T15:50:10.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.216+0000 7f0d677fe700 1 -- 172.21.15.123:0/3519444716 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70007440 con 0x7f0d800ba280 2023-03-08T15:50:10.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.216+0000 7f0d85452700 1 -- 172.21.15.123:0/3519444716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d80141b90 con 0x7f0d800ba280 2023-03-08T15:50:10.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.217+0000 7f0d85452700 1 -- 172.21.15.123:0/3519444716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8014aff0 con 0x7f0d800ba280 2023-03-08T15:50:10.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.217+0000 7f0d677fe700 1 -- 172.21.15.123:0/3519444716 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f0d70019030 con 0x7f0d800ba280 2023-03-08T15:50:10.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.218+0000 7f0d677fe700 1 --2- 172.21.15.123:0/3519444716 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0d6c0698d0 0x7f0d6c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.218+0000 7f0d677fe700 1 -- 172.21.15.123:0/3519444716 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d70086950 con 0x7f0d800ba280 2023-03-08T15:50:10.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.218+0000 7f0d7effd700 1 --2- 172.21.15.123:0/3519444716 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0d6c0698d0 0x7f0d6c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.218+0000 7f0d7effd700 1 --2- 172.21.15.123:0/3519444716 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0d6c0698d0 0x7f0d6c06bd80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0d740090b0 tx=0x7f0d74008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:10.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.222+0000 7f0d677fe700 1 -- 172.21.15.123:0/3519444716 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f0d7004c150 con 0x7f0d800ba280 2023-03-08T15:50:10.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.447+0000 7f0d85452700 1 -- 172.21.15.123:0/3519444716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d800744c0 con 0x7f0d800ba280 2023-03-08T15:50:10.449 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.448+0000 7f0d677fe700 1 -- 172.21.15.123:0/3519444716 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3915 (secure 0 0 0) 0x7f0d70017090 con 0x7f0d800ba280 2023-03-08T15:50:10.450 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:10.450 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/108043707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":108043707},{"type":"v1","addr":"172.21.15.123:6835","nonce":108043707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1787308526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1787308526},{"type":"v1","addr":"172.21.15.123:6837","nonce":1787308526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-08T15:49:39.489034+0000","modified":"2023-03-08T15:49:42.501407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6833/1018957090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1018957090},{"type":"v1","addr":"172.21.15.175:6833","nonce":1018957090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-08T15:50:10.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.450+0000 7f0d85452700 1 -- 172.21.15.123:0/3519444716 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0d6c0698d0 msgr2=0x7f0d6c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.450+0000 7f0d85452700 1 --2- 172.21.15.123:0/3519444716 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0d6c0698d0 0x7f0d6c06bd80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0d740090b0 tx=0x7f0d74008030 comp rx=0 tx=0).stop 2023-03-08T15:50:10.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.450+0000 7f0d85452700 1 -- 172.21.15.123:0/3519444716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d800ba280 msgr2=0x7f0d801dc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.450+0000 7f0d85452700 1 --2- 172.21.15.123:0/3519444716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d800ba280 0x7f0d801dc900 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c530 tx=0x7f0d7000c8f0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.450+0000 7f0d85452700 1 -- 172.21.15.123:0/3519444716 shutdown_connections 2023-03-08T15:50:10.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.450+0000 7f0d85452700 1 --2- 172.21.15.123:0/3519444716 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0d6c0698d0 0x7f0d6c06bd80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.450+0000 7f0d85452700 1 --2- 172.21.15.123:0/3519444716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d801d2530 0x7f0d801388c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.450+0000 7f0d85452700 1 --2- 172.21.15.123:0/3519444716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d80071df0 0x7f0d801420f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.450+0000 7f0d85452700 1 --2- 172.21.15.123:0/3519444716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d800ba280 0x7f0d801dc900 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.450+0000 7f0d85452700 1 -- 172.21.15.123:0/3519444716 >> 172.21.15.123:0/3519444716 conn(0x7f0d8006b360 msgr2=0x7f0d8013abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:10.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.450+0000 7f0d85452700 1 -- 172.21.15.123:0/3519444716 shutdown_connections 2023-03-08T15:50:10.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.450+0000 7f0d85452700 1 -- 172.21.15.123:0/3519444716 wait complete. 2023-03-08T15:50:10.453 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2023-03-08T15:50:10.463 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-08T15:50:10.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.580+0000 7f01f8231700 1 Processor -- start 2023-03-08T15:50:10.582 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.581+0000 7f01f8231700 1 -- start start 2023-03-08T15:50:10.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.581+0000 7f01f8231700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f01f00b3ce0 0x7f01f014dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.583 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.581+0000 7f01f8231700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f01f014e260 0x7f01f0154f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.581+0000 7f01f8231700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f006b8b0 con 0x7f01f006f330 2023-03-08T15:50:10.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.581+0000 7f01f8231700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f014e6c0 con 0x7f01f014e260 2023-03-08T15:50:10.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.581+0000 7f01f8231700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f00b8fe0 con 0x7f01f00b3ce0 2023-03-08T15:50:10.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.581+0000 7f01f67ce700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f01f014e260 0x7f01f0154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.581+0000 7f01f5fcd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f01f006f330 0x7f01f01446a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36066/0 (socket says 172.21.15.123:36066) 2023-03-08T15:50:10.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.581+0000 7f01f5fcd700 1 -- 172.21.15.123:0/574352355 learned_addr learned my addr 172.21.15.123:0/574352355 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:10.584 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.582+0000 7f01f57cc700 1 --2- 172.21.15.123:0/574352355 >> v2:172.21.15.175:3300/0 conn(0x7f01f00b3ce0 0x7f01f014dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.582+0000 7f01f4fcb700 1 -- 172.21.15.123:0/574352355 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988997218 0 0) 0x7f01f006b8b0 con 0x7f01f006f330 2023-03-08T15:50:10.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.582+0000 7f01f4fcb700 1 -- 172.21.15.123:0/574352355 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01dc0035b0 con 0x7f01f006f330 2023-03-08T15:50:10.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.582+0000 7f01f67ce700 1 -- 172.21.15.123:0/574352355 >> v2:172.21.15.175:3300/0 conn(0x7f01f00b3ce0 msgr2=0x7f01f014dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:10.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.582+0000 7f01f67ce700 1 --2- 172.21.15.123:0/574352355 >> v2:172.21.15.175:3300/0 conn(0x7f01f00b3ce0 0x7f01f014dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.582+0000 7f01f67ce700 1 -- 172.21.15.123:0/574352355 >> v1:172.21.15.123:6789/0 conn(0x7f01f006f330 legacy=0x7f01f01446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.582+0000 7f01f67ce700 1 -- 172.21.15.123:0/574352355 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f00b92c0 con 0x7f01f014e260 2023-03-08T15:50:10.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.582+0000 7f01f67ce700 1 --2- 172.21.15.123:0/574352355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f014e260 0x7f01f0154f50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f01f0068170 tx=0x7f01e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3c689d06ffeb3b server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:10.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.582+0000 7f01f4fcb700 1 -- 172.21.15.123:0/574352355 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e800e070 con 0x7f01f014e260 2023-03-08T15:50:10.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.582+0000 7f01f4fcb700 1 -- 172.21.15.123:0/574352355 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e800bb20 con 0x7f01f014e260 2023-03-08T15:50:10.586 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.582+0000 7f01f4fcb700 1 -- 172.21.15.123:0/574352355 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e8012430 con 0x7f01f014e260 2023-03-08T15:50:10.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.582+0000 7f01f8231700 1 -- 172.21.15.123:0/574352355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f014e260 msgr2=0x7f01f0154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.582+0000 7f01f8231700 1 --2- 172.21.15.123:0/574352355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f014e260 0x7f01f0154f50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f01f0068170 tx=0x7f01e800b330 comp rx=0 tx=0).stop 2023-03-08T15:50:10.588 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.583+0000 7f01f8231700 1 -- 172.21.15.123:0/574352355 shutdown_connections 2023-03-08T15:50:10.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.583+0000 7f01f8231700 1 --2- 172.21.15.123:0/574352355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f014e260 0x7f01f0154f50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.583+0000 7f01f8231700 1 --2- 172.21.15.123:0/574352355 >> v2:172.21.15.175:3300/0 conn(0x7f01f00b3ce0 0x7f01f014dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.583+0000 7f01f8231700 1 -- 172.21.15.123:0/574352355 >> 172.21.15.123:0/574352355 conn(0x7f01f00ba3c0 msgr2=0x7f01f00bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:10.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.583+0000 7f01f8231700 1 -- 172.21.15.123:0/574352355 shutdown_connections 2023-03-08T15:50:10.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.583+0000 7f01f8231700 1 -- 172.21.15.123:0/574352355 wait complete. 2023-03-08T15:50:10.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.584+0000 7f01f8231700 1 Processor -- start 2023-03-08T15:50:10.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.584+0000 7f01f8231700 1 -- start start 2023-03-08T15:50:10.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.584+0000 7f01f8231700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01f006f330 0x7f01f0141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.584+0000 7f01f8231700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01f00b3ce0 0x7f01f014b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.584+0000 7f01f8231700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f014e260 0x7f01f00b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.584+0000 7f01f8231700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f0140130 con 0x7f01f014e260 2023-03-08T15:50:10.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.584+0000 7f01f8231700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f0141560 con 0x7f01f006f330 2023-03-08T15:50:10.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.584+0000 7f01f8231700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f013fc20 con 0x7f01f00b3ce0 2023-03-08T15:50:10.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.584+0000 7f01f67ce700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f014e260 0x7f01f00b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.584+0000 7f01f67ce700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f014e260 0x7f01f00b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57562/0 (socket says 172.21.15.123:57562) 2023-03-08T15:50:10.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.584+0000 7f01f67ce700 1 -- 172.21.15.123:0/3692854054 learned_addr learned my addr 172.21.15.123:0/3692854054 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:10.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.584+0000 7f01f57cc700 1 --2- 172.21.15.123:0/3692854054 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01f00b3ce0 0x7f01f014b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.584+0000 7f01f5fcd700 1 --2- 172.21.15.123:0/3692854054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01f006f330 0x7f01f0141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.585+0000 7f01f67ce700 1 -- 172.21.15.123:0/3692854054 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01f00b3ce0 msgr2=0x7f01f014b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.585+0000 7f01f67ce700 1 --2- 172.21.15.123:0/3692854054 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01f00b3ce0 0x7f01f014b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.585+0000 7f01f67ce700 1 -- 172.21.15.123:0/3692854054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01f006f330 msgr2=0x7f01f0141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.591 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.585+0000 7f01f67ce700 1 --2- 172.21.15.123:0/3692854054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01f006f330 0x7f01f0141020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.585+0000 7f01f67ce700 1 -- 172.21.15.123:0/3692854054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e8009a70 con 0x7f01f014e260 2023-03-08T15:50:10.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.585+0000 7f01f67ce700 1 --2- 172.21.15.123:0/3692854054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f014e260 0x7f01f00b64e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f01e8014040 tx=0x7f01e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:10.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.585+0000 7f01e67fc700 1 -- 172.21.15.123:0/3692854054 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e8012430 con 0x7f01f014e260 2023-03-08T15:50:10.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.585+0000 7f01e67fc700 1 -- 172.21.15.123:0/3692854054 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e8020070 con 0x7f01f014e260 2023-03-08T15:50:10.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.585+0000 7f01f8231700 1 -- 172.21.15.123:0/3692854054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f006b540 con 0x7f01f014e260 2023-03-08T15:50:10.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.585+0000 7f01e67fc700 1 -- 172.21.15.123:0/3692854054 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e80098f0 con 0x7f01f014e260 2023-03-08T15:50:10.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.585+0000 7f01f8231700 1 -- 172.21.15.123:0/3692854054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f006b260 con 0x7f01f014e260 2023-03-08T15:50:10.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.586+0000 7f01f8231700 1 -- 172.21.15.123:0/3692854054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f00bdb20 con 0x7f01f014e260 2023-03-08T15:50:10.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.586+0000 7f01e67fc700 1 -- 172.21.15.123:0/3692854054 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f01e8004040 con 0x7f01f014e260 2023-03-08T15:50:10.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.587+0000 7f01e67fc700 1 --2- 172.21.15.123:0/3692854054 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f01d4069900 0x7f01d406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.587+0000 7f01e67fc700 1 -- 172.21.15.123:0/3692854054 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01e8022070 con 0x7f01f014e260 2023-03-08T15:50:10.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.587+0000 7f01f5fcd700 1 --2- 172.21.15.123:0/3692854054 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f01d4069900 0x7f01d406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.587+0000 7f01f5fcd700 1 --2- 172.21.15.123:0/3692854054 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f01d4069900 0x7f01d406bdb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f01e0007fd0 tx=0x7f01e0007dc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:10.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.591+0000 7f01e67fc700 1 -- 172.21.15.123:0/3692854054 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f01e80556a0 con 0x7f01f014e260 2023-03-08T15:50:10.818 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.817+0000 7f01f8231700 1 -- 172.21.15.123:0/3692854054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01f00744c0 con 0x7f01f014e260 2023-03-08T15:50:10.819 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.818+0000 7f01e67fc700 1 -- 172.21.15.123:0/3692854054 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3915 (secure 0 0 0) 0x7f01e8058cc0 con 0x7f01f014e260 2023-03-08T15:50:10.819 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:10.820 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/108043707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":108043707},{"type":"v1","addr":"172.21.15.123:6835","nonce":108043707}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1787308526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":1787308526},{"type":"v1","addr":"172.21.15.123:6837","nonce":1787308526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-08T15:49:39.489034+0000","modified":"2023-03-08T15:49:42.501407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6833/1018957090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1018957090},{"type":"v1","addr":"172.21.15.175:6833","nonce":1018957090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-08T15:50:10.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.820+0000 7f01f8231700 1 -- 172.21.15.123:0/3692854054 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f01d4069900 msgr2=0x7f01d406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.820+0000 7f01f8231700 1 --2- 172.21.15.123:0/3692854054 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f01d4069900 0x7f01d406bdb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f01e0007fd0 tx=0x7f01e0007dc0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.820+0000 7f01f8231700 1 -- 172.21.15.123:0/3692854054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f014e260 msgr2=0x7f01f00b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.820+0000 7f01f8231700 1 --2- 172.21.15.123:0/3692854054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f014e260 0x7f01f00b64e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f01e8014040 tx=0x7f01e8004ad0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.820+0000 7f01f8231700 1 -- 172.21.15.123:0/3692854054 shutdown_connections 2023-03-08T15:50:10.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.820+0000 7f01f8231700 1 --2- 172.21.15.123:0/3692854054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01f014e260 0x7f01f00b64e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.820+0000 7f01f8231700 1 --2- 172.21.15.123:0/3692854054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01f006f330 0x7f01f0141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.820+0000 7f01f8231700 1 --2- 172.21.15.123:0/3692854054 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f01d4069900 0x7f01d406bdb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.820+0000 7f01f8231700 1 --2- 172.21.15.123:0/3692854054 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01f00b3ce0 0x7f01f014b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.820+0000 7f01f8231700 1 -- 172.21.15.123:0/3692854054 >> 172.21.15.123:0/3692854054 conn(0x7f01f00ba3c0 msgr2=0x7f01f00711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:10.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.820+0000 7f01f8231700 1 -- 172.21.15.123:0/3692854054 shutdown_connections 2023-03-08T15:50:10.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.820+0000 7f01f8231700 1 -- 172.21.15.123:0/3692854054 wait complete. 2023-03-08T15:50:10.824 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2023-03-08T15:50:10.834 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:50:10.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.952+0000 7fe7918fa700 1 Processor -- start 2023-03-08T15:50:10.953 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.952+0000 7fe7918fa700 1 -- start start 2023-03-08T15:50:10.955 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe7918fa700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe78c1446c0 0x7fe78c0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe7918fa700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78c144a90 0x7fe78c0bd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe7918fa700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe78c0ba560 0x7fe78c0b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe7918fa700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c0b7fa0 con 0x7fe78c0ba560 2023-03-08T15:50:10.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe7918fa700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c0b7130 con 0x7fe78c1446c0 2023-03-08T15:50:10.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe7918fa700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c0bc030 con 0x7fe78c144a90 2023-03-08T15:50:10.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe78b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe78c0ba560 0x7fe78c0b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe78b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe78c0ba560 0x7fe78c0b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57568/0 (socket says 172.21.15.123:57568) 2023-03-08T15:50:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe78b7fe700 1 -- 172.21.15.123:0/66532309 learned_addr learned my addr 172.21.15.123:0/66532309 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe78a7fc700 1 --2- 172.21.15.123:0/66532309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78c144a90 0x7fe78c0bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe78affd700 1 --2- 172.21.15.123:0/66532309 >> v2:172.21.15.175:3300/0 conn(0x7fe78c1446c0 0x7fe78c0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe78b7fe700 1 -- 172.21.15.123:0/66532309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78c144a90 msgr2=0x7fe78c0bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe78b7fe700 1 --2- 172.21.15.123:0/66532309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78c144a90 0x7fe78c0bd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe78b7fe700 1 -- 172.21.15.123:0/66532309 >> v2:172.21.15.175:3300/0 conn(0x7fe78c1446c0 msgr2=0x7fe78c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:10.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe78b7fe700 1 --2- 172.21.15.123:0/66532309 >> v2:172.21.15.175:3300/0 conn(0x7fe78c1446c0 0x7fe78c0b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe78b7fe700 1 -- 172.21.15.123:0/66532309 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c0bc310 con 0x7fe78c0ba560 2023-03-08T15:50:10.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe78a7fc700 1 --2- 172.21.15.123:0/66532309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78c144a90 0x7fe78c0bd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:10.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe78b7fe700 1 --2- 172.21.15.123:0/66532309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe78c0ba560 0x7fe78c0b5a80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe78c06ca90 tx=0x7fe78400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6711fdca03af60 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:10.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe789ffb700 1 -- 172.21.15.123:0/66532309 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78400e070 con 0x7fe78c0ba560 2023-03-08T15:50:10.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe789ffb700 1 -- 172.21.15.123:0/66532309 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78400b9c0 con 0x7fe78c0ba560 2023-03-08T15:50:10.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.953+0000 7fe789ffb700 1 -- 172.21.15.123:0/66532309 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78400bd70 con 0x7fe78c0ba560 2023-03-08T15:50:10.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.954+0000 7fe7918fa700 1 -- 172.21.15.123:0/66532309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe78c0ba560 msgr2=0x7fe78c0b5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.954+0000 7fe7918fa700 1 --2- 172.21.15.123:0/66532309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe78c0ba560 0x7fe78c0b5a80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe78c06ca90 tx=0x7fe78400b330 comp rx=0 tx=0).stop 2023-03-08T15:50:10.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.954+0000 7fe7918fa700 1 -- 172.21.15.123:0/66532309 shutdown_connections 2023-03-08T15:50:10.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.954+0000 7fe7918fa700 1 --2- 172.21.15.123:0/66532309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe78c0ba560 0x7fe78c0b5a80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.954+0000 7fe7918fa700 1 --2- 172.21.15.123:0/66532309 >> v2:172.21.15.175:3300/0 conn(0x7fe78c1446c0 0x7fe78c0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.954+0000 7fe7918fa700 1 --2- 172.21.15.123:0/66532309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78c144a90 0x7fe78c0bd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.954+0000 7fe7918fa700 1 -- 172.21.15.123:0/66532309 >> 172.21.15.123:0/66532309 conn(0x7fe78c071980 msgr2=0x7fe78c071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:10.959 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.954+0000 7fe7918fa700 1 -- 172.21.15.123:0/66532309 shutdown_connections 2023-03-08T15:50:10.960 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.954+0000 7fe7918fa700 1 -- 172.21.15.123:0/66532309 wait complete. 2023-03-08T15:50:10.961 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.955+0000 7fe7918fa700 1 Processor -- start 2023-03-08T15:50:10.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.956+0000 7fe7918fa700 1 -- start start 2023-03-08T15:50:10.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.956+0000 7fe7918fa700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78c0ba560 0x7fe78c142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.956+0000 7fe7918fa700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe78c1446c0 0x7fe78c149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.956+0000 7fe7918fa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe78c144a90 0x7fe78c141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.956+0000 7fe7918fa700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c142830 con 0x7fe78c144a90 2023-03-08T15:50:10.962 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.956+0000 7fe7918fa700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c14a0c0 con 0x7fe78c1446c0 2023-03-08T15:50:10.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.956+0000 7fe7918fa700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c1408b0 con 0x7fe78c0ba560 2023-03-08T15:50:10.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.956+0000 7fe78b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe78c144a90 0x7fe78c141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.956+0000 7fe78b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe78c144a90 0x7fe78c141960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57578/0 (socket says 172.21.15.123:57578) 2023-03-08T15:50:10.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.956+0000 7fe78b7fe700 1 -- 172.21.15.123:0/477323969 learned_addr learned my addr 172.21.15.123:0/477323969 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:10.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.956+0000 7fe78affd700 1 --2- 172.21.15.123:0/477323969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78c0ba560 0x7fe78c142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.963 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.956+0000 7fe78a7fc700 1 --2- 172.21.15.123:0/477323969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe78c1446c0 0x7fe78c149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.957+0000 7fe78b7fe700 1 -- 172.21.15.123:0/477323969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78c0ba560 msgr2=0x7fe78c142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.957+0000 7fe78b7fe700 1 --2- 172.21.15.123:0/477323969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78c0ba560 0x7fe78c142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.957+0000 7fe78b7fe700 1 -- 172.21.15.123:0/477323969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe78c1446c0 msgr2=0x7fe78c149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:10.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.957+0000 7fe78b7fe700 1 --2- 172.21.15.123:0/477323969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe78c1446c0 0x7fe78c149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:10.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.957+0000 7fe78b7fe700 1 -- 172.21.15.123:0/477323969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe784009b30 con 0x7fe78c144a90 2023-03-08T15:50:10.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.957+0000 7fe78b7fe700 1 --2- 172.21.15.123:0/477323969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe78c144a90 0x7fe78c141960 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe78400b370 tx=0x7fe784004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:10.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.957+0000 7fe773fff700 1 -- 172.21.15.123:0/477323969 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784004250 con 0x7fe78c144a90 2023-03-08T15:50:10.964 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.957+0000 7fe773fff700 1 -- 172.21.15.123:0/477323969 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7840043d0 con 0x7fe78c144a90 2023-03-08T15:50:10.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.957+0000 7fe7918fa700 1 -- 172.21.15.123:0/477323969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78c14db90 con 0x7fe78c144a90 2023-03-08T15:50:10.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.957+0000 7fe773fff700 1 -- 172.21.15.123:0/477323969 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784004780 con 0x7fe78c144a90 2023-03-08T15:50:10.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.957+0000 7fe7918fa700 1 -- 172.21.15.123:0/477323969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78c0bc5f0 con 0x7fe78c144a90 2023-03-08T15:50:10.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.958+0000 7fe7918fa700 1 -- 172.21.15.123:0/477323969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78c14dd20 con 0x7fe78c144a90 2023-03-08T15:50:10.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.958+0000 7fe773fff700 1 -- 172.21.15.123:0/477323969 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fe78401c440 con 0x7fe78c144a90 2023-03-08T15:50:10.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.959+0000 7fe773fff700 1 --2- 172.21.15.123:0/477323969 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe7780698d0 0x7fe77806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:10.965 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.959+0000 7fe773fff700 1 -- 172.21.15.123:0/477323969 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe784088d10 con 0x7fe78c144a90 2023-03-08T15:50:10.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.959+0000 7fe78affd700 1 --2- 172.21.15.123:0/477323969 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe7780698d0 0x7fe77806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:10.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.959+0000 7fe78affd700 1 --2- 172.21.15.123:0/477323969 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe7780698d0 0x7fe77806bd80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe78000ab60 tx=0x7fe780008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:10.966 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:10.963+0000 7fe773fff700 1 -- 172.21.15.123:0/477323969 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fe78c14dd20 con 0x7fe78c144a90 2023-03-08T15:50:11.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.155+0000 7fe7918fa700 1 -- 172.21.15.123:0/477323969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe78c14dd20 con 0x7fe78c144a90 2023-03-08T15:50:11.157 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.156+0000 7fe773fff700 1 -- 172.21.15.123:0/477323969 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17955 (secure 0 0 0) 0x7fe78c14dd20 con 0x7fe78c144a90 2023-03-08T15:50:11.158 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:11.158 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:49:40.490671+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:49:37.104720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-08T15:49:38.431537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:50:11.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.158+0000 7fe7918fa700 1 -- 172.21.15.123:0/477323969 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe7780698d0 msgr2=0x7fe77806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:11.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.158+0000 7fe7918fa700 1 --2- 172.21.15.123:0/477323969 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe7780698d0 0x7fe77806bd80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe78000ab60 tx=0x7fe780008040 comp rx=0 tx=0).stop 2023-03-08T15:50:11.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.158+0000 7fe7918fa700 1 -- 172.21.15.123:0/477323969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe78c144a90 msgr2=0x7fe78c141960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:11.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.158+0000 7fe7918fa700 1 --2- 172.21.15.123:0/477323969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe78c144a90 0x7fe78c141960 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe78400b370 tx=0x7fe784004ad0 comp rx=0 tx=0).stop 2023-03-08T15:50:11.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.158+0000 7fe7918fa700 1 -- 172.21.15.123:0/477323969 shutdown_connections 2023-03-08T15:50:11.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.158+0000 7fe7918fa700 1 --2- 172.21.15.123:0/477323969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe78c144a90 0x7fe78c141960 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:11.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.158+0000 7fe7918fa700 1 --2- 172.21.15.123:0/477323969 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe7780698d0 0x7fe77806bd80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:11.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.158+0000 7fe7918fa700 1 --2- 172.21.15.123:0/477323969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe78c0ba560 0x7fe78c142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:11.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.158+0000 7fe7918fa700 1 --2- 172.21.15.123:0/477323969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe78c1446c0 0x7fe78c149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:11.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.158+0000 7fe7918fa700 1 -- 172.21.15.123:0/477323969 >> 172.21.15.123:0/477323969 conn(0x7fe78c071980 msgr2=0x7fe78c14b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:11.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.159+0000 7fe7918fa700 1 -- 172.21.15.123:0/477323969 shutdown_connections 2023-03-08T15:50:11.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.159+0000 7fe7918fa700 1 -- 172.21.15.123:0/477323969 wait complete. 2023-03-08T15:50:11.172 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-03-08T15:50:11.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.291+0000 7fb00748f700 1 Processor -- start 2023-03-08T15:50:11.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.291+0000 7fb00748f700 1 -- start start 2023-03-08T15:50:11.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7fb00748f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb0000ba280 0x7fb00006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:11.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7fb00748f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb000072760 0x7fb000141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:11.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7fb00748f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb000070670 con 0x7fb000071df0 2023-03-08T15:50:11.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7fb00748f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb000070a40 con 0x7fb0000ba280 2023-03-08T15:50:11.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7fb00748f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb000070c50 con 0x7fb000072760 2023-03-08T15:50:11.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7fb00522b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb0000ba280 0x7fb00006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:11.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7fb00522b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb0000ba280 0x7fb00006fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57588/0 (socket says 172.21.15.123:57588) 2023-03-08T15:50:11.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7fb00522b700 1 -- 172.21.15.123:0/2316415400 learned_addr learned my addr 172.21.15.123:0/2316415400 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:11.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7fb00522b700 1 -- 172.21.15.123:0/2316415400 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb000072760 msgr2=0x7fb000141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:11.295 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7fb004a2a700 1 --2- 172.21.15.123:0/2316415400 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb000072760 0x7fb000141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:11.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7fb00522b700 1 --2- 172.21.15.123:0/2316415400 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb000072760 0x7fb000141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:11.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7fb00522b700 1 -- 172.21.15.123:0/2316415400 >> v1:172.21.15.175:6789/0 conn(0x7fb000071df0 legacy=0x7fb00014aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:11.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7fb00522b700 1 -- 172.21.15.123:0/2316415400 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0000ba650 con 0x7fb0000ba280 2023-03-08T15:50:11.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7fb004a2a700 1 --2- 172.21.15.123:0/2316415400 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb000072760 0x7fb000141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:11.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7fb00522b700 1 --2- 172.21.15.123:0/2316415400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0000ba280 0x7fb00006fff0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faffc0098f0 tx=0x7faffc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169d05286307900e server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:11.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7faff7fff700 1 -- 172.21.15.123:0/2316415400 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc004230 con 0x7fb0000ba280 2023-03-08T15:50:11.296 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7faff7fff700 1 -- 172.21.15.123:0/2316415400 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc004390 con 0x7fb0000ba280 2023-03-08T15:50:11.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.292+0000 7faff7fff700 1 -- 172.21.15.123:0/2316415400 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc0036a0 con 0x7fb0000ba280 2023-03-08T15:50:11.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.293+0000 7fb00748f700 1 -- 172.21.15.123:0/2316415400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0000ba280 msgr2=0x7fb00006fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:11.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.293+0000 7fb00748f700 1 --2- 172.21.15.123:0/2316415400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0000ba280 0x7fb00006fff0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faffc0098f0 tx=0x7faffc009c00 comp rx=0 tx=0).stop 2023-03-08T15:50:11.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.293+0000 7fb00748f700 1 -- 172.21.15.123:0/2316415400 shutdown_connections 2023-03-08T15:50:11.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.293+0000 7fb00748f700 1 --2- 172.21.15.123:0/2316415400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0000ba280 0x7fb00006fff0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:11.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.293+0000 7fb00748f700 1 --2- 172.21.15.123:0/2316415400 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb000072760 0x7fb000141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:11.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.293+0000 7fb00748f700 1 -- 172.21.15.123:0/2316415400 >> 172.21.15.123:0/2316415400 conn(0x7fb00006b360 msgr2=0x7fb00006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:11.297 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.293+0000 7fb00748f700 1 -- 172.21.15.123:0/2316415400 shutdown_connections 2023-03-08T15:50:11.298 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.293+0000 7fb00748f700 1 -- 172.21.15.123:0/2316415400 wait complete. 2023-03-08T15:50:11.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.294+0000 7fb00748f700 1 Processor -- start 2023-03-08T15:50:11.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.294+0000 7fb00748f700 1 -- start start 2023-03-08T15:50:11.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb00748f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb000071df0 0x7fb0001d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:11.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb00748f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0000ba280 0x7fb00013a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:11.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb00748f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0001de180 0x7fb0001378b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:11.300 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb00748f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00013a620 con 0x7fb0001de180 2023-03-08T15:50:11.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb00748f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb000142150 con 0x7fb0000ba280 2023-03-08T15:50:11.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb00748f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb000149ea0 con 0x7fb000071df0 2023-03-08T15:50:11.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb005a2c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0001de180 0x7fb0001378b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:11.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb005a2c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0001de180 0x7fb0001378b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57598/0 (socket says 172.21.15.123:57598) 2023-03-08T15:50:11.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb005a2c700 1 -- 172.21.15.123:0/2931958391 learned_addr learned my addr 172.21.15.123:0/2931958391 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:11.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb00522b700 1 --2- 172.21.15.123:0/2931958391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb000071df0 0x7fb0001d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:11.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb004a2a700 1 --2- 172.21.15.123:0/2931958391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0000ba280 0x7fb00013a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:11.301 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb005a2c700 1 -- 172.21.15.123:0/2931958391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb000071df0 msgr2=0x7fb0001d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:11.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb005a2c700 1 --2- 172.21.15.123:0/2931958391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb000071df0 0x7fb0001d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:11.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb005a2c700 1 -- 172.21.15.123:0/2931958391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0000ba280 msgr2=0x7fb00013a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:11.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb005a2c700 1 --2- 172.21.15.123:0/2931958391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0000ba280 0x7fb00013a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:11.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb005a2c700 1 -- 172.21.15.123:0/2931958391 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc009550 con 0x7fb0001de180 2023-03-08T15:50:11.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb005a2c700 1 --2- 172.21.15.123:0/2931958391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0001de180 0x7fb0001378b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faff800ee40 tx=0x7faff800c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:11.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7faff5ffb700 1 -- 172.21.15.123:0/2931958391 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8011470 con 0x7fb0001de180 2023-03-08T15:50:11.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7faff5ffb700 1 -- 172.21.15.123:0/2931958391 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff80115d0 con 0x7fb0001de180 2023-03-08T15:50:11.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb00748f700 1 -- 172.21.15.123:0/2931958391 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00014b350 con 0x7fb0001de180 2023-03-08T15:50:11.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7faff5ffb700 1 -- 172.21.15.123:0/2931958391 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8011980 con 0x7fb0001de180 2023-03-08T15:50:11.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.295+0000 7fb00748f700 1 -- 172.21.15.123:0/2931958391 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00014b1c0 con 0x7fb0001de180 2023-03-08T15:50:11.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.296+0000 7fb00748f700 1 -- 172.21.15.123:0/2931958391 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0001419c0 con 0x7fb0001de180 2023-03-08T15:50:11.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.297+0000 7faff5ffb700 1 -- 172.21.15.123:0/2931958391 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7faff8011ae0 con 0x7fb0001de180 2023-03-08T15:50:11.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.297+0000 7faff5ffb700 1 --2- 172.21.15.123:0/2931958391 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafe40698d0 0x7fafe406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:11.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.297+0000 7faff5ffb700 1 -- 172.21.15.123:0/2931958391 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faff808a1c0 con 0x7fb0001de180 2023-03-08T15:50:11.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.297+0000 7fb00522b700 1 --2- 172.21.15.123:0/2931958391 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafe40698d0 0x7fafe406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:11.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.297+0000 7fb00522b700 1 --2- 172.21.15.123:0/2931958391 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafe40698d0 0x7fafe406bd80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faffc009130 tx=0x7faffc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:11.304 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.301+0000 7faff5ffb700 1 -- 172.21.15.123:0/2931958391 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7faff8055f90 con 0x7fb0001de180 2023-03-08T15:50:11.533 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:11.532+0000 7fb00748f700 1 -- 172.21.15.123:0/2931958391 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb0000744c0 con 0x7fb0001de180 2023-03-08T15:50:12.070 INFO:tasks.ceph.mon.a.smithi123.stderr:2023-03-08T15:50:12.069+0000 7f1cf2242700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-03-08T15:50:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.075+0000 7faff5ffb700 1 -- 172.21.15.123:0/2931958391 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7faff80595b0 con 0x7fb0001de180 2023-03-08T15:50:12.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.077+0000 7fb00748f700 1 -- 172.21.15.123:0/2931958391 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafe40698d0 msgr2=0x7fafe406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.077+0000 7fb00748f700 1 --2- 172.21.15.123:0/2931958391 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafe40698d0 0x7fafe406bd80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faffc009130 tx=0x7faffc008030 comp rx=0 tx=0).stop 2023-03-08T15:50:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.077+0000 7fb00748f700 1 -- 172.21.15.123:0/2931958391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0001de180 msgr2=0x7fb0001378b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.077+0000 7fb00748f700 1 --2- 172.21.15.123:0/2931958391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0001de180 0x7fb0001378b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faff800ee40 tx=0x7faff800c550 comp rx=0 tx=0).stop 2023-03-08T15:50:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.077+0000 7fb00748f700 1 -- 172.21.15.123:0/2931958391 shutdown_connections 2023-03-08T15:50:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.077+0000 7fb00748f700 1 --2- 172.21.15.123:0/2931958391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0001de180 0x7fb0001378b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.077+0000 7fb00748f700 1 --2- 172.21.15.123:0/2931958391 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafe40698d0 0x7fafe406bd80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:12.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.077+0000 7fb00748f700 1 --2- 172.21.15.123:0/2931958391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb000071df0 0x7fb0001d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:12.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.077+0000 7fb00748f700 1 --2- 172.21.15.123:0/2931958391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0000ba280 0x7fb00013a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:12.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.077+0000 7fb00748f700 1 -- 172.21.15.123:0/2931958391 >> 172.21.15.123:0/2931958391 conn(0x7fb00006b360 msgr2=0x7fb00013ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:12.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.077+0000 7fb00748f700 1 -- 172.21.15.123:0/2931958391 shutdown_connections 2023-03-08T15:50:12.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.077+0000 7fb00748f700 1 -- 172.21.15.123:0/2931958391 wait complete. 2023-03-08T15:50:12.080 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-03-08T15:50:12.081 INFO:tasks.ceph.mds.b.smithi175.stderr: -8774> 2023-03-08T15:49:45.150+0000 7fc1da7c2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-08T15:50:12.092 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-03-08T15:50:12.117 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-03-08T15:50:12.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.215+0000 7f6c92fe5700 1 Processor -- start 2023-03-08T15:50:12.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.215+0000 7f6c92fe5700 1 -- start start 2023-03-08T15:50:12.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.215+0000 7f6c92fe5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6c8c0bd0b0 0x7f6c8c0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:12.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.215+0000 7f6c92fe5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c8c148b70 0x7f6c8c148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:12.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.215+0000 7f6c92fe5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c142c70 con 0x7f6c8c06ea70 2023-03-08T15:50:12.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.215+0000 7f6c92fe5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8c149530 con 0x7f6c8c0bd0b0 2023-03-08T15:50:12.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.215+0000 7f6c92fe5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0b6070 con 0x7f6c8c148b70 2023-03-08T15:50:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c90d81700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6c8c06ea70 0x7f6c8c142560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36072/0 (socket says 172.21.15.123:36072) 2023-03-08T15:50:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c90d81700 1 -- 172.21.15.123:0/3079400876 learned_addr learned my addr 172.21.15.123:0/3079400876 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 -- 172.21.15.123:0/3079400876 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889916564 0 0) 0x7f6c8c142c70 con 0x7f6c8c06ea70 2023-03-08T15:50:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 -- 172.21.15.123:0/3079400876 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c7c0035b0 con 0x7f6c8c06ea70 2023-03-08T15:50:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8bfff700 1 --2- 172.21.15.123:0/3079400876 >> v2:172.21.15.175:3300/0 conn(0x7f6c8c0bd0b0 0x7f6c8c0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c91582700 1 --2- 172.21.15.123:0/3079400876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c8c148b70 0x7f6c8c148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 -- 172.21.15.123:0/3079400876 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 658800232 0 0) 0x7f6c7c0035b0 con 0x7f6c8c06ea70 2023-03-08T15:50:12.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 -- 172.21.15.123:0/3079400876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c8c148b70 msgr2=0x7f6c8c148ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:12.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 --2- 172.21.15.123:0/3079400876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c8c148b70 0x7f6c8c148ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:12.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 -- 172.21.15.123:0/3079400876 >> v2:172.21.15.175:3300/0 conn(0x7f6c8c0bd0b0 msgr2=0x7f6c8c0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:12.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 --2- 172.21.15.123:0/3079400876 >> v2:172.21.15.175:3300/0 conn(0x7f6c8c0bd0b0 0x7f6c8c0b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:12.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 -- 172.21.15.123:0/3079400876 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c0b6350 con 0x7f6c8c06ea70 2023-03-08T15:50:12.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 -- 172.21.15.123:0/3079400876 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f6c80001670 con 0x7f6c8c06ea70 2023-03-08T15:50:12.221 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 -- 172.21.15.123:0/3079400876 >> v1:172.21.15.123:6789/0 conn(0x7f6c8c06ea70 legacy=0x7f6c8c142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 --2- 172.21.15.123:0/3079400876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c8c148b70 0x7f6c7c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 --2- 172.21.15.123:0/3079400876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c7c003f80 0x7f6c7c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 --2- 172.21.15.123:0/3079400876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c7c004d90 0x7f6c7c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 -- 172.21.15.123:0/3079400876 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c149530 con 0x7f6c7c004d90 2023-03-08T15:50:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 -- 172.21.15.123:0/3079400876 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0b6070 con 0x7f6c7c003f80 2023-03-08T15:50:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8b7fe700 1 -- 172.21.15.123:0/3079400876 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c00ba40 con 0x7f6c8c148b70 2023-03-08T15:50:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c91582700 1 --2- 172.21.15.123:0/3079400876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c7c004d90 0x7f6c7c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c8bfff700 1 --2- 172.21.15.123:0/3079400876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c7c003f80 0x7f6c7c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:12.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c90d81700 1 --2- 172.21.15.123:0/3079400876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c8c148b70 0x7f6c7c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:12.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c91582700 1 -- 172.21.15.123:0/3079400876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c8c148b70 msgr2=0x7f6c7c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:12.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c91582700 1 --2- 172.21.15.123:0/3079400876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c8c148b70 0x7f6c7c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:12.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c91582700 1 -- 172.21.15.123:0/3079400876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c7c003f80 msgr2=0x7f6c7c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:12.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.216+0000 7f6c91582700 1 --2- 172.21.15.123:0/3079400876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c7c003f80 0x7f6c7c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:12.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.217+0000 7f6c91582700 1 -- 172.21.15.123:0/3079400876 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0035b0 con 0x7f6c7c004d90 2023-03-08T15:50:12.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.217+0000 7f6c91582700 1 --2- 172.21.15.123:0/3079400876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c7c004d90 0x7f6c7c005200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009fc0 tx=0x7f6c7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b570b6d1a024d45c server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:12.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.217+0000 7f6c8b7fe700 1 -- 172.21.15.123:0/3079400876 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8400ec30 con 0x7f6c7c004d90 2023-03-08T15:50:12.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.217+0000 7f6c8b7fe700 1 -- 172.21.15.123:0/3079400876 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8400f040 con 0x7f6c7c004d90 2023-03-08T15:50:12.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.217+0000 7f6c8b7fe700 1 -- 172.21.15.123:0/3079400876 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c84014480 con 0x7f6c7c004d90 2023-03-08T15:50:12.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.217+0000 7f6c92fe5700 1 -- 172.21.15.123:0/3079400876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c7c004d90 msgr2=0x7f6c7c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:12.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.217+0000 7f6c92fe5700 1 --2- 172.21.15.123:0/3079400876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c7c004d90 0x7f6c7c005200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009fc0 tx=0x7f6c7c005880 comp rx=0 tx=0).stop 2023-03-08T15:50:12.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.217+0000 7f6c91582700 1 -- 172.21.15.123:0/3079400876 reap_dead start 2023-03-08T15:50:12.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.217+0000 7f6c92fe5700 1 -- 172.21.15.123:0/3079400876 shutdown_connections 2023-03-08T15:50:12.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.217+0000 7f6c92fe5700 1 -- 172.21.15.123:0/3079400876 >> 172.21.15.123:0/3079400876 conn(0x7f6c8c0bc480 msgr2=0x7f6c8c0bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.217+0000 7f6c92fe5700 1 -- 172.21.15.123:0/3079400876 shutdown_connections 2023-03-08T15:50:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.217+0000 7f6c92fe5700 1 -- 172.21.15.123:0/3079400876 wait complete. 2023-03-08T15:50:12.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.218+0000 7f6c92fe5700 1 Processor -- start 2023-03-08T15:50:12.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.218+0000 7f6c92fe5700 1 -- start start 2023-03-08T15:50:12.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c92fe5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c8c13cc00 0x7f6c8c14b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:12.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c92fe5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c8c0bbf80 0x7f6c8c1dfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:12.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c92fe5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c8c149700 0x7f6c8c145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:12.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c92fe5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c13b460 con 0x7f6c8c13cc00 2023-03-08T15:50:12.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c92fe5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c14afb0 con 0x7f6c8c149700 2023-03-08T15:50:12.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c92fe5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c14a5b0 con 0x7f6c8c0bbf80 2023-03-08T15:50:12.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c90d81700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c8c13cc00 0x7f6c8c14b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:12.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c90d81700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c8c13cc00 0x7f6c8c14b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57610/0 (socket says 172.21.15.123:57610) 2023-03-08T15:50:12.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c90d81700 1 -- 172.21.15.123:0/1216414025 learned_addr learned my addr 172.21.15.123:0/1216414025 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:12.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c8bfff700 1 --2- 172.21.15.123:0/1216414025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c8c0bbf80 0x7f6c8c1dfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:12.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c91582700 1 --2- 172.21.15.123:0/1216414025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c8c149700 0x7f6c8c145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:12.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c90d81700 1 -- 172.21.15.123:0/1216414025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c8c0bbf80 msgr2=0x7f6c8c1dfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:12.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c90d81700 1 --2- 172.21.15.123:0/1216414025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c8c0bbf80 0x7f6c8c1dfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:12.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c90d81700 1 -- 172.21.15.123:0/1216414025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c8c149700 msgr2=0x7f6c8c145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:12.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c90d81700 1 --2- 172.21.15.123:0/1216414025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c8c149700 0x7f6c8c145110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:12.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.219+0000 7f6c90d81700 1 -- 172.21.15.123:0/1216414025 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c0b6630 con 0x7f6c8c13cc00 2023-03-08T15:50:12.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.220+0000 7f6c90d81700 1 --2- 172.21.15.123:0/1216414025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c8c13cc00 0x7f6c8c14b440 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6c800017a0 tx=0x7f6c8000f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:12.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.220+0000 7f6c897fa700 1 -- 172.21.15.123:0/1216414025 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80007d30 con 0x7f6c8c13cc00 2023-03-08T15:50:12.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.220+0000 7f6c897fa700 1 -- 172.21.15.123:0/1216414025 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c80007e90 con 0x7f6c8c13cc00 2023-03-08T15:50:12.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.220+0000 7f6c92fe5700 1 -- 172.21.15.123:0/1216414025 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8c148650 con 0x7f6c8c13cc00 2023-03-08T15:50:12.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.220+0000 7f6c897fa700 1 -- 172.21.15.123:0/1216414025 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8000fd00 con 0x7f6c8c13cc00 2023-03-08T15:50:12.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.220+0000 7f6c92fe5700 1 -- 172.21.15.123:0/1216414025 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8c06ee40 con 0x7f6c8c13cc00 2023-03-08T15:50:12.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.221+0000 7f6c92fe5700 1 -- 172.21.15.123:0/1216414025 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c0744c0 con 0x7f6c8c13cc00 2023-03-08T15:50:12.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.221+0000 7f6c897fa700 1 -- 172.21.15.123:0/1216414025 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f6c8001c030 con 0x7f6c8c13cc00 2023-03-08T15:50:12.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.221+0000 7f6c897fa700 1 --2- 172.21.15.123:0/1216414025 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f6c70069900 0x7f6c7006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:12.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.221+0000 7f6c897fa700 1 -- 172.21.15.123:0/1216414025 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f6c800871f0 con 0x7f6c8c13cc00 2023-03-08T15:50:12.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.221+0000 7f6c8bfff700 1 --2- 172.21.15.123:0/1216414025 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f6c70069900 0x7f6c7006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:12.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.222+0000 7f6c8bfff700 1 --2- 172.21.15.123:0/1216414025 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f6c70069900 0x7f6c7006bdb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c146070 tx=0x7f6c78008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:12.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.226+0000 7f6c897fa700 1 -- 172.21.15.123:0/1216414025 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f6c80052ed0 con 0x7f6c8c13cc00 2023-03-08T15:50:12.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:12.451+0000 7f6c92fe5700 1 -- 172.21.15.123:0/1216414025 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6c8c0729a0 con 0x7f6c8c13cc00 2023-03-08T15:50:13.078 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.077+0000 7f6c897fa700 1 -- 172.21.15.123:0/1216414025 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6c800564f0 con 0x7f6c8c13cc00 2023-03-08T15:50:13.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.079+0000 7f6c92fe5700 1 -- 172.21.15.123:0/1216414025 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f6c70069900 msgr2=0x7f6c7006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:13.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.079+0000 7f6c92fe5700 1 --2- 172.21.15.123:0/1216414025 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f6c70069900 0x7f6c7006bdb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c146070 tx=0x7f6c78008040 comp rx=0 tx=0).stop 2023-03-08T15:50:13.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.079+0000 7f6c92fe5700 1 -- 172.21.15.123:0/1216414025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c8c13cc00 msgr2=0x7f6c8c14b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:13.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.079+0000 7f6c92fe5700 1 --2- 172.21.15.123:0/1216414025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c8c13cc00 0x7f6c8c14b440 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6c800017a0 tx=0x7f6c8000f4b0 comp rx=0 tx=0).stop 2023-03-08T15:50:13.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.079+0000 7f6c92fe5700 1 -- 172.21.15.123:0/1216414025 shutdown_connections 2023-03-08T15:50:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.079+0000 7f6c92fe5700 1 --2- 172.21.15.123:0/1216414025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c8c149700 0x7f6c8c145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.079+0000 7f6c92fe5700 1 --2- 172.21.15.123:0/1216414025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c8c13cc00 0x7f6c8c14b440 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.079+0000 7f6c92fe5700 1 --2- 172.21.15.123:0/1216414025 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f6c70069900 0x7f6c7006bdb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.079+0000 7f6c92fe5700 1 --2- 172.21.15.123:0/1216414025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c8c0bbf80 0x7f6c8c1dfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.079+0000 7f6c92fe5700 1 -- 172.21.15.123:0/1216414025 >> 172.21.15.123:0/1216414025 conn(0x7f6c8c0bc480 msgr2=0x7f6c8c146e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.080+0000 7f6c92fe5700 1 -- 172.21.15.123:0/1216414025 shutdown_connections 2023-03-08T15:50:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.080+0000 7f6c92fe5700 1 -- 172.21.15.123:0/1216414025 wait complete. 2023-03-08T15:50:13.095 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-03-08T15:50:13.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.221+0000 7f3bb13a2700 1 Processor -- start 2023-03-08T15:50:13.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.221+0000 7f3bb13a2700 1 -- start start 2023-03-08T15:50:13.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.222+0000 7f3bb13a2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3bac0b7900 0x7f3bac140990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:13.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.222+0000 7f3bb13a2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac0b59c0 con 0x7f3bac1476e0 2023-03-08T15:50:13.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.222+0000 7f3bb13a2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac0b8b10 con 0x7f3bac06aee0 2023-03-08T15:50:13.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.222+0000 7f3bb13a2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bac0b56e0 con 0x7f3bac0b7900 2023-03-08T15:50:13.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.222+0000 7f3bab7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3bac1476e0 0x7f3bac151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36078/0 (socket says 172.21.15.123:36078) 2023-03-08T15:50:13.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.222+0000 7f3baaffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3bac0b7900 0x7f3bac140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:13.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.222+0000 7f3bab7fe700 1 -- 172.21.15.123:0/3918179195 learned_addr learned my addr 172.21.15.123:0/3918179195 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:13.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.223+0000 7f3ba9ffb700 1 -- 172.21.15.123:0/3918179195 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189913611 0 0) 0x7f3bac0b59c0 con 0x7f3bac1476e0 2023-03-08T15:50:13.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.223+0000 7f3ba9ffb700 1 -- 172.21.15.123:0/3918179195 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b940035b0 con 0x7f3bac1476e0 2023-03-08T15:50:13.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.223+0000 7f3baaffd700 1 -- 172.21.15.123:0/3918179195 >> v1:172.21.15.175:6789/0 conn(0x7f3bac06aee0 legacy=0x7f3bac146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:13.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.223+0000 7f3baaffd700 1 -- 172.21.15.123:0/3918179195 >> v1:172.21.15.123:6789/0 conn(0x7f3bac1476e0 legacy=0x7f3bac151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:13.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.223+0000 7f3baaffd700 1 -- 172.21.15.123:0/3918179195 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac0b7cd0 con 0x7f3bac0b7900 2023-03-08T15:50:13.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.223+0000 7f3baaffd700 1 --2- 172.21.15.123:0/3918179195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bac0b7900 0x7f3bac140990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000bae0 tx=0x7f3ba000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109e7ff6e94cb519 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:13.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.223+0000 7f3ba9ffb700 1 -- 172.21.15.123:0/3918179195 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba000dc70 con 0x7f3bac0b7900 2023-03-08T15:50:13.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.223+0000 7f3ba9ffb700 1 -- 172.21.15.123:0/3918179195 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba000ddd0 con 0x7f3bac0b7900 2023-03-08T15:50:13.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.223+0000 7f3ba9ffb700 1 -- 172.21.15.123:0/3918179195 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0010670 con 0x7f3bac0b7900 2023-03-08T15:50:13.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.223+0000 7f3bb13a2700 1 -- 172.21.15.123:0/3918179195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bac0b7900 msgr2=0x7f3bac140990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:13.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.223+0000 7f3bb13a2700 1 --2- 172.21.15.123:0/3918179195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bac0b7900 0x7f3bac140990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000bae0 tx=0x7f3ba000bdf0 comp rx=0 tx=0).stop 2023-03-08T15:50:13.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.224+0000 7f3bb13a2700 1 -- 172.21.15.123:0/3918179195 shutdown_connections 2023-03-08T15:50:13.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.224+0000 7f3bb13a2700 1 --2- 172.21.15.123:0/3918179195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bac0b7900 0x7f3bac140990 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:13.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.224+0000 7f3bb13a2700 1 -- 172.21.15.123:0/3918179195 >> 172.21.15.123:0/3918179195 conn(0x7f3bac0bc480 msgr2=0x7f3bac0bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:13.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.224+0000 7f3bb13a2700 1 -- 172.21.15.123:0/3918179195 shutdown_connections 2023-03-08T15:50:13.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.224+0000 7f3bb13a2700 1 -- 172.21.15.123:0/3918179195 wait complete. 2023-03-08T15:50:13.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.225+0000 7f3bb13a2700 1 Processor -- start 2023-03-08T15:50:13.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.225+0000 7f3bb13a2700 1 -- start start 2023-03-08T15:50:13.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.225+0000 7f3bb13a2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bac06aee0 0x7f3bac13ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:13.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.225+0000 7f3bb13a2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac0b7900 0x7f3bac1378d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:13.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.225+0000 7f3bb13a2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bac1476e0 0x7f3bac136390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:13.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.225+0000 7f3bb13a2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac1d1250 con 0x7f3bac1476e0 2023-03-08T15:50:13.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.225+0000 7f3bb13a2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac13f140 con 0x7f3bac06aee0 2023-03-08T15:50:13.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.225+0000 7f3bb13a2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac13c4c0 con 0x7f3bac0b7900 2023-03-08T15:50:13.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.225+0000 7f3bab7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bac1476e0 0x7f3bac136390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:13.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.225+0000 7f3bab7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bac1476e0 0x7f3bac136390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57620/0 (socket says 172.21.15.123:57620) 2023-03-08T15:50:13.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.225+0000 7f3bab7fe700 1 -- 172.21.15.123:0/2456397417 learned_addr learned my addr 172.21.15.123:0/2456397417 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:13.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.226+0000 7f3baaffd700 1 --2- 172.21.15.123:0/2456397417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bac06aee0 0x7f3bac13ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:13.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.226+0000 7f3baa7fc700 1 --2- 172.21.15.123:0/2456397417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac0b7900 0x7f3bac1378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:13.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.226+0000 7f3bab7fe700 1 -- 172.21.15.123:0/2456397417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac0b7900 msgr2=0x7f3bac1378d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:13.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.226+0000 7f3bab7fe700 1 --2- 172.21.15.123:0/2456397417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac0b7900 0x7f3bac1378d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:13.231 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.226+0000 7f3bab7fe700 1 -- 172.21.15.123:0/2456397417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bac06aee0 msgr2=0x7f3bac13ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:13.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.226+0000 7f3bab7fe700 1 --2- 172.21.15.123:0/2456397417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bac06aee0 0x7f3bac13ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:13.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.226+0000 7f3bab7fe700 1 -- 172.21.15.123:0/2456397417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba000b740 con 0x7f3bac1476e0 2023-03-08T15:50:13.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.226+0000 7f3bab7fe700 1 --2- 172.21.15.123:0/2456397417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bac1476e0 0x7f3bac136390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400ca70 tx=0x7f3ba400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:13.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.226+0000 7f3b937fe700 1 -- 172.21.15.123:0/2456397417 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba400a7e0 con 0x7f3bac1476e0 2023-03-08T15:50:13.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.226+0000 7f3b937fe700 1 -- 172.21.15.123:0/2456397417 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba400a940 con 0x7f3bac1476e0 2023-03-08T15:50:13.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.226+0000 7f3b937fe700 1 -- 172.21.15.123:0/2456397417 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba400acf0 con 0x7f3bac1476e0 2023-03-08T15:50:13.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.226+0000 7f3bb13a2700 1 -- 172.21.15.123:0/2456397417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bac0bd360 con 0x7f3bac1476e0 2023-03-08T15:50:13.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.226+0000 7f3bb13a2700 1 -- 172.21.15.123:0/2456397417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac0bd1d0 con 0x7f3bac1476e0 2023-03-08T15:50:13.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.227+0000 7f3bb13a2700 1 -- 172.21.15.123:0/2456397417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac0b8320 con 0x7f3bac1476e0 2023-03-08T15:50:13.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.227+0000 7f3b937fe700 1 -- 172.21.15.123:0/2456397417 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f3ba4010050 con 0x7f3bac1476e0 2023-03-08T15:50:13.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.228+0000 7f3b937fe700 1 --2- 172.21.15.123:0/2456397417 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3b980698d0 0x7f3b9806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:13.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.228+0000 7f3b937fe700 1 -- 172.21.15.123:0/2456397417 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f3ba4087530 con 0x7f3bac1476e0 2023-03-08T15:50:13.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.228+0000 7f3baaffd700 1 --2- 172.21.15.123:0/2456397417 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3b980698d0 0x7f3b9806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:13.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.228+0000 7f3baaffd700 1 --2- 172.21.15.123:0/2456397417 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3b980698d0 0x7f3b9806bd80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000b2c0 tx=0x7f3ba0013000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:13.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.232+0000 7f3b937fe700 1 -- 172.21.15.123:0/2456397417 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f3ba40532a0 con 0x7f3bac1476e0 2023-03-08T15:50:13.418 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:13.417+0000 7f3bb13a2700 1 -- 172.21.15.123:0/2456397417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3bac0b61f0 con 0x7f3bac1476e0 2023-03-08T15:50:14.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.080+0000 7f3b937fe700 1 -- 172.21.15.123:0/2456397417 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3ba40160d0 con 0x7f3bac1476e0 2023-03-08T15:50:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.084+0000 7f3bb13a2700 1 -- 172.21.15.123:0/2456397417 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3b980698d0 msgr2=0x7f3b9806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.084+0000 7f3bb13a2700 1 --2- 172.21.15.123:0/2456397417 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3b980698d0 0x7f3b9806bd80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000b2c0 tx=0x7f3ba0013000 comp rx=0 tx=0).stop 2023-03-08T15:50:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.084+0000 7f3bb13a2700 1 -- 172.21.15.123:0/2456397417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bac1476e0 msgr2=0x7f3bac136390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.084+0000 7f3bb13a2700 1 --2- 172.21.15.123:0/2456397417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bac1476e0 0x7f3bac136390 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400ca70 tx=0x7f3ba400ce30 comp rx=0 tx=0).stop 2023-03-08T15:50:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.084+0000 7f3bb13a2700 1 -- 172.21.15.123:0/2456397417 shutdown_connections 2023-03-08T15:50:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.084+0000 7f3bb13a2700 1 --2- 172.21.15.123:0/2456397417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bac1476e0 0x7f3bac136390 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.084+0000 7f3bb13a2700 1 --2- 172.21.15.123:0/2456397417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bac06aee0 0x7f3bac13ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.084+0000 7f3bb13a2700 1 --2- 172.21.15.123:0/2456397417 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f3b980698d0 0x7f3b9806bd80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.084+0000 7f3bb13a2700 1 --2- 172.21.15.123:0/2456397417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bac0b7900 0x7f3bac1378d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.084+0000 7f3bb13a2700 1 -- 172.21.15.123:0/2456397417 >> 172.21.15.123:0/2456397417 conn(0x7f3bac0bc480 msgr2=0x7f3bac0b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.085+0000 7f3bb13a2700 1 -- 172.21.15.123:0/2456397417 shutdown_connections 2023-03-08T15:50:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.086+0000 7f3bb13a2700 1 -- 172.21.15.123:0/2456397417 wait complete. 2023-03-08T15:50:14.088 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2023-03-08T15:50:14.101 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-03-08T15:50:14.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.225+0000 7fd5f59d7700 1 Processor -- start 2023-03-08T15:50:14.227 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.225+0000 7fd5f59d7700 1 -- start start 2023-03-08T15:50:14.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.226+0000 7fd5f59d7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f00baa70 0x7fd5f00b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:14.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.226+0000 7fd5f59d7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd5f00b9c00 0x7fd5f0151e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:14.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.226+0000 7fd5f59d7700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f00b6f60 con 0x7fd5f00b97b0 2023-03-08T15:50:14.228 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.226+0000 7fd5f59d7700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f00b5650 con 0x7fd5f00b9c00 2023-03-08T15:50:14.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.226+0000 7fd5f59d7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f00b5930 con 0x7fd5f00baa70 2023-03-08T15:50:14.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.226+0000 7fd5ef7fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd5f00b9c00 0x7fd5f0151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:14.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.226+0000 7fd5eeffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f00baa70 0x7fd5f00b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:14.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.226+0000 7fd5eeffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f00baa70 0x7fd5f00b4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:59610/0 (socket says 172.21.15.123:59610) 2023-03-08T15:50:14.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.226+0000 7fd5eeffd700 1 -- 172.21.15.123:0/4029362023 learned_addr learned my addr 172.21.15.123:0/4029362023 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:14.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.227+0000 7fd5eeffd700 1 -- 172.21.15.123:0/4029362023 >> v2:172.21.15.175:3300/0 conn(0x7fd5f00b9c00 msgr2=0x7fd5f0151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:14.229 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.227+0000 7fd5eeffd700 1 --2- 172.21.15.123:0/4029362023 >> v2:172.21.15.175:3300/0 conn(0x7fd5f00b9c00 0x7fd5f0151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.227+0000 7fd5eeffd700 1 -- 172.21.15.123:0/4029362023 >> v1:172.21.15.175:6789/0 conn(0x7fd5f00b97b0 legacy=0x7fd5f0147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.227+0000 7fd5eeffd700 1 -- 172.21.15.123:0/4029362023 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f00b5c10 con 0x7fd5f00baa70 2023-03-08T15:50:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.227+0000 7fd5ef7fe700 1 --2- 172.21.15.123:0/4029362023 >> v2:172.21.15.175:3300/0 conn(0x7fd5f00b9c00 0x7fd5f0151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:50:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.227+0000 7fd5eeffd700 1 --2- 172.21.15.123:0/4029362023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f00baa70 0x7fd5f00b4a70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40098f0 tx=0x7fd5e4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8fbddaf1b4210a5 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.227+0000 7fd5edffb700 1 -- 172.21.15.123:0/4029362023 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4011830 con 0x7fd5f00baa70 2023-03-08T15:50:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.227+0000 7fd5edffb700 1 -- 172.21.15.123:0/4029362023 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e4011990 con 0x7fd5f00baa70 2023-03-08T15:50:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.227+0000 7fd5edffb700 1 -- 172.21.15.123:0/4029362023 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4011d20 con 0x7fd5f00baa70 2023-03-08T15:50:14.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.228+0000 7fd5f59d7700 1 -- 172.21.15.123:0/4029362023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f00baa70 msgr2=0x7fd5f00b4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:14.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.228+0000 7fd5f59d7700 1 --2- 172.21.15.123:0/4029362023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f00baa70 0x7fd5f00b4a70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40098f0 tx=0x7fd5e4009c00 comp rx=0 tx=0).stop 2023-03-08T15:50:14.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.228+0000 7fd5f59d7700 1 -- 172.21.15.123:0/4029362023 shutdown_connections 2023-03-08T15:50:14.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.228+0000 7fd5f59d7700 1 --2- 172.21.15.123:0/4029362023 >> v2:172.21.15.175:3300/0 conn(0x7fd5f00b9c00 0x7fd5f0151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:14.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.228+0000 7fd5f59d7700 1 --2- 172.21.15.123:0/4029362023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f00baa70 0x7fd5f00b4a70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:14.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.228+0000 7fd5f59d7700 1 -- 172.21.15.123:0/4029362023 >> 172.21.15.123:0/4029362023 conn(0x7fd5f00be2d0 msgr2=0x7fd5f00ba0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:14.233 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.228+0000 7fd5f59d7700 1 -- 172.21.15.123:0/4029362023 shutdown_connections 2023-03-08T15:50:14.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.228+0000 7fd5f59d7700 1 -- 172.21.15.123:0/4029362023 wait complete. 2023-03-08T15:50:14.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.229+0000 7fd5f59d7700 1 Processor -- start 2023-03-08T15:50:14.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.229+0000 7fd5f59d7700 1 -- start start 2023-03-08T15:50:14.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.229+0000 7fd5f59d7700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f00b97b0 0x7fd5f01d1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:14.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.229+0000 7fd5f59d7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f00b9c00 0x7fd5f00710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:14.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5f59d7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f00baa70 0x7fd5f01e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:14.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5f59d7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f00715e0 con 0x7fd5f00baa70 2023-03-08T15:50:14.234 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5f59d7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f01d0230 con 0x7fd5f00b9c00 2023-03-08T15:50:14.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5f59d7700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f00b3bc0 con 0x7fd5f00b97b0 2023-03-08T15:50:14.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5ef7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f00baa70 0x7fd5f01e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:14.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5ef7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f00baa70 0x7fd5f01e34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57626/0 (socket says 172.21.15.123:57626) 2023-03-08T15:50:14.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5eeffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f00b97b0 0x7fd5f01d1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:14.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5ef7fe700 1 -- 172.21.15.123:0/3402694949 learned_addr learned my addr 172.21.15.123:0/3402694949 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:14.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5ee7fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f00b9c00 0x7fd5f00710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:14.235 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5ef7fe700 1 -- 172.21.15.123:0/3402694949 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f00b97b0 msgr2=0x7fd5f01d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:14.236 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5ef7fe700 1 --2- 172.21.15.123:0/3402694949 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f00b97b0 0x7fd5f01d1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:14.236 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5ef7fe700 1 -- 172.21.15.123:0/3402694949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f00b9c00 msgr2=0x7fd5f00710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:14.236 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5ef7fe700 1 --2- 172.21.15.123:0/3402694949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f00b9c00 0x7fd5f00710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:14.236 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5ef7fe700 1 -- 172.21.15.123:0/3402694949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e8009a70 con 0x7fd5f00baa70 2023-03-08T15:50:14.236 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5ef7fe700 1 --2- 172.21.15.123:0/3402694949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f00baa70 0x7fd5f01e34a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009eb0 tx=0x7fd5e800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:14.236 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5d7fff700 1 -- 172.21.15.123:0/3402694949 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8009d50 con 0x7fd5f00baa70 2023-03-08T15:50:14.236 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5f59d7700 1 -- 172.21.15.123:0/3402694949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e4009550 con 0x7fd5f00baa70 2023-03-08T15:50:14.236 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.230+0000 7fd5f59d7700 1 -- 172.21.15.123:0/3402694949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f00bae40 con 0x7fd5f00baa70 2023-03-08T15:50:14.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.231+0000 7fd5d7fff700 1 -- 172.21.15.123:0/3402694949 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e800f040 con 0x7fd5f00baa70 2023-03-08T15:50:14.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.231+0000 7fd5d7fff700 1 -- 172.21.15.123:0/3402694949 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e800ceb0 con 0x7fd5f00baa70 2023-03-08T15:50:14.237 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.231+0000 7fd5f59d7700 1 -- 172.21.15.123:0/3402694949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d00052e0 con 0x7fd5f00baa70 2023-03-08T15:50:14.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.232+0000 7fd5d7fff700 1 -- 172.21.15.123:0/3402694949 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fd5e8014480 con 0x7fd5f00baa70 2023-03-08T15:50:14.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.233+0000 7fd5d7fff700 1 --2- 172.21.15.123:0/3402694949 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd5dc069900 0x7fd5dc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:14.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.233+0000 7fd5d7fff700 1 -- 172.21.15.123:0/3402694949 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5710+0+0 (secure 0 0 0) 0x7fd5e8088760 con 0x7fd5f00baa70 2023-03-08T15:50:14.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.233+0000 7fd5eeffd700 1 --2- 172.21.15.123:0/3402694949 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd5dc069900 0x7fd5dc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:14.238 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.233+0000 7fd5eeffd700 1 --2- 172.21.15.123:0/3402694949 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd5dc069900 0x7fd5dc06bdb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4009c40 tx=0x7fd5e4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:14.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.237+0000 7fd5d7fff700 1 -- 172.21.15.123:0/3402694949 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fd5e8054690 con 0x7fd5f00baa70 2023-03-08T15:50:14.423 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:14.422+0000 7fd5f59d7700 1 -- 172.21.15.123:0/3402694949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd5d0005590 con 0x7fd5f00baa70 2023-03-08T15:50:15.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.088+0000 7fd5d7fff700 1 -- 172.21.15.123:0/3402694949 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd5e80180d0 con 0x7fd5f00baa70 2023-03-08T15:50:15.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.091+0000 7fd5f59d7700 1 -- 172.21.15.123:0/3402694949 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd5dc069900 msgr2=0x7fd5dc06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:15.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.091+0000 7fd5f59d7700 1 --2- 172.21.15.123:0/3402694949 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd5dc069900 0x7fd5dc06bdb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4009c40 tx=0x7fd5e4008030 comp rx=0 tx=0).stop 2023-03-08T15:50:15.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.091+0000 7fd5f59d7700 1 -- 172.21.15.123:0/3402694949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f00baa70 msgr2=0x7fd5f01e34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:15.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.091+0000 7fd5f59d7700 1 --2- 172.21.15.123:0/3402694949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f00baa70 0x7fd5f01e34a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009eb0 tx=0x7fd5e800c3a0 comp rx=0 tx=0).stop 2023-03-08T15:50:15.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.091+0000 7fd5f59d7700 1 -- 172.21.15.123:0/3402694949 shutdown_connections 2023-03-08T15:50:15.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.091+0000 7fd5f59d7700 1 --2- 172.21.15.123:0/3402694949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f00baa70 0x7fd5f01e34a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:15.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.091+0000 7fd5f59d7700 1 --2- 172.21.15.123:0/3402694949 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd5dc069900 0x7fd5dc06bdb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:15.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.091+0000 7fd5f59d7700 1 --2- 172.21.15.123:0/3402694949 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5f00b97b0 0x7fd5f01d1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:15.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.091+0000 7fd5f59d7700 1 --2- 172.21.15.123:0/3402694949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5f00b9c00 0x7fd5f00710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:15.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.091+0000 7fd5f59d7700 1 -- 172.21.15.123:0/3402694949 >> 172.21.15.123:0/3402694949 conn(0x7fd5f00be2d0 msgr2=0x7fd5f0146c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:15.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.091+0000 7fd5f59d7700 1 -- 172.21.15.123:0/3402694949 shutdown_connections 2023-03-08T15:50:15.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.091+0000 7fd5f59d7700 1 -- 172.21.15.123:0/3402694949 wait complete. 2023-03-08T15:50:15.094 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2023-03-08T15:50:15.109 INFO:tasks.ceph.mds.a:Restarting daemon 2023-03-08T15:50:15.109 INFO:tasks.ceph.mds.a:Stopping old one... 2023-03-08T15:50:15.110 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-03-08T15:50:15.110 INFO:teuthology.orchestra.run:waiting for 300 2023-03-08T15:50:15.110 INFO:tasks.ceph.mds.c:Restarting daemon 2023-03-08T15:50:15.110 INFO:tasks.ceph.mds.c:Stopping old one... 2023-03-08T15:50:15.111 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-03-08T15:50:15.111 INFO:teuthology.orchestra.run:waiting for 300 2023-03-08T15:50:15.111 INFO:tasks.ceph.mds.b:Restarting daemon 2023-03-08T15:50:15.111 INFO:tasks.ceph.mds.b:Stopping old one... 2023-03-08T15:50:15.111 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-03-08T15:50:15.112 INFO:teuthology.orchestra.run:waiting for 300 2023-03-08T15:50:15.120 INFO:tasks.ceph.mds.a:Stopped 2023-03-08T15:50:15.121 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-03-08T15:50:15.121 INFO:tasks.ceph.mds.c:Stopped 2023-03-08T15:50:15.122 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-03-08T15:50:15.122 INFO:tasks.ceph.mds.b:Stopped 2023-03-08T15:50:15.123 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-03-08T15:50:15.162 INFO:tasks.ceph.mds.a:Started 2023-03-08T15:50:15.162 DEBUG:teuthology.parallel:result is None 2023-03-08T15:50:15.163 INFO:tasks.ceph.mds.c:Started 2023-03-08T15:50:15.163 DEBUG:teuthology.parallel:result is None 2023-03-08T15:50:15.165 INFO:tasks.ceph.mds.b:Started 2023-03-08T15:50:15.165 DEBUG:teuthology.parallel:result is None 2023-03-08T15:50:15.166 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-03-08T15:50:15.244 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2023-03-08T15:50:15.244 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2023-03-08T15:50:15.249 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-03-08T15:50:15.302 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.301+0000 7fea4d48b700 1 Processor -- start 2023-03-08T15:50:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.301+0000 7fea4d48b700 1 -- start start 2023-03-08T15:50:15.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.302+0000 7fea4d48b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea480b3c30 0x7fea48152d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:15.305 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.302+0000 7fea4d48b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea480b7180 con 0x7fea48147510 2023-03-08T15:50:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.302+0000 7fea4d48b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea480bdb30 con 0x7fea48148130 2023-03-08T15:50:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.302+0000 7fea4d48b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea48141cd0 con 0x7fea480b3c30 2023-03-08T15:50:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.302+0000 7fea467fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fea48147510 0x7fea480bd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36098/0 (socket says 172.21.15.123:36098) 2023-03-08T15:50:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.302+0000 7fea467fc700 1 -- 172.21.15.123:0/2551787689 learned_addr learned my addr 172.21.15.123:0/2551787689 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.302+0000 7fea477fe700 1 --2- 172.21.15.123:0/2551787689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea480b3c30 0x7fea48152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.302+0000 7fea45ffb700 1 -- 172.21.15.123:0/2551787689 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794330509 0 0) 0x7fea480b7180 con 0x7fea48147510 2023-03-08T15:50:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.302+0000 7fea45ffb700 1 -- 172.21.15.123:0/2551787689 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea300035b0 con 0x7fea48147510 2023-03-08T15:50:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.302+0000 7fea45ffb700 1 -- 172.21.15.123:0/2551787689 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2647736334 0 0) 0x7fea300035b0 con 0x7fea48147510 2023-03-08T15:50:15.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.302+0000 7fea45ffb700 1 -- 172.21.15.123:0/2551787689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea480b3c30 msgr2=0x7fea48152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:15.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.302+0000 7fea45ffb700 1 --2- 172.21.15.123:0/2551787689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea480b3c30 0x7fea48152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:15.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.302+0000 7fea45ffb700 1 -- 172.21.15.123:0/2551787689 >> v1:172.21.15.175:6789/0 conn(0x7fea48148130 legacy=0x7fea4806b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:15.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.302+0000 7fea45ffb700 1 -- 172.21.15.123:0/2551787689 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea480b8960 con 0x7fea48147510 2023-03-08T15:50:15.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.302+0000 7fea45ffb700 1 -- 172.21.15.123:0/2551787689 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7fea38001670 con 0x7fea48147510 2023-03-08T15:50:15.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea45ffb700 1 -- 172.21.15.123:0/2551787689 >> v1:172.21.15.123:6789/0 conn(0x7fea48147510 legacy=0x7fea480bd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:15.307 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea45ffb700 1 --2- 172.21.15.123:0/2551787689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea480b3c30 0x7fea30003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:15.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea45ffb700 1 --2- 172.21.15.123:0/2551787689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea30003fb0 0x7fea30004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:15.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea45ffb700 1 --2- 172.21.15.123:0/2551787689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea30004d90 0x7fea30005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:15.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea45ffb700 1 -- 172.21.15.123:0/2551787689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea48141cd0 con 0x7fea30004d90 2023-03-08T15:50:15.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea45ffb700 1 -- 172.21.15.123:0/2551787689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3000bb80 con 0x7fea30003fb0 2023-03-08T15:50:15.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea45ffb700 1 -- 172.21.15.123:0/2551787689 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3000df50 con 0x7fea480b3c30 2023-03-08T15:50:15.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea477fe700 1 --2- 172.21.15.123:0/2551787689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea30004d90 0x7fea30005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:15.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea467fc700 1 --2- 172.21.15.123:0/2551787689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea30003fb0 0x7fea30004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:15.308 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea46ffd700 1 --2- 172.21.15.123:0/2551787689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea480b3c30 0x7fea30003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:15.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea477fe700 1 -- 172.21.15.123:0/2551787689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea480b3c30 msgr2=0x7fea30003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:15.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea477fe700 1 --2- 172.21.15.123:0/2551787689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea480b3c30 0x7fea30003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:15.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea477fe700 1 -- 172.21.15.123:0/2551787689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea30003fb0 msgr2=0x7fea30004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:15.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea477fe700 1 --2- 172.21.15.123:0/2551787689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea30003fb0 0x7fea30004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:15.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea477fe700 1 -- 172.21.15.123:0/2551787689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea300035b0 con 0x7fea30004d90 2023-03-08T15:50:15.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea477fe700 1 --2- 172.21.15.123:0/2551787689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea30004d90 0x7fea30005200 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fea40009f90 tx=0x7fea30005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1e09c69db38059 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:15.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea45ffb700 1 -- 172.21.15.123:0/2551787689 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4000ec30 con 0x7fea30004d90 2023-03-08T15:50:15.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea45ffb700 1 -- 172.21.15.123:0/2551787689 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4000f040 con 0x7fea30004d90 2023-03-08T15:50:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.303+0000 7fea45ffb700 1 -- 172.21.15.123:0/2551787689 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40014480 con 0x7fea30004d90 2023-03-08T15:50:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.304+0000 7fea4d48b700 1 -- 172.21.15.123:0/2551787689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea30004d90 msgr2=0x7fea30005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.304+0000 7fea4d48b700 1 --2- 172.21.15.123:0/2551787689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea30004d90 0x7fea30005200 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fea40009f90 tx=0x7fea30005880 comp rx=0 tx=0).stop 2023-03-08T15:50:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.304+0000 7fea477fe700 1 -- 172.21.15.123:0/2551787689 reap_dead start 2023-03-08T15:50:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.304+0000 7fea4d48b700 1 -- 172.21.15.123:0/2551787689 shutdown_connections 2023-03-08T15:50:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.304+0000 7fea4d48b700 1 -- 172.21.15.123:0/2551787689 >> 172.21.15.123:0/2551787689 conn(0x7fea480ba3c0 msgr2=0x7fea480bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.304+0000 7fea4d48b700 1 -- 172.21.15.123:0/2551787689 shutdown_connections 2023-03-08T15:50:15.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.304+0000 7fea4d48b700 1 -- 172.21.15.123:0/2551787689 wait complete. 2023-03-08T15:50:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.305+0000 7fea4d48b700 1 Processor -- start 2023-03-08T15:50:15.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.305+0000 7fea4d48b700 1 -- start start 2023-03-08T15:50:15.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea4d48b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea30004d90 0x7fea480bbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:15.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea4d48b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea481e3d10 0x7fea481cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:15.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea4d48b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea481cf630 0x7fea480b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:15.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea4d48b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea480b8c40 con 0x7fea30004d90 2023-03-08T15:50:15.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea4d48b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea480bc520 con 0x7fea481e3d10 2023-03-08T15:50:15.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea4d48b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea480b5e20 con 0x7fea481cf630 2023-03-08T15:50:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea46ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea30004d90 0x7fea480bbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea46ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea30004d90 0x7fea480bbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57668/0 (socket says 172.21.15.123:57668) 2023-03-08T15:50:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea46ffd700 1 -- 172.21.15.123:0/3406090351 learned_addr learned my addr 172.21.15.123:0/3406090351 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea467fc700 1 --2- 172.21.15.123:0/3406090351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea481e3d10 0x7fea481cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea477fe700 1 --2- 172.21.15.123:0/3406090351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea481cf630 0x7fea480b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea46ffd700 1 -- 172.21.15.123:0/3406090351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea481cf630 msgr2=0x7fea480b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea46ffd700 1 --2- 172.21.15.123:0/3406090351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea481cf630 0x7fea480b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea46ffd700 1 -- 172.21.15.123:0/3406090351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea481e3d10 msgr2=0x7fea481cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea46ffd700 1 --2- 172.21.15.123:0/3406090351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea481e3d10 0x7fea481cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea46ffd700 1 -- 172.21.15.123:0/3406090351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea48071eb0 con 0x7fea30004d90 2023-03-08T15:50:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea46ffd700 1 --2- 172.21.15.123:0/3406090351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea30004d90 0x7fea480bbfe0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00f820 tx=0x7fea3c00fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea2f7fe700 1 -- 172.21.15.123:0/3406090351 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0052e0 con 0x7fea30004d90 2023-03-08T15:50:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea2f7fe700 1 -- 172.21.15.123:0/3406090351 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3c005440 con 0x7fea30004d90 2023-03-08T15:50:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea4d48b700 1 -- 172.21.15.123:0/3406090351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea480b6e10 con 0x7fea30004d90 2023-03-08T15:50:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea2f7fe700 1 -- 172.21.15.123:0/3406090351 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0038c0 con 0x7fea30004d90 2023-03-08T15:50:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.306+0000 7fea4d48b700 1 -- 172.21.15.123:0/3406090351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea48072040 con 0x7fea30004d90 2023-03-08T15:50:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.307+0000 7fea4d48b700 1 -- 172.21.15.123:0/3406090351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea481e3620 con 0x7fea30004d90 2023-03-08T15:50:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.308+0000 7fea2f7fe700 1 -- 172.21.15.123:0/3406090351 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fea3c003a20 con 0x7fea30004d90 2023-03-08T15:50:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.308+0000 7fea2f7fe700 1 --2- 172.21.15.123:0/3406090351 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fea340698d0 0x7fea3406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.308+0000 7fea2f7fe700 1 -- 172.21.15.123:0/3406090351 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fea3c0871e0 con 0x7fea30004d90 2023-03-08T15:50:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.308+0000 7fea467fc700 1 --2- 172.21.15.123:0/3406090351 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fea340698d0 0x7fea3406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.308+0000 7fea467fc700 1 --2- 172.21.15.123:0/3406090351 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fea340698d0 0x7fea3406bd80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fea380017a0 tx=0x7fea380015f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.312+0000 7fea2f7fe700 1 -- 172.21.15.123:0/3406090351 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fea3c0532b0 con 0x7fea30004d90 2023-03-08T15:50:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:15.518+0000 7fea4d48b700 1 -- 172.21.15.123:0/3406090351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fea480744c0 con 0x7fea30004d90 2023-03-08T15:50:16.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.283+0000 7fea2f7fe700 1 -- 172.21.15.123:0/3406090351 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7fea3c003cb0 con 0x7fea30004d90 2023-03-08T15:50:16.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.285+0000 7fea4d48b700 1 -- 172.21.15.123:0/3406090351 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fea340698d0 msgr2=0x7fea3406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:16.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.285+0000 7fea4d48b700 1 --2- 172.21.15.123:0/3406090351 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fea340698d0 0x7fea3406bd80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fea380017a0 tx=0x7fea380015f0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.285+0000 7fea4d48b700 1 -- 172.21.15.123:0/3406090351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea30004d90 msgr2=0x7fea480bbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:16.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.285+0000 7fea4d48b700 1 --2- 172.21.15.123:0/3406090351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea30004d90 0x7fea480bbfe0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00f820 tx=0x7fea3c00fb30 comp rx=0 tx=0).stop 2023-03-08T15:50:16.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.285+0000 7fea4d48b700 1 -- 172.21.15.123:0/3406090351 shutdown_connections 2023-03-08T15:50:16.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.285+0000 7fea4d48b700 1 --2- 172.21.15.123:0/3406090351 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fea340698d0 0x7fea3406bd80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.285+0000 7fea4d48b700 1 --2- 172.21.15.123:0/3406090351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea481cf630 0x7fea480b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.285+0000 7fea4d48b700 1 --2- 172.21.15.123:0/3406090351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea30004d90 0x7fea480bbfe0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.285+0000 7fea4d48b700 1 --2- 172.21.15.123:0/3406090351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea481e3d10 0x7fea481cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.285+0000 7fea4d48b700 1 -- 172.21.15.123:0/3406090351 >> 172.21.15.123:0/3406090351 conn(0x7fea480ba3c0 msgr2=0x7fea480b73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:16.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.285+0000 7fea4d48b700 1 -- 172.21.15.123:0/3406090351 shutdown_connections 2023-03-08T15:50:16.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.286+0000 7fea4d48b700 1 -- 172.21.15.123:0/3406090351 wait complete. 2023-03-08T15:50:16.290 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2023-03-08T15:50:16.302 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-03-08T15:50:16.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.422+0000 7f2b304a2700 1 Processor -- start 2023-03-08T15:50:16.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.422+0000 7f2b304a2700 1 -- start start 2023-03-08T15:50:16.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.423+0000 7f2b304a2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b280b6a00 0x7f2b2806b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:16.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.423+0000 7f2b304a2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b280bd420 con 0x7f2b280b3c50 2023-03-08T15:50:16.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.423+0000 7f2b304a2700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b28071cd0 con 0x7f2b28149080 2023-03-08T15:50:16.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.423+0000 7f2b304a2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28142cc0 con 0x7f2b280b6a00 2023-03-08T15:50:16.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.423+0000 7f2b2da3d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2b280b3c50 0x7f2b28148970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51838/0 (socket says 172.21.15.123:51838) 2023-03-08T15:50:16.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.423+0000 7f2b2da3d700 1 -- 172.21.15.123:0/1251860347 learned_addr learned my addr 172.21.15.123:0/1251860347 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:16.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.423+0000 7f2b2e23e700 1 --2- 172.21.15.123:0/1251860347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b280b6a00 0x7f2b2806b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:16.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.423+0000 7f2b2d23c700 1 -- 172.21.15.123:0/1251860347 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907364913 0 0) 0x7f2b280bd420 con 0x7f2b280b3c50 2023-03-08T15:50:16.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.424+0000 7f2b2d23c700 1 -- 172.21.15.123:0/1251860347 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b140035b0 con 0x7f2b280b3c50 2023-03-08T15:50:16.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.424+0000 7f2b2d23c700 1 -- 172.21.15.123:0/1251860347 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929972436 0 0) 0x7f2b28071cd0 con 0x7f2b28149080 2023-03-08T15:50:16.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.424+0000 7f2b2d23c700 1 -- 172.21.15.123:0/1251860347 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b280bd420 con 0x7f2b28149080 2023-03-08T15:50:16.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.424+0000 7f2b2d23c700 1 -- 172.21.15.123:0/1251860347 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 461179780 0 0) 0x7f2b140035b0 con 0x7f2b280b3c50 2023-03-08T15:50:16.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.424+0000 7f2b2e23e700 1 -- 172.21.15.123:0/1251860347 >> v1:172.21.15.175:6789/0 conn(0x7f2b28149080 legacy=0x7f2b28152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:16.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.424+0000 7f2b2e23e700 1 -- 172.21.15.123:0/1251860347 >> v1:172.21.15.123:6789/0 conn(0x7f2b280b3c50 legacy=0x7f2b28148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:16.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.424+0000 7f2b2e23e700 1 -- 172.21.15.123:0/1251860347 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b280bd670 con 0x7f2b280b6a00 2023-03-08T15:50:16.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.424+0000 7f2b2e23e700 1 --2- 172.21.15.123:0/1251860347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b280b6a00 0x7f2b2806b260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009870 tx=0x7f2b18009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7791215bd43e9df server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:16.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.424+0000 7f2b2d23c700 1 -- 172.21.15.123:0/1251860347 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24001670 con 0x7f2b280b6a00 2023-03-08T15:50:16.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.424+0000 7f2b2d23c700 1 -- 172.21.15.123:0/1251860347 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b18004030 con 0x7f2b280b6a00 2023-03-08T15:50:16.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.424+0000 7f2b2d23c700 1 -- 172.21.15.123:0/1251860347 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b180043a0 con 0x7f2b280b6a00 2023-03-08T15:50:16.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.425+0000 7f2b304a2700 1 -- 172.21.15.123:0/1251860347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b280b6a00 msgr2=0x7f2b2806b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:16.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.425+0000 7f2b304a2700 1 --2- 172.21.15.123:0/1251860347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b280b6a00 0x7f2b2806b260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009870 tx=0x7f2b18009b80 comp rx=0 tx=0).stop 2023-03-08T15:50:16.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.425+0000 7f2b304a2700 1 -- 172.21.15.123:0/1251860347 shutdown_connections 2023-03-08T15:50:16.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.425+0000 7f2b304a2700 1 --2- 172.21.15.123:0/1251860347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b280b6a00 0x7f2b2806b260 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.425+0000 7f2b304a2700 1 -- 172.21.15.123:0/1251860347 >> 172.21.15.123:0/1251860347 conn(0x7f2b280ba3c0 msgr2=0x7f2b280bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:16.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.425+0000 7f2b304a2700 1 -- 172.21.15.123:0/1251860347 shutdown_connections 2023-03-08T15:50:16.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.425+0000 7f2b304a2700 1 -- 172.21.15.123:0/1251860347 wait complete. 2023-03-08T15:50:16.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.426+0000 7f2b304a2700 1 Processor -- start 2023-03-08T15:50:16.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.426+0000 7f2b304a2700 1 -- start start 2023-03-08T15:50:16.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.426+0000 7f2b304a2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b280b3c50 0x7f2b28145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:16.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.426+0000 7f2b304a2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b280b6a00 0x7f2b28144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:16.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.426+0000 7f2b304a2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b28149080 0x7f2b281ddf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:16.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.426+0000 7f2b304a2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28145e90 con 0x7f2b280b3c50 2023-03-08T15:50:16.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.426+0000 7f2b304a2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28143800 con 0x7f2b280b6a00 2023-03-08T15:50:16.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.426+0000 7f2b304a2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b281ce780 con 0x7f2b28149080 2023-03-08T15:50:16.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.426+0000 7f2b2e23e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b280b3c50 0x7f2b28145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:16.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.427+0000 7f2b2e23e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b280b3c50 0x7f2b28145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36520/0 (socket says 172.21.15.123:36520) 2023-03-08T15:50:16.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.427+0000 7f2b2e23e700 1 -- 172.21.15.123:0/557586801 learned_addr learned my addr 172.21.15.123:0/557586801 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:16.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.427+0000 7f2b2ea3f700 1 --2- 172.21.15.123:0/557586801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b28149080 0x7f2b281ddf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:16.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.427+0000 7f2b2da3d700 1 --2- 172.21.15.123:0/557586801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b280b6a00 0x7f2b28144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:16.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.427+0000 7f2b2e23e700 1 -- 172.21.15.123:0/557586801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b28149080 msgr2=0x7f2b281ddf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:16.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.427+0000 7f2b2e23e700 1 --2- 172.21.15.123:0/557586801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b28149080 0x7f2b281ddf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.427+0000 7f2b2e23e700 1 -- 172.21.15.123:0/557586801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b280b6a00 msgr2=0x7f2b28144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:16.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.427+0000 7f2b2e23e700 1 --2- 172.21.15.123:0/557586801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b280b6a00 0x7f2b28144a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.427+0000 7f2b2e23e700 1 -- 172.21.15.123:0/557586801 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b180094a0 con 0x7f2b280b3c50 2023-03-08T15:50:16.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.427+0000 7f2b2e23e700 1 --2- 172.21.15.123:0/557586801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b280b3c50 0x7f2b28145950 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2b18000c00 tx=0x7f2b18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:16.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.427+0000 7f2b1effd700 1 -- 172.21.15.123:0/557586801 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18003e40 con 0x7f2b280b3c50 2023-03-08T15:50:16.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.427+0000 7f2b1effd700 1 -- 172.21.15.123:0/557586801 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1801f070 con 0x7f2b280b3c50 2023-03-08T15:50:16.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.427+0000 7f2b304a2700 1 -- 172.21.15.123:0/557586801 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b280bda00 con 0x7f2b280b3c50 2023-03-08T15:50:16.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.427+0000 7f2b1effd700 1 -- 172.21.15.123:0/557586801 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18011870 con 0x7f2b280b3c50 2023-03-08T15:50:16.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.427+0000 7f2b304a2700 1 -- 172.21.15.123:0/557586801 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b28071f20 con 0x7f2b280b3c50 2023-03-08T15:50:16.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.428+0000 7f2b304a2700 1 -- 172.21.15.123:0/557586801 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b280b7090 con 0x7f2b280b3c50 2023-03-08T15:50:16.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.428+0000 7f2b1effd700 1 -- 172.21.15.123:0/557586801 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f2b18017020 con 0x7f2b280b3c50 2023-03-08T15:50:16.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.429+0000 7f2b1effd700 1 --2- 172.21.15.123:0/557586801 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f2b0c0698d0 0x7f2b0c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:16.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.429+0000 7f2b1effd700 1 -- 172.21.15.123:0/557586801 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2b18021070 con 0x7f2b280b3c50 2023-03-08T15:50:16.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.429+0000 7f2b2da3d700 1 --2- 172.21.15.123:0/557586801 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f2b0c0698d0 0x7f2b0c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:16.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.429+0000 7f2b2da3d700 1 --2- 172.21.15.123:0/557586801 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f2b0c0698d0 0x7f2b0c06bd80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2b281d2540 tx=0x7f2b24001590 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:16.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.433+0000 7f2b1effd700 1 -- 172.21.15.123:0/557586801 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f2b18054d60 con 0x7f2b280b3c50 2023-03-08T15:50:16.698 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.696+0000 7f2b304a2700 1 -- 172.21.15.123:0/557586801 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2b280744c0 con 0x7f2b280b3c50 2023-03-08T15:50:16.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.697+0000 7f2b1effd700 1 -- 172.21.15.123:0/557586801 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+5491 (secure 0 0 0) 0x7f2b18058380 con 0x7f2b280b3c50 2023-03-08T15:50:16.699 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:16.700 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2023-03-08T15:50:16.700 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2023-03-08T15:50:16.700 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.700 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2023-03-08T15:50:16.700 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBZrghkWNZ4EBAAMA2U3kpQfOu1QQIrwfP1xw==", 2023-03-08T15:50:16.700 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.700 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2023-03-08T15:50:16.701 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2023-03-08T15:50:16.701 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2023-03-08T15:50:16.701 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-03-08T15:50:16.701 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.701 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.701 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.701 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2023-03-08T15:50:16.702 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBZrghk6xelHBAAQ5A68T67cGRq9xmLqpr8bQ==", 2023-03-08T15:50:16.702 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.702 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2023-03-08T15:50:16.702 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2023-03-08T15:50:16.702 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2023-03-08T15:50:16.702 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-03-08T15:50:16.702 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.702 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.703 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.703 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2023-03-08T15:50:16.703 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBZrghkE4O7FxAAKebPQz7wEXV5SXPt2XSF9Q==", 2023-03-08T15:50:16.703 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.703 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2023-03-08T15:50:16.703 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2023-03-08T15:50:16.703 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2023-03-08T15:50:16.704 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-03-08T15:50:16.704 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.704 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.704 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.704 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2023-03-08T15:50:16.704 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBcrghkg5A+MhAAUxJGw6XMtw2I2nY7prkHzA==", 2023-03-08T15:50:16.704 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.704 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-03-08T15:50:16.705 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-03-08T15:50:16.705 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-03-08T15:50:16.705 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.705 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.705 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.705 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2023-03-08T15:50:16.705 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBfrghkjMPIMBAAJBSVelYPAZ2sSjF120fmIQ==", 2023-03-08T15:50:16.706 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.706 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-03-08T15:50:16.706 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-03-08T15:50:16.706 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-03-08T15:50:16.706 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.706 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.706 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.707 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2023-03-08T15:50:16.707 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBirghkIKXWLhAA98rDwuV96f0fdkxaxxeyjw==", 2023-03-08T15:50:16.707 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.707 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-03-08T15:50:16.707 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-03-08T15:50:16.707 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-03-08T15:50:16.707 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.707 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.708 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.708 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2023-03-08T15:50:16.708 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBlrghk+ZNrLRAAz3JzCAplasJVWClv10lr1w==", 2023-03-08T15:50:16.708 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.708 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-03-08T15:50:16.708 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-03-08T15:50:16.708 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-03-08T15:50:16.708 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.709 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.709 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.709 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2023-03-08T15:50:16.709 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBrrghk31xXKBAAnWGXIH40ZFPDCMjK6Sg8tg==", 2023-03-08T15:50:16.709 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.709 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-03-08T15:50:16.709 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-03-08T15:50:16.710 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-03-08T15:50:16.710 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.710 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.710 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.710 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2023-03-08T15:50:16.710 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBurghknLb4JhAAcDyzC73+0aMhsqrP0c0a2g==", 2023-03-08T15:50:16.710 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.711 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-03-08T15:50:16.711 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-03-08T15:50:16.711 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-03-08T15:50:16.711 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.711 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.711 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.711 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2023-03-08T15:50:16.711 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBxrghk+kT8JBAAnT9Y2A+AmmAmy0rPBsegMA==", 2023-03-08T15:50:16.712 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.712 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-03-08T15:50:16.712 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-03-08T15:50:16.712 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-03-08T15:50:16.712 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.712 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.712 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.712 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2023-03-08T15:50:16.713 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQB0rghkr4EVJBAAFxJPLa5xZ+WYyJGbJbbiww==", 2023-03-08T15:50:16.713 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.713 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2023-03-08T15:50:16.713 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2023-03-08T15:50:16.713 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-03-08T15:50:16.713 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.713 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.714 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.714 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2023-03-08T15:50:16.714 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBZrghkEZl9JxAAzJi2qJ/oIe4AzvPC2aiVjw==", 2023-03-08T15:50:16.714 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.714 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2023-03-08T15:50:16.714 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2023-03-08T15:50:16.715 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2023-03-08T15:50:16.715 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2023-03-08T15:50:16.715 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.715 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.715 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.715 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2023-03-08T15:50:16.715 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBYrghkBXe4HRAAQ7OV7ftTtz+Ijw9yEcu/xg==", 2023-03-08T15:50:16.716 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.716 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2023-03-08T15:50:16.716 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2023-03-08T15:50:16.716 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2023-03-08T15:50:16.716 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-03-08T15:50:16.716 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.716 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.716 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.717 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-mds", 2023-03-08T15:50:16.717 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQB6rghkfNywBBAAUYniDGv1ICLpmj3qamiPcw==", 2023-03-08T15:50:16.717 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.717 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-mds" 2023-03-08T15:50:16.717 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.717 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.718 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.718 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-mgr", 2023-03-08T15:50:16.718 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQB6rghkbOqwBBAA1rqFgEfbNPtpFmINIp45lA==", 2023-03-08T15:50:16.718 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.718 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-mgr" 2023-03-08T15:50:16.718 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.718 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.719 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.719 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-osd", 2023-03-08T15:50:16.719 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQB6rghkCvWwBBAA94nMUQS/QXCacGOwd6oGDw==", 2023-03-08T15:50:16.719 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.719 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-osd" 2023-03-08T15:50:16.719 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.719 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.719 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.720 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-rbd", 2023-03-08T15:50:16.720 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQB6rghkl/6wBBAAsdfjILHsnD7oQPEuMX/sLQ==", 2023-03-08T15:50:16.720 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.720 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-rbd" 2023-03-08T15:50:16.720 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.720 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.720 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.721 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-03-08T15:50:16.721 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQB6rghk6wWxBBAA7gfncvDAV2nXUjgeUSCVFg==", 2023-03-08T15:50:16.721 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.721 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-03-08T15:50:16.721 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.721 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.721 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.722 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-rgw", 2023-03-08T15:50:16.722 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQB6rghkPQ2xBBAAWyifkM8du2ztLoNQmpZ4Cg==", 2023-03-08T15:50:16.722 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.722 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-rgw" 2023-03-08T15:50:16.722 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.722 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.722 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.723 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2023-03-08T15:50:16.723 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBZrghkwzIjDRAAklXNLBhbi3AAPfOTv9ZSNg==", 2023-03-08T15:50:16.723 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.723 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2023-03-08T15:50:16.723 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2023-03-08T15:50:16.723 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-03-08T15:50:16.723 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.724 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:16.724 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:16.724 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2023-03-08T15:50:16.724 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBZrghkfi9QCBAATBmbzLj7Ed/rYrsrshuZ+Q==", 2023-03-08T15:50:16.724 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2023-03-08T15:50:16.724 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2023-03-08T15:50:16.724 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2023-03-08T15:50:16.725 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2023-03-08T15:50:16.725 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.725 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:16.725 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2023-03-08T15:50:16.725 INFO:teuthology.orchestra.run.smithi123.stdout:} 2023-03-08T15:50:16.726 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.699+0000 7f2b304a2700 1 -- 172.21.15.123:0/557586801 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f2b0c0698d0 msgr2=0x7f2b0c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:16.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.699+0000 7f2b304a2700 1 --2- 172.21.15.123:0/557586801 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f2b0c0698d0 0x7f2b0c06bd80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2b281d2540 tx=0x7f2b24001590 comp rx=0 tx=0).stop 2023-03-08T15:50:16.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.699+0000 7f2b304a2700 1 -- 172.21.15.123:0/557586801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b280b3c50 msgr2=0x7f2b28145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:16.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.699+0000 7f2b304a2700 1 --2- 172.21.15.123:0/557586801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b280b3c50 0x7f2b28145950 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2b18000c00 tx=0x7f2b18004750 comp rx=0 tx=0).stop 2023-03-08T15:50:16.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.699+0000 7f2b304a2700 1 -- 172.21.15.123:0/557586801 shutdown_connections 2023-03-08T15:50:16.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.699+0000 7f2b304a2700 1 --2- 172.21.15.123:0/557586801 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f2b0c0698d0 0x7f2b0c06bd80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.727 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.699+0000 7f2b304a2700 1 --2- 172.21.15.123:0/557586801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b28149080 0x7f2b281ddf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.699+0000 7f2b304a2700 1 --2- 172.21.15.123:0/557586801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b280b3c50 0x7f2b28145950 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.699+0000 7f2b304a2700 1 --2- 172.21.15.123:0/557586801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b280b6a00 0x7f2b28144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.699+0000 7f2b304a2700 1 -- 172.21.15.123:0/557586801 >> 172.21.15.123:0/557586801 conn(0x7f2b280ba3c0 msgr2=0x7f2b28146550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:16.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.699+0000 7f2b304a2700 1 -- 172.21.15.123:0/557586801 shutdown_connections 2023-03-08T15:50:16.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.699+0000 7f2b304a2700 1 -- 172.21.15.123:0/557586801 wait complete. 2023-03-08T15:50:16.728 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-03-08T15:50:16.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.847+0000 7f80247cb700 1 Processor -- start 2023-03-08T15:50:16.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.847+0000 7f80247cb700 1 -- start start 2023-03-08T15:50:16.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.847+0000 7f80247cb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f801c06fef0 0x7f801c14ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:16.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f80247cb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f801c14b250 0x7f801c155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:16.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f80247cb700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801c14b6f0 con 0x7f801c147e50 2023-03-08T15:50:16.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f80247cb700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801c06a960 con 0x7f801c06fef0 2023-03-08T15:50:16.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f80247cb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801c14a810 con 0x7f801c14b250 2023-03-08T15:50:16.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f8021d66700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f801c06fef0 0x7f801c14ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:16.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f8022567700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f801c147e50 0x7f801c06a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51840/0 (socket says 172.21.15.123:51840) 2023-03-08T15:50:16.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f8022567700 1 -- 172.21.15.123:0/460162376 learned_addr learned my addr 172.21.15.123:0/460162376 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:16.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f8021d66700 1 -- 172.21.15.123:0/460162376 >> v2:172.21.15.175:3300/0 conn(0x7f801c14b250 msgr2=0x7f801c155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:16.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f8021d66700 1 --2- 172.21.15.123:0/460162376 >> v2:172.21.15.175:3300/0 conn(0x7f801c14b250 0x7f801c155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f8021d66700 1 -- 172.21.15.123:0/460162376 >> v1:172.21.15.123:6789/0 conn(0x7f801c147e50 legacy=0x7f801c06a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:16.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f8021d66700 1 -- 172.21.15.123:0/460162376 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c071a40 con 0x7f801c06fef0 2023-03-08T15:50:16.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f8021565700 1 -- 172.21.15.123:0/460162376 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825869695 0 0) 0x7f801c14b6f0 con 0x7f801c147e50 2023-03-08T15:50:16.852 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f8021d66700 1 --2- 172.21.15.123:0/460162376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801c06fef0 0x7f801c14ad10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f801c06f810 tx=0x7f800c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583a6191e0cf4b4d server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:16.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f8021565700 1 -- 172.21.15.123:0/460162376 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c011830 con 0x7f801c06fef0 2023-03-08T15:50:16.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f8021565700 1 -- 172.21.15.123:0/460162376 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c011990 con 0x7f801c06fef0 2023-03-08T15:50:16.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.848+0000 7f8021565700 1 -- 172.21.15.123:0/460162376 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c011d20 con 0x7f801c06fef0 2023-03-08T15:50:16.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.849+0000 7f80247cb700 1 -- 172.21.15.123:0/460162376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801c06fef0 msgr2=0x7f801c14ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:16.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.849+0000 7f80247cb700 1 --2- 172.21.15.123:0/460162376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801c06fef0 0x7f801c14ad10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f801c06f810 tx=0x7f800c009b20 comp rx=0 tx=0).stop 2023-03-08T15:50:16.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.849+0000 7f80247cb700 1 -- 172.21.15.123:0/460162376 shutdown_connections 2023-03-08T15:50:16.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.849+0000 7f80247cb700 1 --2- 172.21.15.123:0/460162376 >> v2:172.21.15.175:3300/0 conn(0x7f801c14b250 0x7f801c155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.849+0000 7f80247cb700 1 --2- 172.21.15.123:0/460162376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801c06fef0 0x7f801c14ad10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.849+0000 7f80247cb700 1 -- 172.21.15.123:0/460162376 >> 172.21.15.123:0/460162376 conn(0x7f801c06b360 msgr2=0x7f801c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:16.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.849+0000 7f80247cb700 1 -- 172.21.15.123:0/460162376 shutdown_connections 2023-03-08T15:50:16.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.849+0000 7f80247cb700 1 -- 172.21.15.123:0/460162376 wait complete. 2023-03-08T15:50:16.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.850+0000 7f80247cb700 1 Processor -- start 2023-03-08T15:50:16.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.850+0000 7f80247cb700 1 -- start start 2023-03-08T15:50:16.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.850+0000 7f80247cb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801c06fef0 0x7f801c1e2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:16.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.850+0000 7f80247cb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801c147e50 0x7f801c143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:16.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.850+0000 7f80247cb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f801c14b250 0x7f801c145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:16.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.850+0000 7f80247cb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c143d40 con 0x7f801c147e50 2023-03-08T15:50:16.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.850+0000 7f80247cb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c0b45f0 con 0x7f801c14b250 2023-03-08T15:50:16.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.850+0000 7f80247cb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801c14deb0 con 0x7f801c06fef0 2023-03-08T15:50:16.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f8021d66700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801c147e50 0x7f801c143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:16.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f8021d66700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801c147e50 0x7f801c143800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36548/0 (socket says 172.21.15.123:36548) 2023-03-08T15:50:16.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f8021d66700 1 -- 172.21.15.123:0/1720214973 learned_addr learned my addr 172.21.15.123:0/1720214973 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:16.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f8022d68700 1 --2- 172.21.15.123:0/1720214973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f801c14b250 0x7f801c145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:16.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f8022567700 1 --2- 172.21.15.123:0/1720214973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801c06fef0 0x7f801c1e2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:16.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f8021d66700 1 -- 172.21.15.123:0/1720214973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801c06fef0 msgr2=0x7f801c1e2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:16.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f8021d66700 1 --2- 172.21.15.123:0/1720214973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801c06fef0 0x7f801c1e2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f8021d66700 1 -- 172.21.15.123:0/1720214973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f801c14b250 msgr2=0x7f801c145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:16.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f8021d66700 1 --2- 172.21.15.123:0/1720214973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f801c14b250 0x7f801c145e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:16.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f8021d66700 1 -- 172.21.15.123:0/1720214973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c0094a0 con 0x7f801c147e50 2023-03-08T15:50:16.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f8022567700 1 --2- 172.21.15.123:0/1720214973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801c06fef0 0x7f801c1e2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:16.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f8021d66700 1 --2- 172.21.15.123:0/1720214973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801c147e50 0x7f801c143800 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f800c0090b0 tx=0x7f800c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:16.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f8012ffd700 1 -- 172.21.15.123:0/1720214973 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c0038a0 con 0x7f801c147e50 2023-03-08T15:50:16.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f8012ffd700 1 -- 172.21.15.123:0/1720214973 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c01f070 con 0x7f801c147e50 2023-03-08T15:50:16.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f8012ffd700 1 -- 172.21.15.123:0/1720214973 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c003c60 con 0x7f801c147e50 2023-03-08T15:50:16.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f80247cb700 1 -- 172.21.15.123:0/1720214973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801c072000 con 0x7f801c147e50 2023-03-08T15:50:16.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.851+0000 7f80247cb700 1 -- 172.21.15.123:0/1720214973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801c071d20 con 0x7f801c147e50 2023-03-08T15:50:16.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.852+0000 7f80247cb700 1 -- 172.21.15.123:0/1720214973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801c148220 con 0x7f801c147e50 2023-03-08T15:50:16.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.852+0000 7f8012ffd700 1 -- 172.21.15.123:0/1720214973 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f800c00f050 con 0x7f801c147e50 2023-03-08T15:50:16.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.853+0000 7f8012ffd700 1 --2- 172.21.15.123:0/1720214973 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f80000698d0 0x7f800006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:16.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.853+0000 7f8012ffd700 1 -- 172.21.15.123:0/1720214973 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f800c021070 con 0x7f801c147e50 2023-03-08T15:50:16.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.853+0000 7f8022567700 1 --2- 172.21.15.123:0/1720214973 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f80000698d0 0x7f800006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:16.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.853+0000 7f8022567700 1 --2- 172.21.15.123:0/1720214973 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f80000698d0 0x7f800006bd80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8018000f60 tx=0x7f8018009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:16.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:16.857+0000 7f8012ffd700 1 -- 172.21.15.123:0/1720214973 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f800c054ea0 con 0x7f801c147e50 2023-03-08T15:50:17.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.119+0000 7f80247cb700 1 -- 172.21.15.123:0/1720214973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f801c0744c0 con 0x7f801c147e50 2023-03-08T15:50:17.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.123+0000 7f8012ffd700 1 -- 172.21.15.123:0/1720214973 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f800c02b0a0 con 0x7f801c147e50 2023-03-08T15:50:17.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.125+0000 7f80247cb700 1 -- 172.21.15.123:0/1720214973 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f80000698d0 msgr2=0x7f800006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:17.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.125+0000 7f80247cb700 1 --2- 172.21.15.123:0/1720214973 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f80000698d0 0x7f800006bd80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8018000f60 tx=0x7f8018009040 comp rx=0 tx=0).stop 2023-03-08T15:50:17.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.125+0000 7f80247cb700 1 -- 172.21.15.123:0/1720214973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801c147e50 msgr2=0x7f801c143800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:17.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.125+0000 7f80247cb700 1 --2- 172.21.15.123:0/1720214973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801c147e50 0x7f801c143800 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f800c0090b0 tx=0x7f800c004750 comp rx=0 tx=0).stop 2023-03-08T15:50:17.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.125+0000 7f80247cb700 1 -- 172.21.15.123:0/1720214973 shutdown_connections 2023-03-08T15:50:17.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.125+0000 7f80247cb700 1 --2- 172.21.15.123:0/1720214973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f801c14b250 0x7f801c145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.128 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.125+0000 7f80247cb700 1 --2- 172.21.15.123:0/1720214973 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f80000698d0 0x7f800006bd80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.125+0000 7f80247cb700 1 --2- 172.21.15.123:0/1720214973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801c06fef0 0x7f801c1e2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.125+0000 7f80247cb700 1 --2- 172.21.15.123:0/1720214973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f801c147e50 0x7f801c143800 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.125+0000 7f80247cb700 1 -- 172.21.15.123:0/1720214973 >> 172.21.15.123:0/1720214973 conn(0x7f801c06b360 msgr2=0x7f801c0b8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:17.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.125+0000 7f80247cb700 1 -- 172.21.15.123:0/1720214973 shutdown_connections 2023-03-08T15:50:17.129 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.125+0000 7f80247cb700 1 -- 172.21.15.123:0/1720214973 wait complete. 2023-03-08T15:50:17.139 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-03-08T15:50:17.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.257+0000 7f8e7785b700 1 Processor -- start 2023-03-08T15:50:17.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.257+0000 7f8e7785b700 1 -- start start 2023-03-08T15:50:17.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e7785b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e700bb350 0x7f8e701446b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:17.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e7785b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e70144bf0 0x7f8e700bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:17.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e7785b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7014dc00 con 0x7f8e700be1f0 2023-03-08T15:50:17.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e7785b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e7006bb70 con 0x7f8e70144bf0 2023-03-08T15:50:17.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e7785b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700b9fc0 con 0x7f8e700bb350 2023-03-08T15:50:17.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e74df6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e70144bf0 0x7f8e700bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:17.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e74df6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e70144bf0 0x7f8e700bdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36560/0 (socket says 172.21.15.123:36560) 2023-03-08T15:50:17.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e74df6700 1 -- 172.21.15.123:0/1149969894 learned_addr learned my addr 172.21.15.123:0/1149969894 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:17.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e755f7700 1 --2- 172.21.15.123:0/1149969894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e700bb350 0x7f8e701446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:17.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e74df6700 1 -- 172.21.15.123:0/1149969894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e700bb350 msgr2=0x7f8e701446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:17.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e74df6700 1 --2- 172.21.15.123:0/1149969894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e700bb350 0x7f8e701446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e74df6700 1 -- 172.21.15.123:0/1149969894 >> v1:172.21.15.175:6789/0 conn(0x7f8e700be1f0 legacy=0x7f8e7014e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:17.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e74df6700 1 -- 172.21.15.123:0/1149969894 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e700ba2a0 con 0x7f8e70144bf0 2023-03-08T15:50:17.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e74df6700 1 --2- 172.21.15.123:0/1149969894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e70144bf0 0x7f8e700bdcb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8e600098f0 tx=0x7f8e60009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab03d25263c9cd7 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:17.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e67fff700 1 -- 172.21.15.123:0/1149969894 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6000b8a0 con 0x7f8e70144bf0 2023-03-08T15:50:17.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e67fff700 1 -- 172.21.15.123:0/1149969894 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6000ba00 con 0x7f8e70144bf0 2023-03-08T15:50:17.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.258+0000 7f8e67fff700 1 -- 172.21.15.123:0/1149969894 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6000bd90 con 0x7f8e70144bf0 2023-03-08T15:50:17.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.259+0000 7f8e7785b700 1 -- 172.21.15.123:0/1149969894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e70144bf0 msgr2=0x7f8e700bdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:17.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.259+0000 7f8e7785b700 1 --2- 172.21.15.123:0/1149969894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e70144bf0 0x7f8e700bdcb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8e600098f0 tx=0x7f8e60009c00 comp rx=0 tx=0).stop 2023-03-08T15:50:17.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.259+0000 7f8e7785b700 1 -- 172.21.15.123:0/1149969894 shutdown_connections 2023-03-08T15:50:17.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.259+0000 7f8e7785b700 1 --2- 172.21.15.123:0/1149969894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e700bb350 0x7f8e701446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.259+0000 7f8e7785b700 1 --2- 172.21.15.123:0/1149969894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e70144bf0 0x7f8e700bdcb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.259+0000 7f8e7785b700 1 -- 172.21.15.123:0/1149969894 >> 172.21.15.123:0/1149969894 conn(0x7f8e7006a250 msgr2=0x7f8e7006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:17.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.259+0000 7f8e7785b700 1 -- 172.21.15.123:0/1149969894 shutdown_connections 2023-03-08T15:50:17.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.259+0000 7f8e7785b700 1 -- 172.21.15.123:0/1149969894 wait complete. 2023-03-08T15:50:17.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.260+0000 7f8e7785b700 1 Processor -- start 2023-03-08T15:50:17.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.260+0000 7f8e7785b700 1 -- start start 2023-03-08T15:50:17.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.261+0000 7f8e7785b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e700bb350 0x7f8e7013faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:17.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.261+0000 7f8e7785b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e700be1f0 0x7f8e701dfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:17.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.261+0000 7f8e7785b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e70144bf0 0x7f8e70133770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:17.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.261+0000 7f8e7785b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7013ffe0 con 0x7f8e700bb350 2023-03-08T15:50:17.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.261+0000 7f8e7785b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7013aad0 con 0x7f8e700be1f0 2023-03-08T15:50:17.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.261+0000 7f8e7785b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e701390d0 con 0x7f8e70144bf0 2023-03-08T15:50:17.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.261+0000 7f8e755f7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e700bb350 0x7f8e7013faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:17.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.261+0000 7f8e755f7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e700bb350 0x7f8e7013faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36570/0 (socket says 172.21.15.123:36570) 2023-03-08T15:50:17.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.261+0000 7f8e755f7700 1 -- 172.21.15.123:0/1534173038 learned_addr learned my addr 172.21.15.123:0/1534173038 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:17.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.261+0000 7f8e75df8700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e70144bf0 0x7f8e70133770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:17.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.261+0000 7f8e74df6700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e700be1f0 0x7f8e701dfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:17.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.262+0000 7f8e755f7700 1 -- 172.21.15.123:0/1534173038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e70144bf0 msgr2=0x7f8e70133770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:17.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.262+0000 7f8e755f7700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e70144bf0 0x7f8e70133770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.262+0000 7f8e755f7700 1 -- 172.21.15.123:0/1534173038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e700be1f0 msgr2=0x7f8e701dfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:17.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.262+0000 7f8e755f7700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e700be1f0 0x7f8e701dfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.262+0000 7f8e755f7700 1 -- 172.21.15.123:0/1534173038 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e60009550 con 0x7f8e700bb350 2023-03-08T15:50:17.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.262+0000 7f8e74df6700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e700be1f0 0x7f8e701dfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:17.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.262+0000 7f8e75df8700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e70144bf0 0x7f8e70133770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:17.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.262+0000 7f8e755f7700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e700bb350 0x7f8e7013faa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00e810 tx=0x7f8e6c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:17.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.262+0000 7f8e65ffb700 1 -- 172.21.15.123:0/1534173038 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c013610 con 0x7f8e700bb350 2023-03-08T15:50:17.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.262+0000 7f8e65ffb700 1 -- 172.21.15.123:0/1534173038 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c013770 con 0x7f8e700bb350 2023-03-08T15:50:17.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.262+0000 7f8e7785b700 1 -- 172.21.15.123:0/1534173038 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e700bb720 con 0x7f8e700bb350 2023-03-08T15:50:17.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.262+0000 7f8e65ffb700 1 -- 172.21.15.123:0/1534173038 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c013b20 con 0x7f8e700bb350 2023-03-08T15:50:17.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.262+0000 7f8e7785b700 1 -- 172.21.15.123:0/1534173038 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e700ba580 con 0x7f8e700bb350 2023-03-08T15:50:17.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.263+0000 7f8e7785b700 1 -- 172.21.15.123:0/1534173038 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7014e7a0 con 0x7f8e700bb350 2023-03-08T15:50:17.271 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.263+0000 7f8e65ffb700 1 -- 172.21.15.123:0/1534173038 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f8e6c023070 con 0x7f8e700bb350 2023-03-08T15:50:17.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.264+0000 7f8e65ffb700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8e540698d0 0x7f8e5406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:17.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.264+0000 7f8e65ffb700 1 -- 172.21.15.123:0/1534173038 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8e6c087000 con 0x7f8e700bb350 2023-03-08T15:50:17.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.264+0000 7f8e74df6700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8e540698d0 0x7f8e5406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:17.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.264+0000 7f8e74df6700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8e540698d0 0x7f8e5406bd80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8e60014040 tx=0x7f8e60008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:17.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.268+0000 7f8e65ffb700 1 -- 172.21.15.123:0/1534173038 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f8e6c053120 con 0x7f8e700bb350 2023-03-08T15:50:17.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.530+0000 7f8e7785b700 1 -- 172.21.15.123:0/1534173038 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f8e70139290 con 0x7f8e700bb350 2023-03-08T15:50:17.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.533+0000 7f8e65ffb700 1 -- 172.21.15.123:0/1534173038 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8e6c056740 con 0x7f8e700bb350 2023-03-08T15:50:17.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.536+0000 7f8e7785b700 1 -- 172.21.15.123:0/1534173038 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8e540698d0 msgr2=0x7f8e5406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:17.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.536+0000 7f8e7785b700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8e540698d0 0x7f8e5406bd80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8e60014040 tx=0x7f8e60008030 comp rx=0 tx=0).stop 2023-03-08T15:50:17.538 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.536+0000 7f8e7785b700 1 -- 172.21.15.123:0/1534173038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e700bb350 msgr2=0x7f8e7013faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:17.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.536+0000 7f8e7785b700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e700bb350 0x7f8e7013faa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00e810 tx=0x7f8e6c00ebd0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.536+0000 7f8e7785b700 1 -- 172.21.15.123:0/1534173038 shutdown_connections 2023-03-08T15:50:17.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.536+0000 7f8e7785b700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8e540698d0 0x7f8e5406bd80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.536+0000 7f8e7785b700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e70144bf0 0x7f8e70133770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.536+0000 7f8e7785b700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e700bb350 0x7f8e7013faa0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.536+0000 7f8e7785b700 1 --2- 172.21.15.123:0/1534173038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e700be1f0 0x7f8e701dfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.539 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.536+0000 7f8e7785b700 1 -- 172.21.15.123:0/1534173038 >> 172.21.15.123:0/1534173038 conn(0x7f8e7006a250 msgr2=0x7f8e7014e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:17.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.536+0000 7f8e7785b700 1 -- 172.21.15.123:0/1534173038 shutdown_connections 2023-03-08T15:50:17.540 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.536+0000 7f8e7785b700 1 -- 172.21.15.123:0/1534173038 wait complete. 2023-03-08T15:50:17.550 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-03-08T15:50:17.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.669+0000 7f0ce196a700 1 Processor -- start 2023-03-08T15:50:17.671 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.669+0000 7f0ce196a700 1 -- start start 2023-03-08T15:50:17.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.669+0000 7f0ce196a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0cdc147e50 0x7f0cdc06a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:17.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.669+0000 7f0ce196a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cdc06fef0 0x7f0cdc14ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:17.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.669+0000 7f0ce196a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cdc14b6c0 con 0x7f0cdc14b250 2023-03-08T15:50:17.674 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.669+0000 7f0ce196a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cdc14a810 con 0x7f0cdc147e50 2023-03-08T15:50:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.669+0000 7f0ce196a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc071a40 con 0x7f0cdc06fef0 2023-03-08T15:50:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.669+0000 7f0cdb7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0cdc14b250 0x7f0cdc14dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51848/0 (socket says 172.21.15.123:51848) 2023-03-08T15:50:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.669+0000 7f0cdb7fe700 1 -- 172.21.15.123:0/2059325426 learned_addr learned my addr 172.21.15.123:0/2059325426 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cda7fc700 1 --2- 172.21.15.123:0/2059325426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cdc06fef0 0x7f0cdc14ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cdaffd700 1 --2- 172.21.15.123:0/2059325426 >> v2:172.21.15.175:3300/0 conn(0x7f0cdc147e50 0x7f0cdc06a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 -- 172.21.15.123:0/2059325426 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985770337 0 0) 0x7f0cdc14b6c0 con 0x7f0cdc14b250 2023-03-08T15:50:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 -- 172.21.15.123:0/2059325426 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc40035b0 con 0x7f0cdc14b250 2023-03-08T15:50:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 -- 172.21.15.123:0/2059325426 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2080181125 0 0) 0x7f0cc40035b0 con 0x7f0cdc14b250 2023-03-08T15:50:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 -- 172.21.15.123:0/2059325426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cdc06fef0 msgr2=0x7f0cdc14ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 --2- 172.21.15.123:0/2059325426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cdc06fef0 0x7f0cdc14ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 -- 172.21.15.123:0/2059325426 >> v2:172.21.15.175:3300/0 conn(0x7f0cdc147e50 msgr2=0x7f0cdc06a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 --2- 172.21.15.123:0/2059325426 >> v2:172.21.15.175:3300/0 conn(0x7f0cdc147e50 0x7f0cdc06a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 -- 172.21.15.123:0/2059325426 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc071d20 con 0x7f0cdc14b250 2023-03-08T15:50:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 -- 172.21.15.123:0/2059325426 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f0cd40019f0 con 0x7f0cdc14b250 2023-03-08T15:50:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 -- 172.21.15.123:0/2059325426 >> v1:172.21.15.123:6789/0 conn(0x7f0cdc14b250 legacy=0x7f0cdc14dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:17.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 --2- 172.21.15.123:0/2059325426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc4003a00 0x7f0cc4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:17.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 --2- 172.21.15.123:0/2059325426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cc4004430 0x7f0cc40048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:17.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 --2- 172.21.15.123:0/2059325426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cdc06fef0 0x7f0cc4004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:17.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 -- 172.21.15.123:0/2059325426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc14a810 con 0x7f0cc4003a00 2023-03-08T15:50:17.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 -- 172.21.15.123:0/2059325426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc071a40 con 0x7f0cc4004430 2023-03-08T15:50:17.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cd9ffb700 1 -- 172.21.15.123:0/2059325426 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc400ba10 con 0x7f0cdc06fef0 2023-03-08T15:50:17.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cdaffd700 1 --2- 172.21.15.123:0/2059325426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc4003a00 0x7f0cc4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:17.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cdb7fe700 1 --2- 172.21.15.123:0/2059325426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cdc06fef0 0x7f0cc4004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:17.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cda7fc700 1 --2- 172.21.15.123:0/2059325426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cc4004430 0x7f0cc40048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:17.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cdaffd700 1 -- 172.21.15.123:0/2059325426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cdc06fef0 msgr2=0x7f0cc4004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:17.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cdaffd700 1 --2- 172.21.15.123:0/2059325426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cdc06fef0 0x7f0cc4004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cdaffd700 1 -- 172.21.15.123:0/2059325426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cc4004430 msgr2=0x7f0cc40048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:17.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cdaffd700 1 --2- 172.21.15.123:0/2059325426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cc4004430 0x7f0cc40048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cdaffd700 1 -- 172.21.15.123:0/2059325426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc40035b0 con 0x7f0cc4003a00 2023-03-08T15:50:17.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.670+0000 7f0cdaffd700 1 --2- 172.21.15.123:0/2059325426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc4003a00 0x7f0cc4003e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009b60 tx=0x7f0cc4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d211c3c3d0739a6 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:17.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.671+0000 7f0cd9ffb700 1 -- 172.21.15.123:0/2059325426 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc00e6c0 con 0x7f0cc4003a00 2023-03-08T15:50:17.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.671+0000 7f0cd9ffb700 1 -- 172.21.15.123:0/2059325426 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc00e820 con 0x7f0cc4003a00 2023-03-08T15:50:17.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.671+0000 7f0cd9ffb700 1 -- 172.21.15.123:0/2059325426 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc00eb90 con 0x7f0cc4003a00 2023-03-08T15:50:17.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.671+0000 7f0ce196a700 1 -- 172.21.15.123:0/2059325426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc4003a00 msgr2=0x7f0cc4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:17.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.671+0000 7f0ce196a700 1 --2- 172.21.15.123:0/2059325426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc4003a00 0x7f0cc4003e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009b60 tx=0x7f0cc4005880 comp rx=0 tx=0).stop 2023-03-08T15:50:17.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.671+0000 7f0cdb7fe700 1 -- 172.21.15.123:0/2059325426 reap_dead start 2023-03-08T15:50:17.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.671+0000 7f0ce196a700 1 -- 172.21.15.123:0/2059325426 shutdown_connections 2023-03-08T15:50:17.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.671+0000 7f0ce196a700 1 -- 172.21.15.123:0/2059325426 >> 172.21.15.123:0/2059325426 conn(0x7f0cdc06b360 msgr2=0x7f0cdc06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:17.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.671+0000 7f0ce196a700 1 -- 172.21.15.123:0/2059325426 shutdown_connections 2023-03-08T15:50:17.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.671+0000 7f0ce196a700 1 -- 172.21.15.123:0/2059325426 wait complete. 2023-03-08T15:50:17.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.672+0000 7f0ce196a700 1 Processor -- start 2023-03-08T15:50:17.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.672+0000 7f0ce196a700 1 -- start start 2023-03-08T15:50:17.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0ce196a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cc4003a00 0x7f0cdc140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:17.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0ce196a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cdc1411b0 0x7f0cdc146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:17.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0ce196a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cdc146aa0 0x7f0cdc1e3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:17.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0ce196a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc144ce0 con 0x7f0cdc146aa0 2023-03-08T15:50:17.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0ce196a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc145510 con 0x7f0cc4003a00 2023-03-08T15:50:17.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0ce196a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc142820 con 0x7f0cdc1411b0 2023-03-08T15:50:17.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0cdb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cdc146aa0 0x7f0cdc1e3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:17.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0cdb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cdc146aa0 0x7f0cdc1e3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36584/0 (socket says 172.21.15.123:36584) 2023-03-08T15:50:17.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0cdb7fe700 1 -- 172.21.15.123:0/1515040084 learned_addr learned my addr 172.21.15.123:0/1515040084 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:17.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0cdaffd700 1 --2- 172.21.15.123:0/1515040084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cc4003a00 0x7f0cdc140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:17.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0cda7fc700 1 --2- 172.21.15.123:0/1515040084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cdc1411b0 0x7f0cdc146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:17.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0cdb7fe700 1 -- 172.21.15.123:0/1515040084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cdc1411b0 msgr2=0x7f0cdc146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:17.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0cdb7fe700 1 --2- 172.21.15.123:0/1515040084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cdc1411b0 0x7f0cdc146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0cdb7fe700 1 -- 172.21.15.123:0/1515040084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cc4003a00 msgr2=0x7f0cdc140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:17.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0cdb7fe700 1 --2- 172.21.15.123:0/1515040084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cc4003a00 0x7f0cdc140c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0cdb7fe700 1 -- 172.21.15.123:0/1515040084 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc148220 con 0x7f0cdc146aa0 2023-03-08T15:50:17.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.673+0000 7f0cdb7fe700 1 --2- 172.21.15.123:0/1515040084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cdc146aa0 0x7f0cdc1e3480 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc06f9a0 tx=0x7f0cd4007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:17.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.674+0000 7f0cc3fff700 1 -- 172.21.15.123:0/1515040084 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4017070 con 0x7f0cdc146aa0 2023-03-08T15:50:17.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.674+0000 7f0cc3fff700 1 -- 172.21.15.123:0/1515040084 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd400ed30 con 0x7f0cdc146aa0 2023-03-08T15:50:17.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.674+0000 7f0ce196a700 1 -- 172.21.15.123:0/1515040084 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cdc072000 con 0x7f0cdc146aa0 2023-03-08T15:50:17.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.674+0000 7f0cc3fff700 1 -- 172.21.15.123:0/1515040084 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd400eec0 con 0x7f0cdc146aa0 2023-03-08T15:50:17.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.674+0000 7f0ce196a700 1 -- 172.21.15.123:0/1515040084 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cdc0728f0 con 0x7f0cdc146aa0 2023-03-08T15:50:17.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.675+0000 7f0ce196a700 1 -- 172.21.15.123:0/1515040084 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cdc0744c0 con 0x7f0cdc146aa0 2023-03-08T15:50:17.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.675+0000 7f0cc3fff700 1 -- 172.21.15.123:0/1515040084 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f0cd4013420 con 0x7f0cdc146aa0 2023-03-08T15:50:17.685 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.675+0000 7f0cc3fff700 1 --2- 172.21.15.123:0/1515040084 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0cc80698d0 0x7f0cc806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:17.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.675+0000 7f0cc3fff700 1 -- 172.21.15.123:0/1515040084 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0cd40871f0 con 0x7f0cdc146aa0 2023-03-08T15:50:17.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.675+0000 7f0cdaffd700 1 --2- 172.21.15.123:0/1515040084 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0cc80698d0 0x7f0cc806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:17.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.676+0000 7f0cdaffd700 1 --2- 172.21.15.123:0/1515040084 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0cc80698d0 0x7f0cc806bd80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0090b0 tx=0x7f0ccc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:17.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.679+0000 7f0cc3fff700 1 -- 172.21.15.123:0/1515040084 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f0cd40532b0 con 0x7f0cdc146aa0 2023-03-08T15:50:17.942 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.940+0000 7f0ce196a700 1 -- 172.21.15.123:0/1515040084 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f0cdc148a60 con 0x7f0cdc146aa0 2023-03-08T15:50:17.946 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.944+0000 7f0cc3fff700 1 -- 172.21.15.123:0/1515040084 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0cd40568d0 con 0x7f0cdc146aa0 2023-03-08T15:50:17.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.947+0000 7f0ce196a700 1 -- 172.21.15.123:0/1515040084 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0cc80698d0 msgr2=0x7f0cc806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:17.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.947+0000 7f0ce196a700 1 --2- 172.21.15.123:0/1515040084 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0cc80698d0 0x7f0cc806bd80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0090b0 tx=0x7f0ccc008030 comp rx=0 tx=0).stop 2023-03-08T15:50:17.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.947+0000 7f0ce196a700 1 -- 172.21.15.123:0/1515040084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cdc146aa0 msgr2=0x7f0cdc1e3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:17.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.947+0000 7f0ce196a700 1 --2- 172.21.15.123:0/1515040084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cdc146aa0 0x7f0cdc1e3480 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc06f9a0 tx=0x7f0cd4007c90 comp rx=0 tx=0).stop 2023-03-08T15:50:17.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.947+0000 7f0ce196a700 1 -- 172.21.15.123:0/1515040084 shutdown_connections 2023-03-08T15:50:17.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.947+0000 7f0ce196a700 1 --2- 172.21.15.123:0/1515040084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cdc146aa0 0x7f0cdc1e3480 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.949 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.947+0000 7f0ce196a700 1 --2- 172.21.15.123:0/1515040084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0cc4003a00 0x7f0cdc140c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.947+0000 7f0ce196a700 1 --2- 172.21.15.123:0/1515040084 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f0cc80698d0 0x7f0cc806bd80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.947+0000 7f0ce196a700 1 --2- 172.21.15.123:0/1515040084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0cdc1411b0 0x7f0cdc146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:17.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.947+0000 7f0ce196a700 1 -- 172.21.15.123:0/1515040084 >> 172.21.15.123:0/1515040084 conn(0x7f0cdc06b360 msgr2=0x7f0cdc06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:17.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.947+0000 7f0ce196a700 1 -- 172.21.15.123:0/1515040084 shutdown_connections 2023-03-08T15:50:17.950 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:17.947+0000 7f0ce196a700 1 -- 172.21.15.123:0/1515040084 wait complete. 2023-03-08T15:50:17.960 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-03-08T15:50:18.080 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.078+0000 7fd82bf23700 1 Processor -- start 2023-03-08T15:50:18.081 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.078+0000 7fd82bf23700 1 -- start start 2023-03-08T15:50:18.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.079+0000 7fd82bf23700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8240ba280 0x7fd82406fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.079+0000 7fd82bf23700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd824071df0 0x7fd82414aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.079+0000 7fd82bf23700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd824070670 con 0x7fd824072760 2023-03-08T15:50:18.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.079+0000 7fd82bf23700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd824070a40 con 0x7fd8240ba280 2023-03-08T15:50:18.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.079+0000 7fd82bf23700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd824070c50 con 0x7fd824071df0 2023-03-08T15:50:18.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.079+0000 7fd8294be700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd824072760 0x7fd824141480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51854/0 (socket says 172.21.15.123:51854) 2023-03-08T15:50:18.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.079+0000 7fd8294be700 1 -- 172.21.15.123:0/1516643908 learned_addr learned my addr 172.21.15.123:0/1516643908 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:18.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.079+0000 7fd829cbf700 1 --2- 172.21.15.123:0/1516643908 >> v2:172.21.15.175:3300/0 conn(0x7fd8240ba280 0x7fd82406fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.079+0000 7fd82a4c0700 1 --2- 172.21.15.123:0/1516643908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd824071df0 0x7fd82414aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.079+0000 7fd828cbd700 1 -- 172.21.15.123:0/1516643908 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360555620 0 0) 0x7fd824070670 con 0x7fd824072760 2023-03-08T15:50:18.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 -- 172.21.15.123:0/1516643908 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8100057c0 con 0x7fd824072760 2023-03-08T15:50:18.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 -- 172.21.15.123:0/1516643908 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2622897773 0 0) 0x7fd8100057c0 con 0x7fd824072760 2023-03-08T15:50:18.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 -- 172.21.15.123:0/1516643908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd824071df0 msgr2=0x7fd82414aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:18.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 --2- 172.21.15.123:0/1516643908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd824071df0 0x7fd82414aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 -- 172.21.15.123:0/1516643908 >> v2:172.21.15.175:3300/0 conn(0x7fd8240ba280 msgr2=0x7fd82406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:18.085 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 --2- 172.21.15.123:0/1516643908 >> v2:172.21.15.175:3300/0 conn(0x7fd8240ba280 0x7fd82406fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 -- 172.21.15.123:0/1516643908 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8240ba650 con 0x7fd824072760 2023-03-08T15:50:18.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 -- 172.21.15.123:0/1516643908 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7fd820001670 con 0x7fd824072760 2023-03-08T15:50:18.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 -- 172.21.15.123:0/1516643908 >> v1:172.21.15.123:6789/0 conn(0x7fd824072760 legacy=0x7fd824141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 --2- 172.21.15.123:0/1516643908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd810005c10 0x7fd810006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 --2- 172.21.15.123:0/1516643908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd810006640 0x7fd810006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 --2- 172.21.15.123:0/1516643908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd824071df0 0x7fd8100071d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 -- 172.21.15.123:0/1516643908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd824070a40 con 0x7fd810006640 2023-03-08T15:50:18.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 -- 172.21.15.123:0/1516643908 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd824070c50 con 0x7fd810005c10 2023-03-08T15:50:18.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 -- 172.21.15.123:0/1516643908 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81000dc20 con 0x7fd824071df0 2023-03-08T15:50:18.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd8294be700 1 --2- 172.21.15.123:0/1516643908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd810006640 0x7fd810006b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd829cbf700 1 --2- 172.21.15.123:0/1516643908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd810005c10 0x7fd810006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd82a4c0700 1 --2- 172.21.15.123:0/1516643908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd824071df0 0x7fd8100071d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd8294be700 1 -- 172.21.15.123:0/1516643908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd824071df0 msgr2=0x7fd8100071d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:18.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd8294be700 1 --2- 172.21.15.123:0/1516643908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd824071df0 0x7fd8100071d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd8294be700 1 -- 172.21.15.123:0/1516643908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd810005c10 msgr2=0x7fd810006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:18.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd8294be700 1 --2- 172.21.15.123:0/1516643908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd810005c10 0x7fd810006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd8294be700 1 -- 172.21.15.123:0/1516643908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8100057c0 con 0x7fd810006640 2023-03-08T15:50:18.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd8294be700 1 --2- 172.21.15.123:0/1516643908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd810006640 0x7fd810006b00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd82406f9c0 tx=0x7fd810007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a7ac41d19df647 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:18.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 -- 172.21.15.123:0/1516643908 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820007c60 con 0x7fd810006640 2023-03-08T15:50:18.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 -- 172.21.15.123:0/1516643908 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82000ce80 con 0x7fd810006640 2023-03-08T15:50:18.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.080+0000 7fd828cbd700 1 -- 172.21.15.123:0/1516643908 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820005ba0 con 0x7fd810006640 2023-03-08T15:50:18.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.081+0000 7fd82bf23700 1 -- 172.21.15.123:0/1516643908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd810006640 msgr2=0x7fd810006b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.081+0000 7fd82bf23700 1 --2- 172.21.15.123:0/1516643908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd810006640 0x7fd810006b00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd82406f9c0 tx=0x7fd810007a90 comp rx=0 tx=0).stop 2023-03-08T15:50:18.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.081+0000 7fd82a4c0700 1 -- 172.21.15.123:0/1516643908 reap_dead start 2023-03-08T15:50:18.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.081+0000 7fd82bf23700 1 -- 172.21.15.123:0/1516643908 shutdown_connections 2023-03-08T15:50:18.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.081+0000 7fd82bf23700 1 -- 172.21.15.123:0/1516643908 >> 172.21.15.123:0/1516643908 conn(0x7fd82406b360 msgr2=0x7fd82406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:18.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.081+0000 7fd82bf23700 1 -- 172.21.15.123:0/1516643908 shutdown_connections 2023-03-08T15:50:18.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.081+0000 7fd82bf23700 1 -- 172.21.15.123:0/1516643908 wait complete. 2023-03-08T15:50:18.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.082+0000 7fd82bf23700 1 Processor -- start 2023-03-08T15:50:18.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.082+0000 7fd82bf23700 1 -- start start 2023-03-08T15:50:18.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd82bf23700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd810006640 0x7fd824145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd82bf23700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd824147400 0x7fd824149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd82bf23700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd82414a080 0x7fd8240bb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd82bf23700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd824146030 con 0x7fd82414a080 2023-03-08T15:50:18.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd82bf23700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd824148380 con 0x7fd810006640 2023-03-08T15:50:18.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd82bf23700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd824146a30 con 0x7fd824147400 2023-03-08T15:50:18.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd82a4c0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd82414a080 0x7fd8240bb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd82a4c0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd82414a080 0x7fd8240bb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36592/0 (socket says 172.21.15.123:36592) 2023-03-08T15:50:18.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd82a4c0700 1 -- 172.21.15.123:0/1057975786 learned_addr learned my addr 172.21.15.123:0/1057975786 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:18.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd829cbf700 1 --2- 172.21.15.123:0/1057975786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd810006640 0x7fd824145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd8294be700 1 --2- 172.21.15.123:0/1057975786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd824147400 0x7fd824149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd82a4c0700 1 -- 172.21.15.123:0/1057975786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd824147400 msgr2=0x7fd824149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd82a4c0700 1 --2- 172.21.15.123:0/1057975786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd824147400 0x7fd824149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd82a4c0700 1 -- 172.21.15.123:0/1057975786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd810006640 msgr2=0x7fd824145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd82a4c0700 1 --2- 172.21.15.123:0/1057975786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd810006640 0x7fd824145af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd82a4c0700 1 -- 172.21.15.123:0/1057975786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd824141d20 con 0x7fd82414a080 2023-03-08T15:50:18.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd82a4c0700 1 --2- 172.21.15.123:0/1057975786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd82414a080 0x7fd8240bb3e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd81c011bf0 tx=0x7fd81c011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:18.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.083+0000 7fd81a7fc700 1 -- 172.21.15.123:0/1057975786 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c00e040 con 0x7fd82414a080 2023-03-08T15:50:18.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.084+0000 7fd81a7fc700 1 -- 172.21.15.123:0/1057975786 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81c00f040 con 0x7fd82414a080 2023-03-08T15:50:18.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.084+0000 7fd82bf23700 1 -- 172.21.15.123:0/1057975786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd824141b90 con 0x7fd82414a080 2023-03-08T15:50:18.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.084+0000 7fd81a7fc700 1 -- 172.21.15.123:0/1057975786 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c00fd20 con 0x7fd82414a080 2023-03-08T15:50:18.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.084+0000 7fd82bf23700 1 -- 172.21.15.123:0/1057975786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82414aab0 con 0x7fd82414a080 2023-03-08T15:50:18.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.084+0000 7fd82bf23700 1 -- 172.21.15.123:0/1057975786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8240744c0 con 0x7fd82414a080 2023-03-08T15:50:18.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.085+0000 7fd81a7fc700 1 -- 172.21.15.123:0/1057975786 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fd81c022460 con 0x7fd82414a080 2023-03-08T15:50:18.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.085+0000 7fd81a7fc700 1 --2- 172.21.15.123:0/1057975786 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd8080698d0 0x7fd80806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.086+0000 7fd81a7fc700 1 -- 172.21.15.123:0/1057975786 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd81c088450 con 0x7fd82414a080 2023-03-08T15:50:18.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.086+0000 7fd829cbf700 1 --2- 172.21.15.123:0/1057975786 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd8080698d0 0x7fd80806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.086+0000 7fd829cbf700 1 --2- 172.21.15.123:0/1057975786 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd8080698d0 0x7fd80806bd80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd814009c60 tx=0x7fd814009210 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:18.095 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.090+0000 7fd81a7fc700 1 -- 172.21.15.123:0/1057975786 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fd81c0545b0 con 0x7fd82414a080 2023-03-08T15:50:18.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.353+0000 7fd82bf23700 1 -- 172.21.15.123:0/1057975786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fd824071aa0 con 0x7fd82414a080 2023-03-08T15:50:18.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.356+0000 7fd81a7fc700 1 -- 172.21.15.123:0/1057975786 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd81c057bd0 con 0x7fd82414a080 2023-03-08T15:50:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.358+0000 7fd82bf23700 1 -- 172.21.15.123:0/1057975786 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd8080698d0 msgr2=0x7fd80806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.358+0000 7fd82bf23700 1 --2- 172.21.15.123:0/1057975786 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd8080698d0 0x7fd80806bd80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd814009c60 tx=0x7fd814009210 comp rx=0 tx=0).stop 2023-03-08T15:50:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.358+0000 7fd82bf23700 1 -- 172.21.15.123:0/1057975786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd82414a080 msgr2=0x7fd8240bb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.358+0000 7fd82bf23700 1 --2- 172.21.15.123:0/1057975786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd82414a080 0x7fd8240bb3e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd81c011bf0 tx=0x7fd81c011f00 comp rx=0 tx=0).stop 2023-03-08T15:50:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.358+0000 7fd82bf23700 1 -- 172.21.15.123:0/1057975786 shutdown_connections 2023-03-08T15:50:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.358+0000 7fd82bf23700 1 --2- 172.21.15.123:0/1057975786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd82414a080 0x7fd8240bb3e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.358+0000 7fd82bf23700 1 --2- 172.21.15.123:0/1057975786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd810006640 0x7fd824145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.358+0000 7fd82bf23700 1 --2- 172.21.15.123:0/1057975786 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fd8080698d0 0x7fd80806bd80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.358+0000 7fd82bf23700 1 --2- 172.21.15.123:0/1057975786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd824147400 0x7fd824149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.358+0000 7fd82bf23700 1 -- 172.21.15.123:0/1057975786 >> 172.21.15.123:0/1057975786 conn(0x7fd82406b360 msgr2=0x7fd8240bd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:18.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.358+0000 7fd82bf23700 1 -- 172.21.15.123:0/1057975786 shutdown_connections 2023-03-08T15:50:18.362 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.358+0000 7fd82bf23700 1 -- 172.21.15.123:0/1057975786 wait complete. 2023-03-08T15:50:18.373 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-03-08T15:50:18.493 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.491+0000 7f7c3147c700 1 Processor -- start 2023-03-08T15:50:18.494 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.491+0000 7f7c3147c700 1 -- start start 2023-03-08T15:50:18.496 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c3147c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c2c144a90 0x7f7c2c0bd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.496 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c3147c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c0b7fa0 con 0x7f7c2c0ba560 2023-03-08T15:50:18.496 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c3147c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c0bc030 con 0x7f7c2c1446c0 2023-03-08T15:50:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c3147c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0bc310 con 0x7f7c2c144a90 2023-03-08T15:50:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c2b7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7c2c0ba560 0x7f7c2c154f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51866/0 (socket says 172.21.15.123:51866) 2023-03-08T15:50:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c2b7fe700 1 -- 172.21.15.123:0/3758202823 learned_addr learned my addr 172.21.15.123:0/3758202823 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c2a7fc700 1 --2- 172.21.15.123:0/3758202823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c2c144a90 0x7f7c2c0bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c29ffb700 1 -- 172.21.15.123:0/3758202823 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263430114 0 0) 0x7f7c2c0b7fa0 con 0x7f7c2c0ba560 2023-03-08T15:50:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c29ffb700 1 -- 172.21.15.123:0/3758202823 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c140035b0 con 0x7f7c2c0ba560 2023-03-08T15:50:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c29ffb700 1 -- 172.21.15.123:0/3758202823 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1022840836 0 0) 0x7f7c140035b0 con 0x7f7c2c0ba560 2023-03-08T15:50:18.498 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c29ffb700 1 -- 172.21.15.123:0/3758202823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c2c144a90 msgr2=0x7f7c2c0bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:18.498 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c29ffb700 1 --2- 172.21.15.123:0/3758202823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c2c144a90 0x7f7c2c0bd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.498 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c29ffb700 1 -- 172.21.15.123:0/3758202823 >> v1:172.21.15.175:6789/0 conn(0x7f7c2c1446c0 legacy=0x7f7c2c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.498 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c29ffb700 1 -- 172.21.15.123:0/3758202823 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c0bc5f0 con 0x7f7c2c0ba560 2023-03-08T15:50:18.498 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c29ffb700 1 -- 172.21.15.123:0/3758202823 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f7c240019f0 con 0x7f7c2c0ba560 2023-03-08T15:50:18.498 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c29ffb700 1 -- 172.21.15.123:0/3758202823 >> v1:172.21.15.123:6789/0 conn(0x7f7c2c0ba560 legacy=0x7f7c2c154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c29ffb700 1 --2- 172.21.15.123:0/3758202823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c2c144a90 0x7f7c14003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c29ffb700 1 --2- 172.21.15.123:0/3758202823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c14003fb0 0x7f7c14004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c29ffb700 1 --2- 172.21.15.123:0/3758202823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c14004d90 0x7f7c14005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c29ffb700 1 -- 172.21.15.123:0/3758202823 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0bc310 con 0x7f7c14003fb0 2023-03-08T15:50:18.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c29ffb700 1 -- 172.21.15.123:0/3758202823 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1400baf0 con 0x7f7c14004d90 2023-03-08T15:50:18.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.492+0000 7f7c29ffb700 1 -- 172.21.15.123:0/3758202823 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1400bcb0 con 0x7f7c2c144a90 2023-03-08T15:50:18.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.493+0000 7f7c2a7fc700 1 --2- 172.21.15.123:0/3758202823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c14003fb0 0x7f7c14004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.499 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.493+0000 7f7c2affd700 1 --2- 172.21.15.123:0/3758202823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c2c144a90 0x7f7c14003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.500 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.493+0000 7f7c2b7fe700 1 --2- 172.21.15.123:0/3758202823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c14004d90 0x7f7c14005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.500 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.493+0000 7f7c2a7fc700 1 -- 172.21.15.123:0/3758202823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c2c144a90 msgr2=0x7f7c14003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:18.500 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.493+0000 7f7c2a7fc700 1 --2- 172.21.15.123:0/3758202823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c2c144a90 0x7f7c14003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.500 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.493+0000 7f7c2a7fc700 1 -- 172.21.15.123:0/3758202823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c14004d90 msgr2=0x7f7c14005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:18.500 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.493+0000 7f7c2a7fc700 1 --2- 172.21.15.123:0/3758202823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c14004d90 0x7f7c14005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.500 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.493+0000 7f7c2a7fc700 1 -- 172.21.15.123:0/3758202823 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c140035b0 con 0x7f7c14003fb0 2023-03-08T15:50:18.500 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.493+0000 7f7c2b7fe700 1 --2- 172.21.15.123:0/3758202823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c14004d90 0x7f7c14005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:18.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.493+0000 7f7c2a7fc700 1 --2- 172.21.15.123:0/3758202823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c14003fb0 0x7f7c14004850 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c144ec0 tx=0x7f7c14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f3744984e2f6e0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:18.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.493+0000 7f7c29ffb700 1 -- 172.21.15.123:0/3758202823 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00e6c0 con 0x7f7c14003fb0 2023-03-08T15:50:18.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.493+0000 7f7c29ffb700 1 -- 172.21.15.123:0/3758202823 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c00e820 con 0x7f7c14003fb0 2023-03-08T15:50:18.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.493+0000 7f7c29ffb700 1 -- 172.21.15.123:0/3758202823 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00ebb0 con 0x7f7c14003fb0 2023-03-08T15:50:18.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.494+0000 7f7c3147c700 1 -- 172.21.15.123:0/3758202823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c14003fb0 msgr2=0x7f7c14004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.494+0000 7f7c3147c700 1 --2- 172.21.15.123:0/3758202823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c14003fb0 0x7f7c14004850 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c144ec0 tx=0x7f7c14005880 comp rx=0 tx=0).stop 2023-03-08T15:50:18.501 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.494+0000 7f7c2b7fe700 1 -- 172.21.15.123:0/3758202823 reap_dead start 2023-03-08T15:50:18.502 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.494+0000 7f7c3147c700 1 -- 172.21.15.123:0/3758202823 shutdown_connections 2023-03-08T15:50:18.502 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.494+0000 7f7c3147c700 1 -- 172.21.15.123:0/3758202823 >> 172.21.15.123:0/3758202823 conn(0x7f7c2c071980 msgr2=0x7f7c2c071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:18.502 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.494+0000 7f7c3147c700 1 -- 172.21.15.123:0/3758202823 shutdown_connections 2023-03-08T15:50:18.502 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.494+0000 7f7c3147c700 1 -- 172.21.15.123:0/3758202823 wait complete. 2023-03-08T15:50:18.504 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.495+0000 7f7c3147c700 1 Processor -- start 2023-03-08T15:50:18.504 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.495+0000 7f7c3147c700 1 -- start start 2023-03-08T15:50:18.504 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.495+0000 7f7c3147c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c14003fb0 0x7f7c2c14b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.495+0000 7f7c3147c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c2c14d5a0 0x7f7c2c14c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.495+0000 7f7c3147c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c2c141d50 0x7f7c2c139610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.495+0000 7f7c3147c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c14da10 con 0x7f7c2c14d5a0 2023-03-08T15:50:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.495+0000 7f7c3147c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c14bf10 con 0x7f7c2c141d50 2023-03-08T15:50:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.495+0000 7f7c3147c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c13fd10 con 0x7f7c14003fb0 2023-03-08T15:50:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c2a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c2c14d5a0 0x7f7c2c14c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c2a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c2c14d5a0 0x7f7c2c14c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36622/0 (socket says 172.21.15.123:36622) 2023-03-08T15:50:18.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c2a7fc700 1 -- 172.21.15.123:0/3464145824 learned_addr learned my addr 172.21.15.123:0/3464145824 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:18.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c2affd700 1 --2- 172.21.15.123:0/3464145824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c14003fb0 0x7f7c2c14b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c2b7fe700 1 --2- 172.21.15.123:0/3464145824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c2c141d50 0x7f7c2c139610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c2a7fc700 1 -- 172.21.15.123:0/3464145824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c14003fb0 msgr2=0x7f7c2c14b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c2a7fc700 1 --2- 172.21.15.123:0/3464145824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c14003fb0 0x7f7c2c14b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.506 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c2a7fc700 1 -- 172.21.15.123:0/3464145824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c2c141d50 msgr2=0x7f7c2c139610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c2a7fc700 1 --2- 172.21.15.123:0/3464145824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c2c141d50 0x7f7c2c139610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c2a7fc700 1 -- 172.21.15.123:0/3464145824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c14db90 con 0x7f7c2c14d5a0 2023-03-08T15:50:18.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c2affd700 1 --2- 172.21.15.123:0/3464145824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c14003fb0 0x7f7c2c14b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:18.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c2a7fc700 1 --2- 172.21.15.123:0/3464145824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c2c14d5a0 0x7f7c2c14c950 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400bac0 tx=0x7f7c1c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:18.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c137fe700 1 -- 172.21.15.123:0/3464145824 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00e6c0 con 0x7f7c2c14d5a0 2023-03-08T15:50:18.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c137fe700 1 -- 172.21.15.123:0/3464145824 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0038a0 con 0x7f7c2c14d5a0 2023-03-08T15:50:18.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c3147c700 1 -- 172.21.15.123:0/3464145824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c0b7530 con 0x7f7c2c14d5a0 2023-03-08T15:50:18.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c137fe700 1 -- 172.21.15.123:0/3464145824 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c006e60 con 0x7f7c2c14d5a0 2023-03-08T15:50:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.496+0000 7f7c3147c700 1 -- 172.21.15.123:0/3464145824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c14ce90 con 0x7f7c2c14d5a0 2023-03-08T15:50:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.497+0000 7f7c3147c700 1 -- 172.21.15.123:0/3464145824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c14dd20 con 0x7f7c2c14d5a0 2023-03-08T15:50:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.497+0000 7f7c137fe700 1 -- 172.21.15.123:0/3464145824 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f7c1c025070 con 0x7f7c2c14d5a0 2023-03-08T15:50:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.498+0000 7f7c137fe700 1 --2- 172.21.15.123:0/3464145824 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7c18069900 0x7f7c1806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.498+0000 7f7c137fe700 1 -- 172.21.15.123:0/3464145824 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7c1c088b90 con 0x7f7c2c14d5a0 2023-03-08T15:50:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.498+0000 7f7c2affd700 1 --2- 172.21.15.123:0/3464145824 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7c18069900 0x7f7c1806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.498+0000 7f7c2affd700 1 --2- 172.21.15.123:0/3464145824 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7c18069900 0x7f7c1806bdb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7c20007fd0 tx=0x7f7c20009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:18.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.503+0000 7f7c137fe700 1 -- 172.21.15.123:0/3464145824 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f7c2c14dd20 con 0x7f7c2c14d5a0 2023-03-08T15:50:18.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.762+0000 7f7c3147c700 1 -- 172.21.15.123:0/3464145824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f7c2c14dd20 con 0x7f7c2c14d5a0 2023-03-08T15:50:18.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.766+0000 7f7c137fe700 1 -- 172.21.15.123:0/3464145824 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7c2c14dd20 con 0x7f7c2c14d5a0 2023-03-08T15:50:18.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.768+0000 7f7c3147c700 1 -- 172.21.15.123:0/3464145824 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7c18069900 msgr2=0x7f7c1806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.770 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.768+0000 7f7c3147c700 1 --2- 172.21.15.123:0/3464145824 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7c18069900 0x7f7c1806bdb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7c20007fd0 tx=0x7f7c20009040 comp rx=0 tx=0).stop 2023-03-08T15:50:18.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.768+0000 7f7c3147c700 1 -- 172.21.15.123:0/3464145824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c2c14d5a0 msgr2=0x7f7c2c14c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.768+0000 7f7c3147c700 1 --2- 172.21.15.123:0/3464145824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c2c14d5a0 0x7f7c2c14c950 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400bac0 tx=0x7f7c1c0047c0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.768+0000 7f7c3147c700 1 -- 172.21.15.123:0/3464145824 shutdown_connections 2023-03-08T15:50:18.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.768+0000 7f7c3147c700 1 --2- 172.21.15.123:0/3464145824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c2c141d50 0x7f7c2c139610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.768+0000 7f7c3147c700 1 --2- 172.21.15.123:0/3464145824 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f7c18069900 0x7f7c1806bdb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.768+0000 7f7c3147c700 1 --2- 172.21.15.123:0/3464145824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c14003fb0 0x7f7c2c14b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.771 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.768+0000 7f7c3147c700 1 --2- 172.21.15.123:0/3464145824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c2c14d5a0 0x7f7c2c14c950 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.768+0000 7f7c3147c700 1 -- 172.21.15.123:0/3464145824 >> 172.21.15.123:0/3464145824 conn(0x7f7c2c071980 msgr2=0x7f7c2c143370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:18.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.768+0000 7f7c3147c700 1 -- 172.21.15.123:0/3464145824 shutdown_connections 2023-03-08T15:50:18.772 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.768+0000 7f7c3147c700 1 -- 172.21.15.123:0/3464145824 wait complete. 2023-03-08T15:50:18.782 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-03-08T15:50:18.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.902+0000 7f8b7431e700 1 Processor -- start 2023-03-08T15:50:18.903 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.902+0000 7f8b7431e700 1 -- start start 2023-03-08T15:50:18.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.902+0000 7f8b7431e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8b6c0bb350 0x7f8b6c1446b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.902+0000 7f8b7431e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8b6c144bf0 0x7f8b6c0bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.902+0000 7f8b7431e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6c14dc00 con 0x7f8b6c0be1f0 2023-03-08T15:50:18.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.902+0000 7f8b7431e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6c06bb70 con 0x7f8b6c0bb350 2023-03-08T15:50:18.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.902+0000 7f8b7431e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6c0b9fc0 con 0x7f8b6c144bf0 2023-03-08T15:50:18.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.903+0000 7f8b720ba700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8b6c0bb350 0x7f8b6c1446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.903+0000 7f8b728bb700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8b6c0be1f0 0x7f8b6c14e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51870/0 (socket says 172.21.15.123:51870) 2023-03-08T15:50:18.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.903+0000 7f8b720ba700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8b6c0bb350 0x7f8b6c1446b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36634/0 (socket says 172.21.15.123:36634) 2023-03-08T15:50:18.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.903+0000 7f8b728bb700 1 -- 172.21.15.123:0/97405232 learned_addr learned my addr 172.21.15.123:0/97405232 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:18.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.903+0000 7f8b718b9700 1 --2- 172.21.15.123:0/97405232 >> v2:172.21.15.175:3300/0 conn(0x7f8b6c144bf0 0x7f8b6c0bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.903+0000 7f8b720ba700 1 -- 172.21.15.123:0/97405232 >> v2:172.21.15.175:3300/0 conn(0x7f8b6c144bf0 msgr2=0x7f8b6c0bdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:18.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.903+0000 7f8b720ba700 1 --2- 172.21.15.123:0/97405232 >> v2:172.21.15.175:3300/0 conn(0x7f8b6c144bf0 0x7f8b6c0bdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.903+0000 7f8b720ba700 1 -- 172.21.15.123:0/97405232 >> v1:172.21.15.123:6789/0 conn(0x7f8b6c0be1f0 legacy=0x7f8b6c14e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.903+0000 7f8b720ba700 1 -- 172.21.15.123:0/97405232 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c0ba2a0 con 0x7f8b6c0bb350 2023-03-08T15:50:18.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.903+0000 7f8b710b8700 1 -- 172.21.15.123:0/97405232 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039424806 0 0) 0x7f8b6c14dc00 con 0x7f8b6c0be1f0 2023-03-08T15:50:18.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.903+0000 7f8b718b9700 1 --2- 172.21.15.123:0/97405232 >> v2:172.21.15.175:3300/0 conn(0x7f8b6c144bf0 0x7f8b6c0bdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:18.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.903+0000 7f8b720ba700 1 --2- 172.21.15.123:0/97405232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c0bb350 0x7f8b6c1446b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0bbfc0 tx=0x7f8b68009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645eacfe75e5ec44 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:18.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.903+0000 7f8b710b8700 1 -- 172.21.15.123:0/97405232 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b68011830 con 0x7f8b6c0bb350 2023-03-08T15:50:18.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.903+0000 7f8b710b8700 1 -- 172.21.15.123:0/97405232 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b68011990 con 0x7f8b6c0bb350 2023-03-08T15:50:18.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.903+0000 7f8b710b8700 1 -- 172.21.15.123:0/97405232 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b68011d20 con 0x7f8b6c0bb350 2023-03-08T15:50:18.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.904+0000 7f8b7431e700 1 -- 172.21.15.123:0/97405232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c0bb350 msgr2=0x7f8b6c1446b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.904+0000 7f8b7431e700 1 --2- 172.21.15.123:0/97405232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c0bb350 0x7f8b6c1446b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0bbfc0 tx=0x7f8b68009b20 comp rx=0 tx=0).stop 2023-03-08T15:50:18.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.904+0000 7f8b7431e700 1 -- 172.21.15.123:0/97405232 shutdown_connections 2023-03-08T15:50:18.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.904+0000 7f8b7431e700 1 --2- 172.21.15.123:0/97405232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c0bb350 0x7f8b6c1446b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.909 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.904+0000 7f8b7431e700 1 --2- 172.21.15.123:0/97405232 >> v2:172.21.15.175:3300/0 conn(0x7f8b6c144bf0 0x7f8b6c0bdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.909 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.904+0000 7f8b7431e700 1 -- 172.21.15.123:0/97405232 >> 172.21.15.123:0/97405232 conn(0x7f8b6c06a250 msgr2=0x7f8b6c06a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:18.909 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.904+0000 7f8b7431e700 1 -- 172.21.15.123:0/97405232 shutdown_connections 2023-03-08T15:50:18.909 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.904+0000 7f8b7431e700 1 -- 172.21.15.123:0/97405232 wait complete. 2023-03-08T15:50:18.911 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.905+0000 7f8b7431e700 1 Processor -- start 2023-03-08T15:50:18.911 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.905+0000 7f8b7431e700 1 -- start start 2023-03-08T15:50:18.911 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b7431e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c0bb350 0x7f8b6c1e3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b7431e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b6c0be1f0 0x7f8b6c14bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b7431e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b6c144bf0 0x7f8b6c14c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b7431e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c14b7d0 con 0x7f8b6c0bb350 2023-03-08T15:50:18.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b7431e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c14bab0 con 0x7f8b6c0be1f0 2023-03-08T15:50:18.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b7431e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c1e3c60 con 0x7f8b6c144bf0 2023-03-08T15:50:18.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b720ba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c0bb350 0x7f8b6c1e3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b720ba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c0bb350 0x7f8b6c1e3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36644/0 (socket says 172.21.15.123:36644) 2023-03-08T15:50:18.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b720ba700 1 -- 172.21.15.123:0/1902612042 learned_addr learned my addr 172.21.15.123:0/1902612042 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:18.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b718b9700 1 --2- 172.21.15.123:0/1902612042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b6c0be1f0 0x7f8b6c14bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b728bb700 1 --2- 172.21.15.123:0/1902612042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b6c144bf0 0x7f8b6c14c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b720ba700 1 -- 172.21.15.123:0/1902612042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b6c144bf0 msgr2=0x7f8b6c14c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b720ba700 1 --2- 172.21.15.123:0/1902612042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b6c144bf0 0x7f8b6c14c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b720ba700 1 -- 172.21.15.123:0/1902612042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b6c0be1f0 msgr2=0x7f8b6c14bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:18.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b720ba700 1 --2- 172.21.15.123:0/1902612042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b6c0be1f0 0x7f8b6c14bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:18.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b720ba700 1 -- 172.21.15.123:0/1902612042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b680094a0 con 0x7f8b6c0bb350 2023-03-08T15:50:18.914 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.906+0000 7f8b728bb700 1 --2- 172.21.15.123:0/1902612042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b6c144bf0 0x7f8b6c14c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:18.914 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.907+0000 7f8b720ba700 1 --2- 172.21.15.123:0/1902612042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c0bb350 0x7f8b6c1e3440 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8b680090b0 tx=0x7f8b68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:18.914 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.907+0000 7f8b62ffd700 1 -- 172.21.15.123:0/1902612042 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b680036a0 con 0x7f8b6c0bb350 2023-03-08T15:50:18.914 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.907+0000 7f8b62ffd700 1 -- 172.21.15.123:0/1902612042 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6801f070 con 0x7f8b6c0bb350 2023-03-08T15:50:18.914 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.907+0000 7f8b62ffd700 1 -- 172.21.15.123:0/1902612042 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b68003a40 con 0x7f8b6c0bb350 2023-03-08T15:50:18.914 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.907+0000 7f8b7431e700 1 -- 172.21.15.123:0/1902612042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6c0bb720 con 0x7f8b6c0bb350 2023-03-08T15:50:18.914 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.907+0000 7f8b7431e700 1 -- 172.21.15.123:0/1902612042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6c0ba580 con 0x7f8b6c0bb350 2023-03-08T15:50:18.915 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.908+0000 7f8b7431e700 1 -- 172.21.15.123:0/1902612042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6c14e7a0 con 0x7f8b6c0bb350 2023-03-08T15:50:18.915 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.908+0000 7f8b62ffd700 1 -- 172.21.15.123:0/1902612042 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f8b6800f050 con 0x7f8b6c0bb350 2023-03-08T15:50:18.915 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.908+0000 7f8b62ffd700 1 --2- 172.21.15.123:0/1902612042 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8b500698d0 0x7f8b5006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:18.915 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.908+0000 7f8b62ffd700 1 -- 172.21.15.123:0/1902612042 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8b68021070 con 0x7f8b6c0bb350 2023-03-08T15:50:18.915 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.908+0000 7f8b718b9700 1 --2- 172.21.15.123:0/1902612042 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8b500698d0 0x7f8b5006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:18.915 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.909+0000 7f8b718b9700 1 --2- 172.21.15.123:0/1902612042 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8b500698d0 0x7f8b5006bd80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c006fd0 tx=0x7f8b5c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:18.916 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:18.913+0000 7f8b62ffd700 1 -- 172.21.15.123:0/1902612042 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f8b68054f00 con 0x7f8b6c0bb350 2023-03-08T15:50:19.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.175+0000 7f8b7431e700 1 -- 172.21.15.123:0/1902612042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f8b6c0744c0 con 0x7f8b6c0bb350 2023-03-08T15:50:19.179 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.178+0000 7f8b62ffd700 1 -- 172.21.15.123:0/1902612042 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8b6802b0a0 con 0x7f8b6c0bb350 2023-03-08T15:50:19.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.180+0000 7f8b7431e700 1 -- 172.21.15.123:0/1902612042 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8b500698d0 msgr2=0x7f8b5006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.180+0000 7f8b7431e700 1 --2- 172.21.15.123:0/1902612042 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8b500698d0 0x7f8b5006bd80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c006fd0 tx=0x7f8b5c008040 comp rx=0 tx=0).stop 2023-03-08T15:50:19.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.180+0000 7f8b7431e700 1 -- 172.21.15.123:0/1902612042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c0bb350 msgr2=0x7f8b6c1e3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.180+0000 7f8b7431e700 1 --2- 172.21.15.123:0/1902612042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c0bb350 0x7f8b6c1e3440 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8b680090b0 tx=0x7f8b68004750 comp rx=0 tx=0).stop 2023-03-08T15:50:19.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.180+0000 7f8b7431e700 1 -- 172.21.15.123:0/1902612042 shutdown_connections 2023-03-08T15:50:19.182 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.180+0000 7f8b7431e700 1 --2- 172.21.15.123:0/1902612042 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f8b500698d0 0x7f8b5006bd80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.180+0000 7f8b7431e700 1 --2- 172.21.15.123:0/1902612042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b6c144bf0 0x7f8b6c14c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.180+0000 7f8b7431e700 1 --2- 172.21.15.123:0/1902612042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b6c0bb350 0x7f8b6c1e3440 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.180+0000 7f8b7431e700 1 --2- 172.21.15.123:0/1902612042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b6c0be1f0 0x7f8b6c14bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.180+0000 7f8b7431e700 1 -- 172.21.15.123:0/1902612042 >> 172.21.15.123:0/1902612042 conn(0x7f8b6c06a250 msgr2=0x7f8b6c06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:19.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.180+0000 7f8b7431e700 1 -- 172.21.15.123:0/1902612042 shutdown_connections 2023-03-08T15:50:19.183 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.180+0000 7f8b7431e700 1 -- 172.21.15.123:0/1902612042 wait complete. 2023-03-08T15:50:19.193 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:50:19.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.312+0000 7f81dd87a700 1 Processor -- start 2023-03-08T15:50:19.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.312+0000 7f81dd87a700 1 -- start start 2023-03-08T15:50:19.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.313+0000 7f81dd87a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81d8142680 0x7f81d814b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.313+0000 7f81dd87a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f81d80b92f0 0x7f81d8152d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.313+0000 7f81dd87a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d80b9710 con 0x7f81d80b7f80 2023-03-08T15:50:19.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.313+0000 7f81dd87a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d80b71e0 con 0x7f81d8142680 2023-03-08T15:50:19.316 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.313+0000 7f81dd87a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d80ba0d0 con 0x7f81d80b92f0 2023-03-08T15:50:19.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.313+0000 7f81d6ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81d8142680 0x7f81d814b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.313+0000 7f81d67fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f81d80b7f80 0x7f81d8071c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51876/0 (socket says 172.21.15.123:51876) 2023-03-08T15:50:19.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.313+0000 7f81d67fc700 1 -- 172.21.15.123:0/1016589056 learned_addr learned my addr 172.21.15.123:0/1016589056 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:19.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.313+0000 7f81d77fe700 1 --2- 172.21.15.123:0/1016589056 >> v2:172.21.15.175:3300/0 conn(0x7f81d80b92f0 0x7f81d8152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.313+0000 7f81d6ffd700 1 -- 172.21.15.123:0/1016589056 >> v2:172.21.15.175:3300/0 conn(0x7f81d80b92f0 msgr2=0x7f81d8152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:19.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.313+0000 7f81d6ffd700 1 --2- 172.21.15.123:0/1016589056 >> v2:172.21.15.175:3300/0 conn(0x7f81d80b92f0 0x7f81d8152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.313+0000 7f81d6ffd700 1 -- 172.21.15.123:0/1016589056 >> v1:172.21.15.123:6789/0 conn(0x7f81d80b7f80 legacy=0x7f81d8071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.313+0000 7f81d5ffb700 1 -- 172.21.15.123:0/1016589056 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583128846 0 0) 0x7f81d80b9710 con 0x7f81d80b7f80 2023-03-08T15:50:19.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.313+0000 7f81d6ffd700 1 -- 172.21.15.123:0/1016589056 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d80ba690 con 0x7f81d8142680 2023-03-08T15:50:19.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.313+0000 7f81d77fe700 1 --2- 172.21.15.123:0/1016589056 >> v2:172.21.15.175:3300/0 conn(0x7f81d80b92f0 0x7f81d8152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:19.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.314+0000 7f81d6ffd700 1 --2- 172.21.15.123:0/1016589056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d8142680 0x7f81d814b9b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f81d8066c30 tx=0x7f81cc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49c08f66db47763 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:19.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.314+0000 7f81d5ffb700 1 -- 172.21.15.123:0/1016589056 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc011830 con 0x7f81d8142680 2023-03-08T15:50:19.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.314+0000 7f81d5ffb700 1 -- 172.21.15.123:0/1016589056 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc011990 con 0x7f81d8142680 2023-03-08T15:50:19.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.314+0000 7f81d5ffb700 1 -- 172.21.15.123:0/1016589056 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc011d20 con 0x7f81d8142680 2023-03-08T15:50:19.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.314+0000 7f81dd87a700 1 -- 172.21.15.123:0/1016589056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d8142680 msgr2=0x7f81d814b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.314+0000 7f81dd87a700 1 --2- 172.21.15.123:0/1016589056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d8142680 0x7f81d814b9b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f81d8066c30 tx=0x7f81cc009b20 comp rx=0 tx=0).stop 2023-03-08T15:50:19.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.314+0000 7f81dd87a700 1 -- 172.21.15.123:0/1016589056 shutdown_connections 2023-03-08T15:50:19.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.314+0000 7f81dd87a700 1 --2- 172.21.15.123:0/1016589056 >> v2:172.21.15.175:3300/0 conn(0x7f81d80b92f0 0x7f81d8152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.314+0000 7f81dd87a700 1 --2- 172.21.15.123:0/1016589056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d8142680 0x7f81d814b9b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.314+0000 7f81dd87a700 1 -- 172.21.15.123:0/1016589056 >> 172.21.15.123:0/1016589056 conn(0x7f81d806b360 msgr2=0x7f81d806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:19.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.314+0000 7f81dd87a700 1 -- 172.21.15.123:0/1016589056 shutdown_connections 2023-03-08T15:50:19.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.314+0000 7f81dd87a700 1 -- 172.21.15.123:0/1016589056 wait complete. 2023-03-08T15:50:19.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.315+0000 7f81dd87a700 1 Processor -- start 2023-03-08T15:50:19.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.315+0000 7f81dd87a700 1 -- start start 2023-03-08T15:50:19.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81dd87a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d80b7f80 0x7f81d813dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81dd87a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d80b92f0 0x7f81d813f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81dd87a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81d8142680 0x7f81d81e3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81dd87a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80711e0 con 0x7f81d80b7f80 2023-03-08T15:50:19.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81dd87a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d813e2e0 con 0x7f81d80b92f0 2023-03-08T15:50:19.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81dd87a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8070fd0 con 0x7f81d8142680 2023-03-08T15:50:19.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81d6ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d80b7f80 0x7f81d813dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81d6ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d80b7f80 0x7f81d813dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36666/0 (socket says 172.21.15.123:36666) 2023-03-08T15:50:19.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81d6ffd700 1 -- 172.21.15.123:0/2758934108 learned_addr learned my addr 172.21.15.123:0/2758934108 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:19.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81d67fc700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d80b92f0 0x7f81d813f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81d77fe700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81d8142680 0x7f81d81e3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.323 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81d6ffd700 1 -- 172.21.15.123:0/2758934108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81d8142680 msgr2=0x7f81d81e3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81d6ffd700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81d8142680 0x7f81d81e3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81d6ffd700 1 -- 172.21.15.123:0/2758934108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d80b92f0 msgr2=0x7f81d813f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81d6ffd700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d80b92f0 0x7f81d813f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81d6ffd700 1 -- 172.21.15.123:0/2758934108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc0094a0 con 0x7f81d80b7f80 2023-03-08T15:50:19.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81d67fc700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d80b92f0 0x7f81d813f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:19.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.316+0000 7f81d77fe700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81d8142680 0x7f81d81e3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:19.324 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.317+0000 7f81d6ffd700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d80b7f80 0x7f81d813dda0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f81cc014040 tx=0x7f81cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:19.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.317+0000 7f81bffff700 1 -- 172.21.15.123:0/2758934108 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0038a0 con 0x7f81d80b7f80 2023-03-08T15:50:19.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.317+0000 7f81bffff700 1 -- 172.21.15.123:0/2758934108 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc01e070 con 0x7f81d80b7f80 2023-03-08T15:50:19.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.317+0000 7f81dd87a700 1 -- 172.21.15.123:0/2758934108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d80ba8e0 con 0x7f81d80b7f80 2023-03-08T15:50:19.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.317+0000 7f81bffff700 1 -- 172.21.15.123:0/2758934108 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc003c60 con 0x7f81d80b7f80 2023-03-08T15:50:19.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.317+0000 7f81dd87a700 1 -- 172.21.15.123:0/2758934108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d8072330 con 0x7f81d80b7f80 2023-03-08T15:50:19.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.318+0000 7f81dd87a700 1 -- 172.21.15.123:0/2758934108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d80b8dd0 con 0x7f81d80b7f80 2023-03-08T15:50:19.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.318+0000 7f81bffff700 1 -- 172.21.15.123:0/2758934108 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f81cc00f050 con 0x7f81d80b7f80 2023-03-08T15:50:19.325 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.318+0000 7f81bffff700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f81c40698d0 0x7f81c406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.319+0000 7f81bffff700 1 -- 172.21.15.123:0/2758934108 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f81cc088420 con 0x7f81d80b7f80 2023-03-08T15:50:19.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.319+0000 7f81d67fc700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f81c40698d0 0x7f81c406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.319+0000 7f81d67fc700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f81c40698d0 0x7f81c406bd80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f81d814a4b0 tx=0x7f81c8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:19.326 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.323+0000 7f81bffff700 1 -- 172.21.15.123:0/2758934108 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f81cc054540 con 0x7f81d80b7f80 2023-03-08T15:50:19.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.506+0000 7f81dd87a700 1 -- 172.21.15.123:0/2758934108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81d80744c0 con 0x7f81d80b7f80 2023-03-08T15:50:19.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.507+0000 7f81bffff700 1 -- 172.21.15.123:0/2758934108 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+14315 (secure 0 0 0) 0x7f81cc020090 con 0x7f81d80b7f80 2023-03-08T15:50:19.509 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:19.509 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":30,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:50:16.279129+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:50:19.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.510+0000 7f81dd87a700 1 -- 172.21.15.123:0/2758934108 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f81c40698d0 msgr2=0x7f81c406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.510+0000 7f81dd87a700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f81c40698d0 0x7f81c406bd80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f81d814a4b0 tx=0x7f81c8009040 comp rx=0 tx=0).stop 2023-03-08T15:50:19.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.510+0000 7f81dd87a700 1 -- 172.21.15.123:0/2758934108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d80b7f80 msgr2=0x7f81d813dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.510+0000 7f81dd87a700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d80b7f80 0x7f81d813dda0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f81cc014040 tx=0x7f81cc004750 comp rx=0 tx=0).stop 2023-03-08T15:50:19.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.510+0000 7f81dd87a700 1 -- 172.21.15.123:0/2758934108 shutdown_connections 2023-03-08T15:50:19.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.510+0000 7f81dd87a700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f81c40698d0 0x7f81c406bd80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.510+0000 7f81dd87a700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81d8142680 0x7f81d81e3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.510+0000 7f81dd87a700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d80b7f80 0x7f81d813dda0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.510+0000 7f81dd87a700 1 --2- 172.21.15.123:0/2758934108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81d80b92f0 0x7f81d813f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.510+0000 7f81dd87a700 1 -- 172.21.15.123:0/2758934108 >> 172.21.15.123:0/2758934108 conn(0x7f81d806b360 msgr2=0x7f81d8071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:19.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.510+0000 7f81dd87a700 1 -- 172.21.15.123:0/2758934108 shutdown_connections 2023-03-08T15:50:19.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.510+0000 7f81dd87a700 1 -- 172.21.15.123:0/2758934108 wait complete. 2023-03-08T15:50:19.523 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-08T15:49:26.011228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-08T15:49:32.528343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-08T15:50:19.524 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-08T15:50:19.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.644+0000 7fafc9edb700 1 Processor -- start 2023-03-08T15:50:19.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.644+0000 7fafc9edb700 1 -- start start 2023-03-08T15:50:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.645+0000 7fafc9edb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fafc406abd0 0x7fafc41443c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.645+0000 7fafc9edb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fafc40afb80 0x7fafc4144900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.645+0000 7fafc9edb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc40b4990 con 0x7fafc40b5830 2023-03-08T15:50:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.645+0000 7fafc9edb700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc40b0010 con 0x7fafc406abd0 2023-03-08T15:50:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.645+0000 7fafc9edb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc40b4620 con 0x7fafc40afb80 2023-03-08T15:50:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.645+0000 7fafc37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fafc406abd0 0x7fafc41443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.645+0000 7fafc37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fafc406abd0 0x7fafc41443c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36678/0 (socket says 172.21.15.123:36678) 2023-03-08T15:50:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.645+0000 7fafc37fe700 1 -- 172.21.15.123:0/2071529956 learned_addr learned my addr 172.21.15.123:0/2071529956 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.645+0000 7fafc2ffd700 1 --2- 172.21.15.123:0/2071529956 >> v2:172.21.15.175:3300/0 conn(0x7fafc40afb80 0x7fafc4144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.645+0000 7fafc37fe700 1 -- 172.21.15.123:0/2071529956 >> v2:172.21.15.175:3300/0 conn(0x7fafc40afb80 msgr2=0x7fafc4144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.645+0000 7fafc37fe700 1 --2- 172.21.15.123:0/2071529956 >> v2:172.21.15.175:3300/0 conn(0x7fafc40afb80 0x7fafc4144900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.645+0000 7fafc37fe700 1 -- 172.21.15.123:0/2071529956 >> v1:172.21.15.175:6789/0 conn(0x7fafc40b5830 legacy=0x7fafc40b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.645+0000 7fafc37fe700 1 -- 172.21.15.123:0/2071529956 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc406afa0 con 0x7fafc406abd0 2023-03-08T15:50:19.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.646+0000 7fafc37fe700 1 --2- 172.21.15.123:0/2071529956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafc406abd0 0x7fafc41443c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fafc40b4400 tx=0x7fafac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2492348ce327beec server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:19.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.646+0000 7fafc27fc700 1 -- 172.21.15.123:0/2071529956 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac004230 con 0x7fafc406abd0 2023-03-08T15:50:19.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.646+0000 7fafc27fc700 1 -- 172.21.15.123:0/2071529956 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac004390 con 0x7fafc406abd0 2023-03-08T15:50:19.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.646+0000 7fafc27fc700 1 -- 172.21.15.123:0/2071529956 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac0036a0 con 0x7fafc406abd0 2023-03-08T15:50:19.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.646+0000 7fafc9edb700 1 -- 172.21.15.123:0/2071529956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafc406abd0 msgr2=0x7fafc41443c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.646+0000 7fafc9edb700 1 --2- 172.21.15.123:0/2071529956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafc406abd0 0x7fafc41443c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fafc40b4400 tx=0x7fafac009bd0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.646+0000 7fafc9edb700 1 -- 172.21.15.123:0/2071529956 shutdown_connections 2023-03-08T15:50:19.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.646+0000 7fafc9edb700 1 --2- 172.21.15.123:0/2071529956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafc406abd0 0x7fafc41443c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.646+0000 7fafc9edb700 1 --2- 172.21.15.123:0/2071529956 >> v2:172.21.15.175:3300/0 conn(0x7fafc40afb80 0x7fafc4144900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.646+0000 7fafc9edb700 1 -- 172.21.15.123:0/2071529956 >> 172.21.15.123:0/2071529956 conn(0x7fafc4065f10 msgr2=0x7fafc406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:19.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.646+0000 7fafc9edb700 1 -- 172.21.15.123:0/2071529956 shutdown_connections 2023-03-08T15:50:19.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.646+0000 7fafc9edb700 1 -- 172.21.15.123:0/2071529956 wait complete. 2023-03-08T15:50:19.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.647+0000 7fafc9edb700 1 Processor -- start 2023-03-08T15:50:19.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.648+0000 7fafc9edb700 1 -- start start 2023-03-08T15:50:19.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.648+0000 7fafc9edb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafc406abd0 0x7fafc40715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.648+0000 7fafc9edb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc40afb80 0x7fafc41e3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.648+0000 7fafc9edb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc40b5830 0x7fafc413dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.648+0000 7fafc9edb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc4071ae0 con 0x7fafc406abd0 2023-03-08T15:50:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.648+0000 7fafc9edb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc414c820 con 0x7fafc40afb80 2023-03-08T15:50:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.648+0000 7fafc9edb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40b2880 con 0x7fafc40b5830 2023-03-08T15:50:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.648+0000 7fafc37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafc406abd0 0x7fafc40715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.648+0000 7fafc37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafc406abd0 0x7fafc40715a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36680/0 (socket says 172.21.15.123:36680) 2023-03-08T15:50:19.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.648+0000 7fafc37fe700 1 -- 172.21.15.123:0/658012768 learned_addr learned my addr 172.21.15.123:0/658012768 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:19.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.648+0000 7fafc2ffd700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc40afb80 0x7fafc41e3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.649+0000 7fafc3fff700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc40b5830 0x7fafc413dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.649+0000 7fafc37fe700 1 -- 172.21.15.123:0/658012768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc40b5830 msgr2=0x7fafc413dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.649+0000 7fafc37fe700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc40b5830 0x7fafc413dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.649+0000 7fafc37fe700 1 -- 172.21.15.123:0/658012768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc40afb80 msgr2=0x7fafc41e3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.649+0000 7fafc37fe700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc40afb80 0x7fafc41e3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.649+0000 7fafc37fe700 1 -- 172.21.15.123:0/658012768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac009550 con 0x7fafc406abd0 2023-03-08T15:50:19.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.649+0000 7fafc2ffd700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc40afb80 0x7fafc41e3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:19.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.649+0000 7fafc3fff700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc40b5830 0x7fafc413dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:19.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.649+0000 7fafc37fe700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafc406abd0 0x7fafc40715a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fafac009130 tx=0x7fafac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:19.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.649+0000 7fafbbfff700 1 -- 172.21.15.123:0/658012768 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac003dc0 con 0x7fafc406abd0 2023-03-08T15:50:19.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.649+0000 7fafbbfff700 1 -- 172.21.15.123:0/658012768 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac01f070 con 0x7fafc406abd0 2023-03-08T15:50:19.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.649+0000 7fafbbfff700 1 -- 172.21.15.123:0/658012768 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac011870 con 0x7fafc406abd0 2023-03-08T15:50:19.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.649+0000 7fafc9edb700 1 -- 172.21.15.123:0/658012768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc4072790 con 0x7fafc406abd0 2023-03-08T15:50:19.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.649+0000 7fafc9edb700 1 -- 172.21.15.123:0/658012768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc4072600 con 0x7fafc406abd0 2023-03-08T15:50:19.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.650+0000 7fafc9edb700 1 -- 172.21.15.123:0/658012768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc40b68b0 con 0x7fafc406abd0 2023-03-08T15:50:19.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.650+0000 7fafbbfff700 1 -- 172.21.15.123:0/658012768 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fafac017020 con 0x7fafc406abd0 2023-03-08T15:50:19.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.651+0000 7fafbbfff700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafa40698d0 0x7fafa406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.651+0000 7fafbbfff700 1 -- 172.21.15.123:0/658012768 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fafac088b10 con 0x7fafc406abd0 2023-03-08T15:50:19.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.651+0000 7fafc2ffd700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafa40698d0 0x7fafa406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.651+0000 7fafc2ffd700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafa40698d0 0x7fafa406bd80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fafc40bd8d0 tx=0x7fafb4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:19.658 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.655+0000 7fafbbfff700 1 -- 172.21.15.123:0/658012768 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fafac054c30 con 0x7fafc406abd0 2023-03-08T15:50:19.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.838+0000 7fafc9edb700 1 -- 172.21.15.123:0/658012768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fafc40b13e0 con 0x7fafc406abd0 2023-03-08T15:50:19.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.838+0000 7fafbbfff700 1 -- 172.21.15.123:0/658012768 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fafac029020 con 0x7fafc406abd0 2023-03-08T15:50:19.840 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2023-03-08T15:50:19.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.840+0000 7fafc9edb700 1 -- 172.21.15.123:0/658012768 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafa40698d0 msgr2=0x7fafa406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.840+0000 7fafc9edb700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafa40698d0 0x7fafa406bd80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fafc40bd8d0 tx=0x7fafb4008040 comp rx=0 tx=0).stop 2023-03-08T15:50:19.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.840+0000 7fafc9edb700 1 -- 172.21.15.123:0/658012768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafc406abd0 msgr2=0x7fafc40715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.840+0000 7fafc9edb700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafc406abd0 0x7fafc40715a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fafac009130 tx=0x7fafac004750 comp rx=0 tx=0).stop 2023-03-08T15:50:19.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.840+0000 7fafc9edb700 1 -- 172.21.15.123:0/658012768 shutdown_connections 2023-03-08T15:50:19.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.840+0000 7fafc9edb700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fafa40698d0 0x7fafa406bd80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.840+0000 7fafc9edb700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc40b5830 0x7fafc413dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.840+0000 7fafc9edb700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafc406abd0 0x7fafc40715a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.840+0000 7fafc9edb700 1 --2- 172.21.15.123:0/658012768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc40afb80 0x7fafc41e3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.840+0000 7fafc9edb700 1 -- 172.21.15.123:0/658012768 >> 172.21.15.123:0/658012768 conn(0x7fafc4065f10 msgr2=0x7fafc4142a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:19.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.840+0000 7fafc9edb700 1 -- 172.21.15.123:0/658012768 shutdown_connections 2023-03-08T15:50:19.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.840+0000 7fafc9edb700 1 -- 172.21.15.123:0/658012768 wait complete. 2023-03-08T15:50:19.853 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-08T15:50:19.974 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.973+0000 7f65ebee8700 1 Processor -- start 2023-03-08T15:50:19.975 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.973+0000 7f65ebee8700 1 -- start start 2023-03-08T15:50:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.974+0000 7f65ebee8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65e406aee0 0x7f65e4146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.974+0000 7f65ebee8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e40b59c0 con 0x7f65e40b7900 2023-03-08T15:50:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.974+0000 7f65ebee8700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e40b8b10 con 0x7f65e41410a0 2023-03-08T15:50:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.974+0000 7f65ebee8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40b56e0 con 0x7f65e406aee0 2023-03-08T15:50:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.974+0000 7f65e9c84700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f65e40b7900 0x7f65e4140990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51890/0 (socket says 172.21.15.123:51890) 2023-03-08T15:50:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.974+0000 7f65e9c84700 1 -- 172.21.15.123:0/1176586122 learned_addr learned my addr 172.21.15.123:0/1176586122 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.974+0000 7f65e9483700 1 --2- 172.21.15.123:0/1176586122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65e406aee0 0x7f65e4146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.974+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235722050 0 0) 0x7f65e40b59c0 con 0x7f65e40b7900 2023-03-08T15:50:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.974+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65d00035b0 con 0x7f65e40b7900 2023-03-08T15:50:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361636910 0 0) 0x7f65e40b8b10 con 0x7f65e41410a0 2023-03-08T15:50:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65e40b59c0 con 0x7f65e41410a0 2023-03-08T15:50:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1267355571 0 0) 0x7f65d00035b0 con 0x7f65e40b7900 2023-03-08T15:50:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65e406aee0 msgr2=0x7f65e4146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 --2- 172.21.15.123:0/1176586122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65e406aee0 0x7f65e4146fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 >> v1:172.21.15.175:6789/0 conn(0x7f65e41410a0 legacy=0x7f65e4151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40b7cd0 con 0x7f65e40b7900 2023-03-08T15:50:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f65d4001670 con 0x7f65e40b7900 2023-03-08T15:50:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 >> v1:172.21.15.123:6789/0 conn(0x7f65e40b7900 legacy=0x7f65e4140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 --2- 172.21.15.123:0/1176586122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65d0003bc0 0x7f65d0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 --2- 172.21.15.123:0/1176586122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65e406aee0 0x7f65d0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 --2- 172.21.15.123:0/1176586122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d0004d90 0x7f65d0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40b56e0 con 0x7f65d0004d90 2023-03-08T15:50:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d000bba0 con 0x7f65d0003bc0 2023-03-08T15:50:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d000bd10 con 0x7f65e406aee0 2023-03-08T15:50:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65ea485700 1 --2- 172.21.15.123:0/1176586122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d0004d90 0x7f65d0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e9c84700 1 --2- 172.21.15.123:0/1176586122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65d0003bc0 0x7f65d0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e9483700 1 --2- 172.21.15.123:0/1176586122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65e406aee0 0x7f65d0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65ea485700 1 -- 172.21.15.123:0/1176586122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65e406aee0 msgr2=0x7f65d0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65ea485700 1 --2- 172.21.15.123:0/1176586122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65e406aee0 0x7f65d0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65ea485700 1 -- 172.21.15.123:0/1176586122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65d0003bc0 msgr2=0x7f65d0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65ea485700 1 --2- 172.21.15.123:0/1176586122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65d0003bc0 0x7f65d0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65ea485700 1 -- 172.21.15.123:0/1176586122 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d00035b0 con 0x7f65d0004d90 2023-03-08T15:50:19.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65ea485700 1 --2- 172.21.15.123:0/1176586122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d0004d90 0x7f65d0005200 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f65dc002230 tx=0x7f65d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd59f79745b6e7b6 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:19.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc001f30 con 0x7f65d0004d90 2023-03-08T15:50:19.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc00ce80 con 0x7f65d0004d90 2023-03-08T15:50:19.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.975+0000 7f65e8c82700 1 -- 172.21.15.123:0/1176586122 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc003c40 con 0x7f65d0004d90 2023-03-08T15:50:19.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.976+0000 7f65ebee8700 1 -- 172.21.15.123:0/1176586122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d0004d90 msgr2=0x7f65d0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.976+0000 7f65ebee8700 1 --2- 172.21.15.123:0/1176586122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d0004d90 0x7f65d0005200 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f65dc002230 tx=0x7f65d0005880 comp rx=0 tx=0).stop 2023-03-08T15:50:19.982 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.976+0000 7f65ea485700 1 -- 172.21.15.123:0/1176586122 reap_dead start 2023-03-08T15:50:19.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.976+0000 7f65ebee8700 1 -- 172.21.15.123:0/1176586122 shutdown_connections 2023-03-08T15:50:19.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.976+0000 7f65ebee8700 1 -- 172.21.15.123:0/1176586122 >> 172.21.15.123:0/1176586122 conn(0x7f65e40bc480 msgr2=0x7f65e40bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:19.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.976+0000 7f65ebee8700 1 -- 172.21.15.123:0/1176586122 shutdown_connections 2023-03-08T15:50:19.983 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.976+0000 7f65ebee8700 1 -- 172.21.15.123:0/1176586122 wait complete. 2023-03-08T15:50:19.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.977+0000 7f65ebee8700 1 Processor -- start 2023-03-08T15:50:19.985 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.977+0000 7f65ebee8700 1 -- start start 2023-03-08T15:50:19.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ebee8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65d0004d90 0x7f65e41419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ebee8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65e41d1320 0x7f65e41e3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ebee8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65e41e3680 0x7f65e4138200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ebee8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e41e3af0 con 0x7f65e41e3680 2023-03-08T15:50:19.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ebee8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e41447d0 con 0x7f65e41d1320 2023-03-08T15:50:19.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ebee8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e41d1790 con 0x7f65d0004d90 2023-03-08T15:50:19.986 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ea485700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65e41e3680 0x7f65e4138200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ea485700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65e41e3680 0x7f65e4138200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36690/0 (socket says 172.21.15.123:36690) 2023-03-08T15:50:19.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ea485700 1 -- 172.21.15.123:0/580642525 learned_addr learned my addr 172.21.15.123:0/580642525 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:19.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65e9483700 1 --2- 172.21.15.123:0/580642525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65e41d1320 0x7f65e41e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65e9c84700 1 --2- 172.21.15.123:0/580642525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65d0004d90 0x7f65e41419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ea485700 1 -- 172.21.15.123:0/580642525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65d0004d90 msgr2=0x7f65e41419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ea485700 1 --2- 172.21.15.123:0/580642525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65d0004d90 0x7f65e41419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.987 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ea485700 1 -- 172.21.15.123:0/580642525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65e41d1320 msgr2=0x7f65e41e3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ea485700 1 --2- 172.21.15.123:0/580642525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65e41d1320 0x7f65e41e3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ea485700 1 -- 172.21.15.123:0/580642525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40bd360 con 0x7f65e41e3680 2023-03-08T15:50:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ea485700 1 --2- 172.21.15.123:0/580642525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65e41e3680 0x7f65e4138200 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f65dc004000 tx=0x7f65dc001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65da7fc700 1 -- 172.21.15.123:0/580642525 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc003e10 con 0x7f65e41e3680 2023-03-08T15:50:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65da7fc700 1 -- 172.21.15.123:0/580642525 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc0050d0 con 0x7f65e41e3680 2023-03-08T15:50:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ebee8700 1 -- 172.21.15.123:0/580642525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e40bd1d0 con 0x7f65e41e3680 2023-03-08T15:50:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65da7fc700 1 -- 172.21.15.123:0/580642525 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc005480 con 0x7f65e41e3680 2023-03-08T15:50:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.978+0000 7f65ebee8700 1 -- 172.21.15.123:0/580642525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e40b8320 con 0x7f65e41e3680 2023-03-08T15:50:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.979+0000 7f65ebee8700 1 -- 172.21.15.123:0/580642525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e41e2f90 con 0x7f65e41e3680 2023-03-08T15:50:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.980+0000 7f65da7fc700 1 -- 172.21.15.123:0/580642525 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f65dc010050 con 0x7f65e41e3680 2023-03-08T15:50:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.980+0000 7f65da7fc700 1 --2- 172.21.15.123:0/580642525 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f65c8069860 0x7f65c806bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.980+0000 7f65e9c84700 1 --2- 172.21.15.123:0/580642525 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f65c8069860 0x7f65c806bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.980+0000 7f65da7fc700 1 -- 172.21.15.123:0/580642525 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f65dc088600 con 0x7f65e41e3680 2023-03-08T15:50:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.980+0000 7f65e9c84700 1 --2- 172.21.15.123:0/580642525 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f65c8069860 0x7f65c806bd10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f65d4001eb0 tx=0x7f65d4001040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:19.984+0000 7f65da7fc700 1 -- 172.21.15.123:0/580642525 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f65dc054720 con 0x7f65e41e3680 2023-03-08T15:50:20.172 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.171+0000 7f65ebee8700 1 -- 172.21.15.123:0/580642525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f65e41468d0 con 0x7f65e41e3680 2023-03-08T15:50:20.173 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.172+0000 7f65da7fc700 1 -- 172.21.15.123:0/580642525 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f65dc00ce80 con 0x7f65e41e3680 2023-03-08T15:50:20.173 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 8 2023-03-08T15:50:20.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.173+0000 7f65ebee8700 1 -- 172.21.15.123:0/580642525 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f65c8069860 msgr2=0x7f65c806bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:20.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.173+0000 7f65ebee8700 1 --2- 172.21.15.123:0/580642525 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f65c8069860 0x7f65c806bd10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f65d4001eb0 tx=0x7f65d4001040 comp rx=0 tx=0).stop 2023-03-08T15:50:20.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.173+0000 7f65ebee8700 1 -- 172.21.15.123:0/580642525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65e41e3680 msgr2=0x7f65e4138200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:20.175 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.173+0000 7f65ebee8700 1 --2- 172.21.15.123:0/580642525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65e41e3680 0x7f65e4138200 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f65dc004000 tx=0x7f65dc001650 comp rx=0 tx=0).stop 2023-03-08T15:50:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.174+0000 7f65ebee8700 1 -- 172.21.15.123:0/580642525 shutdown_connections 2023-03-08T15:50:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.174+0000 7f65ebee8700 1 --2- 172.21.15.123:0/580642525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65e41e3680 0x7f65e4138200 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.174+0000 7f65ebee8700 1 --2- 172.21.15.123:0/580642525 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f65c8069860 0x7f65c806bd10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.174+0000 7f65ebee8700 1 --2- 172.21.15.123:0/580642525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65d0004d90 0x7f65e41419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.174+0000 7f65ebee8700 1 --2- 172.21.15.123:0/580642525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65e41d1320 0x7f65e41e3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.174+0000 7f65ebee8700 1 -- 172.21.15.123:0/580642525 >> 172.21.15.123:0/580642525 conn(0x7f65e40bc480 msgr2=0x7f65e413f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.174+0000 7f65ebee8700 1 -- 172.21.15.123:0/580642525 shutdown_connections 2023-03-08T15:50:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.174+0000 7f65ebee8700 1 -- 172.21.15.123:0/580642525 wait complete. 2023-03-08T15:50:20.187 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-08T15:50:20.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.305+0000 7ffa133be700 1 Processor -- start 2023-03-08T15:50:20.306 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.305+0000 7ffa133be700 1 -- start start 2023-03-08T15:50:20.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.305+0000 7ffa133be700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffa0c0b3c50 0x7ffa0c148970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:20.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa133be700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c0bd420 con 0x7ffa0c148eb0 2023-03-08T15:50:20.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa133be700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c071cd0 con 0x7ffa0c0b6a00 2023-03-08T15:50:20.309 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa133be700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0c142cc0 con 0x7ffa0c0b3c50 2023-03-08T15:50:20.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa1195b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ffa0c148eb0 0x7ffa0c152d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51900/0 (socket says 172.21.15.123:51900) 2023-03-08T15:50:20.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa1195b700 1 -- 172.21.15.123:0/2876928218 learned_addr learned my addr 172.21.15.123:0/2876928218 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:20.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa10959700 1 --2- 172.21.15.123:0/2876928218 >> v2:172.21.15.175:3300/0 conn(0x7ffa0c0b3c50 0x7ffa0c148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:20.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa03fff700 1 -- 172.21.15.123:0/2876928218 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231489208 0 0) 0x7ffa0c0bd420 con 0x7ffa0c148eb0 2023-03-08T15:50:20.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa03fff700 1 -- 172.21.15.123:0/2876928218 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9f80035b0 con 0x7ffa0c148eb0 2023-03-08T15:50:20.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa03fff700 1 -- 172.21.15.123:0/2876928218 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3587244684 0 0) 0x7ff9f80035b0 con 0x7ffa0c148eb0 2023-03-08T15:50:20.310 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa03fff700 1 -- 172.21.15.123:0/2876928218 >> v2:172.21.15.175:3300/0 conn(0x7ffa0c0b3c50 msgr2=0x7ffa0c148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:20.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa03fff700 1 --2- 172.21.15.123:0/2876928218 >> v2:172.21.15.175:3300/0 conn(0x7ffa0c0b3c50 0x7ffa0c148970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa03fff700 1 -- 172.21.15.123:0/2876928218 >> v1:172.21.15.175:6789/0 conn(0x7ffa0c0b6a00 legacy=0x7ffa0c06b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:20.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa03fff700 1 -- 172.21.15.123:0/2876928218 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c06b970 con 0x7ffa0c148eb0 2023-03-08T15:50:20.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa03fff700 1 -- 172.21.15.123:0/2876928218 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7ffa040019f0 con 0x7ffa0c148eb0 2023-03-08T15:50:20.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa03fff700 1 -- 172.21.15.123:0/2876928218 >> v1:172.21.15.123:6789/0 conn(0x7ffa0c148eb0 legacy=0x7ffa0c152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:20.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa03fff700 1 --2- 172.21.15.123:0/2876928218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9f8003a00 0x7ff9f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:20.311 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa03fff700 1 --2- 172.21.15.123:0/2876928218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9f80043f0 0x7ff9f80048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:20.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa03fff700 1 --2- 172.21.15.123:0/2876928218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f8005150 0x7ff9f800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:20.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa03fff700 1 -- 172.21.15.123:0/2876928218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c142cc0 con 0x7ff9f80043f0 2023-03-08T15:50:20.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa03fff700 1 -- 172.21.15.123:0/2876928218 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f800c080 con 0x7ff9f8005150 2023-03-08T15:50:20.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa03fff700 1 -- 172.21.15.123:0/2876928218 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f800c240 con 0x7ff9f8003a00 2023-03-08T15:50:20.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa10959700 1 --2- 172.21.15.123:0/2876928218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9f80043f0 0x7ff9f80048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:20.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa1115a700 1 --2- 172.21.15.123:0/2876928218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9f8003a00 0x7ff9f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:20.312 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.306+0000 7ffa1195b700 1 --2- 172.21.15.123:0/2876928218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f8005150 0x7ff9f800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:20.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa10959700 1 -- 172.21.15.123:0/2876928218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9f8003a00 msgr2=0x7ff9f8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:20.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa10959700 1 --2- 172.21.15.123:0/2876928218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9f8003a00 0x7ff9f8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa10959700 1 -- 172.21.15.123:0/2876928218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f8005150 msgr2=0x7ff9f800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:20.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa10959700 1 --2- 172.21.15.123:0/2876928218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f8005150 0x7ff9f800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa10959700 1 -- 172.21.15.123:0/2876928218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f80035b0 con 0x7ff9f80043f0 2023-03-08T15:50:20.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa1195b700 1 --2- 172.21.15.123:0/2876928218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f8005150 0x7ff9f800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:20.313 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa1195b700 1 -- 172.21.15.123:0/2876928218 reap_dead start 2023-03-08T15:50:20.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa10959700 1 --2- 172.21.15.123:0/2876928218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9f80043f0 0x7ff9f80048b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009b30 tx=0x7ff9f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b791e8c8ba4eee97 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:20.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa03fff700 1 -- 172.21.15.123:0/2876928218 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc00e6c0 con 0x7ff9f80043f0 2023-03-08T15:50:20.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa03fff700 1 -- 172.21.15.123:0/2876928218 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc00e820 con 0x7ff9f80043f0 2023-03-08T15:50:20.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa03fff700 1 -- 172.21.15.123:0/2876928218 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc00eb90 con 0x7ff9f80043f0 2023-03-08T15:50:20.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa133be700 1 -- 172.21.15.123:0/2876928218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9f80043f0 msgr2=0x7ff9f80048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:20.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa133be700 1 --2- 172.21.15.123:0/2876928218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9f80043f0 0x7ff9f80048b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009b30 tx=0x7ff9f8005880 comp rx=0 tx=0).stop 2023-03-08T15:50:20.314 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa133be700 1 -- 172.21.15.123:0/2876928218 shutdown_connections 2023-03-08T15:50:20.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa133be700 1 --2- 172.21.15.123:0/2876928218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9f80043f0 0x7ff9f80048b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa133be700 1 -- 172.21.15.123:0/2876928218 >> 172.21.15.123:0/2876928218 conn(0x7ffa0c0ba3c0 msgr2=0x7ffa0c0bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:20.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa133be700 1 -- 172.21.15.123:0/2876928218 shutdown_connections 2023-03-08T15:50:20.315 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.307+0000 7ffa133be700 1 -- 172.21.15.123:0/2876928218 wait complete. 2023-03-08T15:50:20.317 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.308+0000 7ffa133be700 1 Processor -- start 2023-03-08T15:50:20.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.308+0000 7ffa133be700 1 -- start start 2023-03-08T15:50:20.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa133be700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f80043f0 0x7ffa0c140d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:20.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa133be700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa0c143ba0 0x7ffa0c1e1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:20.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa133be700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa0c1e1740 0x7ffa0c13d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:20.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa133be700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c1412d0 con 0x7ffa0c1e1740 2023-03-08T15:50:20.318 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa133be700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c1cfc50 con 0x7ff9f80043f0 2023-03-08T15:50:20.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa133be700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c1e1bb0 con 0x7ffa0c143ba0 2023-03-08T15:50:20.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa1195b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa0c1e1740 0x7ffa0c13d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:20.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa1195b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa0c1e1740 0x7ffa0c13d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36718/0 (socket says 172.21.15.123:36718) 2023-03-08T15:50:20.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa1195b700 1 -- 172.21.15.123:0/1776091019 learned_addr learned my addr 172.21.15.123:0/1776091019 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:20.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa10959700 1 --2- 172.21.15.123:0/1776091019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa0c143ba0 0x7ffa0c1e1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:20.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa1115a700 1 --2- 172.21.15.123:0/1776091019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f80043f0 0x7ffa0c140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:20.319 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa1195b700 1 -- 172.21.15.123:0/1776091019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa0c143ba0 msgr2=0x7ffa0c1e1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:20.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa1195b700 1 --2- 172.21.15.123:0/1776091019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa0c143ba0 0x7ffa0c1e1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa1195b700 1 -- 172.21.15.123:0/1776091019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f80043f0 msgr2=0x7ffa0c140d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:20.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa1195b700 1 --2- 172.21.15.123:0/1776091019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f80043f0 0x7ffa0c140d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa1195b700 1 -- 172.21.15.123:0/1776091019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c071f20 con 0x7ffa0c1e1740 2023-03-08T15:50:20.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.309+0000 7ffa10959700 1 --2- 172.21.15.123:0/1776091019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa0c143ba0 0x7ffa0c1e1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:20.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.310+0000 7ffa1195b700 1 --2- 172.21.15.123:0/1776091019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa0c1e1740 0x7ffa0c13d8c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c149280 tx=0x7ffa0400e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:20.320 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.310+0000 7ffa01ffb700 1 -- 172.21.15.123:0/1776091019 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04017070 con 0x7ffa0c1e1740 2023-03-08T15:50:20.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.310+0000 7ffa01ffb700 1 -- 172.21.15.123:0/1776091019 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0400ecd0 con 0x7ffa0c1e1740 2023-03-08T15:50:20.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.310+0000 7ffa133be700 1 -- 172.21.15.123:0/1776091019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0c0bd670 con 0x7ffa0c1e1740 2023-03-08T15:50:20.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.310+0000 7ffa01ffb700 1 -- 172.21.15.123:0/1776091019 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0400ee80 con 0x7ffa0c1e1740 2023-03-08T15:50:20.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.310+0000 7ffa133be700 1 -- 172.21.15.123:0/1776091019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c1492d0 con 0x7ffa0c1e1740 2023-03-08T15:50:20.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.311+0000 7ffa133be700 1 -- 172.21.15.123:0/1776091019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0c1e1050 con 0x7ffa0c1e1740 2023-03-08T15:50:20.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.311+0000 7ffa01ffb700 1 -- 172.21.15.123:0/1776091019 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7ffa04013420 con 0x7ffa0c1e1740 2023-03-08T15:50:20.321 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.312+0000 7ffa01ffb700 1 --2- 172.21.15.123:0/1776091019 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff9f00698d0 0x7ff9f006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:20.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.312+0000 7ffa1115a700 1 --2- 172.21.15.123:0/1776091019 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff9f00698d0 0x7ff9f006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:20.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.312+0000 7ffa01ffb700 1 -- 172.21.15.123:0/1776091019 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ffa04087200 con 0x7ffa0c1e1740 2023-03-08T15:50:20.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.312+0000 7ffa1115a700 1 --2- 172.21.15.123:0/1776091019 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff9f00698d0 0x7ff9f006bd80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffa08000c00 tx=0x7ffa08009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:20.322 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.316+0000 7ffa01ffb700 1 -- 172.21.15.123:0/1776091019 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7ffa040531d0 con 0x7ffa0c1e1740 2023-03-08T15:50:20.504 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.503+0000 7ffa133be700 1 -- 172.21.15.123:0/1776091019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ffa0c0744c0 con 0x7ffa0c1e1740 2023-03-08T15:50:20.505 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.503+0000 7ffa01ffb700 1 -- 172.21.15.123:0/1776091019 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+126 (secure 0 0 0) 0x7ffa040567f0 con 0x7ffa0c1e1740 2023-03-08T15:50:20.505 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:20.505 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2023-03-08T15:50:20.505 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:20.505 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2023-03-08T15:50:20.506 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2023-03-08T15:50:20.506 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2023-03-08T15:50:20.506 INFO:teuthology.orchestra.run.smithi123.stdout: { 2023-03-08T15:50:20.506 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 2, 2023-03-08T15:50:20.506 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": "rbd" 2023-03-08T15:50:20.506 INFO:teuthology.orchestra.run.smithi123.stdout: } 2023-03-08T15:50:20.506 INFO:teuthology.orchestra.run.smithi123.stdout:] 2023-03-08T15:50:20.507 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.505+0000 7ffa133be700 1 -- 172.21.15.123:0/1776091019 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff9f00698d0 msgr2=0x7ff9f006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:20.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.505+0000 7ffa133be700 1 --2- 172.21.15.123:0/1776091019 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff9f00698d0 0x7ff9f006bd80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffa08000c00 tx=0x7ffa08009040 comp rx=0 tx=0).stop 2023-03-08T15:50:20.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.505+0000 7ffa133be700 1 -- 172.21.15.123:0/1776091019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa0c1e1740 msgr2=0x7ffa0c13d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:20.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.505+0000 7ffa133be700 1 --2- 172.21.15.123:0/1776091019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa0c1e1740 0x7ffa0c13d8c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c149280 tx=0x7ffa0400e440 comp rx=0 tx=0).stop 2023-03-08T15:50:20.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.505+0000 7ffa133be700 1 -- 172.21.15.123:0/1776091019 shutdown_connections 2023-03-08T15:50:20.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.505+0000 7ffa133be700 1 --2- 172.21.15.123:0/1776091019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa0c1e1740 0x7ffa0c13d8c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.505+0000 7ffa133be700 1 --2- 172.21.15.123:0/1776091019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f80043f0 0x7ffa0c140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.508 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.505+0000 7ffa133be700 1 --2- 172.21.15.123:0/1776091019 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7ff9f00698d0 0x7ff9f006bd80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.505+0000 7ffa133be700 1 --2- 172.21.15.123:0/1776091019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa0c143ba0 0x7ffa0c1e1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.505+0000 7ffa133be700 1 -- 172.21.15.123:0/1776091019 >> 172.21.15.123:0/1776091019 conn(0x7ffa0c0ba3c0 msgr2=0x7ffa0c0baf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:20.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.505+0000 7ffa133be700 1 -- 172.21.15.123:0/1776091019 shutdown_connections 2023-03-08T15:50:20.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.505+0000 7ffa133be700 1 -- 172.21.15.123:0/1776091019 wait complete. 2023-03-08T15:50:20.521 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-08T15:50:20.521 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-08T15:50:20.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.643+0000 7fde94f3f700 1 Processor -- start 2023-03-08T15:50:20.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.643+0000 7fde94f3f700 1 -- start start 2023-03-08T15:50:20.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.644+0000 7fde94f3f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fde9014b9b0 0x7fde900b92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:20.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.644+0000 7fde94f3f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde900ba690 con 0x7fde900b7f80 2023-03-08T15:50:20.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.644+0000 7fde94f3f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde90072330 con 0x7fde90142680 2023-03-08T15:50:20.646 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.644+0000 7fde94f3f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde900b71e0 con 0x7fde9014b9b0 2023-03-08T15:50:20.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.644+0000 7fde8ed9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fde9014b9b0 0x7fde900b92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:20.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.644+0000 7fde8dd9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fde900b7f80 0x7fde90150d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51906/0 (socket says 172.21.15.123:51906) 2023-03-08T15:50:20.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.644+0000 7fde8dd9b700 1 -- 172.21.15.123:0/3833073780 learned_addr learned my addr 172.21.15.123:0/3833073780 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:20.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.644+0000 7fde8ed9d700 1 -- 172.21.15.123:0/3833073780 >> v1:172.21.15.175:6789/0 conn(0x7fde90142680 legacy=0x7fde90071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:20.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.644+0000 7fde8ed9d700 1 -- 172.21.15.123:0/3833073780 >> v1:172.21.15.123:6789/0 conn(0x7fde900b7f80 legacy=0x7fde90150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:20.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.644+0000 7fde8ed9d700 1 -- 172.21.15.123:0/3833073780 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde900ba8e0 con 0x7fde9014b9b0 2023-03-08T15:50:20.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.644+0000 7fde8d59a700 1 -- 172.21.15.123:0/3833073780 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014889532 0 0) 0x7fde900ba690 con 0x7fde900b7f80 2023-03-08T15:50:20.647 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.644+0000 7fde8ed9d700 1 --2- 172.21.15.123:0/3833073780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9014b9b0 0x7fde900b92f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fde88009d90 tx=0x7fde8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be240dd56997d60 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:20.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.645+0000 7fde8d59a700 1 -- 172.21.15.123:0/3833073780 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8800e070 con 0x7fde9014b9b0 2023-03-08T15:50:20.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.645+0000 7fde8d59a700 1 -- 172.21.15.123:0/3833073780 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8800bbd0 con 0x7fde9014b9b0 2023-03-08T15:50:20.648 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.645+0000 7fde8d59a700 1 -- 172.21.15.123:0/3833073780 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88003a20 con 0x7fde9014b9b0 2023-03-08T15:50:20.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.645+0000 7fde94f3f700 1 -- 172.21.15.123:0/3833073780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9014b9b0 msgr2=0x7fde900b92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:20.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.645+0000 7fde94f3f700 1 --2- 172.21.15.123:0/3833073780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9014b9b0 0x7fde900b92f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fde88009d90 tx=0x7fde8800b330 comp rx=0 tx=0).stop 2023-03-08T15:50:20.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.645+0000 7fde94f3f700 1 -- 172.21.15.123:0/3833073780 shutdown_connections 2023-03-08T15:50:20.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.645+0000 7fde94f3f700 1 --2- 172.21.15.123:0/3833073780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9014b9b0 0x7fde900b92f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.645+0000 7fde94f3f700 1 -- 172.21.15.123:0/3833073780 >> 172.21.15.123:0/3833073780 conn(0x7fde9006b360 msgr2=0x7fde9006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:20.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.645+0000 7fde94f3f700 1 -- 172.21.15.123:0/3833073780 shutdown_connections 2023-03-08T15:50:20.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.645+0000 7fde94f3f700 1 -- 172.21.15.123:0/3833073780 wait complete. 2023-03-08T15:50:20.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.646+0000 7fde94f3f700 1 Processor -- start 2023-03-08T15:50:20.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.646+0000 7fde94f3f700 1 -- start start 2023-03-08T15:50:20.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.647+0000 7fde94f3f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde900b7f80 0x7fde90146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:20.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.647+0000 7fde94f3f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde90142680 0x7fde901e13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:20.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.647+0000 7fde94f3f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9014b9b0 0x7fde900bc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:20.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.647+0000 7fde94f3f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde900be350 con 0x7fde9014b9b0 2023-03-08T15:50:20.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.647+0000 7fde94f3f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde901e1900 con 0x7fde900b7f80 2023-03-08T15:50:20.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.647+0000 7fde94f3f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde901e1b70 con 0x7fde90142680 2023-03-08T15:50:20.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.647+0000 7fde8ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9014b9b0 0x7fde900bc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:20.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.647+0000 7fde8ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9014b9b0 0x7fde900bc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36724/0 (socket says 172.21.15.123:36724) 2023-03-08T15:50:20.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.647+0000 7fde8ed9d700 1 -- 172.21.15.123:0/3150294181 learned_addr learned my addr 172.21.15.123:0/3150294181 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:20.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.647+0000 7fde8e59c700 1 --2- 172.21.15.123:0/3150294181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde900b7f80 0x7fde90146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:20.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.647+0000 7fde8dd9b700 1 --2- 172.21.15.123:0/3150294181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde90142680 0x7fde901e13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:20.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.648+0000 7fde8ed9d700 1 -- 172.21.15.123:0/3150294181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde90142680 msgr2=0x7fde901e13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:20.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.648+0000 7fde8ed9d700 1 --2- 172.21.15.123:0/3150294181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde90142680 0x7fde901e13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.648+0000 7fde8ed9d700 1 -- 172.21.15.123:0/3150294181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde900b7f80 msgr2=0x7fde90146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:20.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.648+0000 7fde8ed9d700 1 --2- 172.21.15.123:0/3150294181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde900b7f80 0x7fde90146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.648+0000 7fde8ed9d700 1 -- 172.21.15.123:0/3150294181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde88009a70 con 0x7fde9014b9b0 2023-03-08T15:50:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.648+0000 7fde8ed9d700 1 --2- 172.21.15.123:0/3150294181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9014b9b0 0x7fde900bc560 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fde9006c020 tx=0x7fde88004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.648+0000 7fde7effd700 1 -- 172.21.15.123:0/3150294181 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88012430 con 0x7fde9014b9b0 2023-03-08T15:50:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.648+0000 7fde7effd700 1 -- 172.21.15.123:0/3150294181 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde880125b0 con 0x7fde9014b9b0 2023-03-08T15:50:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.648+0000 7fde94f3f700 1 -- 172.21.15.123:0/3150294181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde90142a50 con 0x7fde9014b9b0 2023-03-08T15:50:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.648+0000 7fde7effd700 1 -- 172.21.15.123:0/3150294181 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88012960 con 0x7fde9014b9b0 2023-03-08T15:50:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.648+0000 7fde94f3f700 1 -- 172.21.15.123:0/3150294181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde900b8dd0 con 0x7fde9014b9b0 2023-03-08T15:50:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.649+0000 7fde94f3f700 1 -- 172.21.15.123:0/3150294181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde900bad10 con 0x7fde9014b9b0 2023-03-08T15:50:20.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.649+0000 7fde7effd700 1 -- 172.21.15.123:0/3150294181 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fde8801d420 con 0x7fde9014b9b0 2023-03-08T15:50:20.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.650+0000 7fde7effd700 1 --2- 172.21.15.123:0/3150294181 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fde700698d0 0x7fde7006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:20.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.650+0000 7fde7effd700 1 -- 172.21.15.123:0/3150294181 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fde88089b30 con 0x7fde9014b9b0 2023-03-08T15:50:20.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.650+0000 7fde8e59c700 1 --2- 172.21.15.123:0/3150294181 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fde700698d0 0x7fde7006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:20.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.650+0000 7fde8e59c700 1 --2- 172.21.15.123:0/3150294181 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fde700698d0 0x7fde7006bd80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde84007fd0 tx=0x7fde84007ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:20.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.654+0000 7fde7effd700 1 -- 172.21.15.123:0/3150294181 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fde88055b80 con 0x7fde9014b9b0 2023-03-08T15:50:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:20.839+0000 7fde94f3f700 1 -- 172.21.15.123:0/3150294181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fde900744c0 con 0x7fde9014b9b0 2023-03-08T15:50:21.184 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.183+0000 7fde7effd700 1 -- 172.21.15.123:0/3150294181 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7fde880591a0 con 0x7fde9014b9b0 2023-03-08T15:50:21.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.186+0000 7fde94f3f700 1 -- 172.21.15.123:0/3150294181 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fde700698d0 msgr2=0x7fde7006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:21.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.186+0000 7fde94f3f700 1 --2- 172.21.15.123:0/3150294181 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fde700698d0 0x7fde7006bd80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde84007fd0 tx=0x7fde84007ec0 comp rx=0 tx=0).stop 2023-03-08T15:50:21.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.186+0000 7fde94f3f700 1 -- 172.21.15.123:0/3150294181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9014b9b0 msgr2=0x7fde900bc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:21.188 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.186+0000 7fde94f3f700 1 --2- 172.21.15.123:0/3150294181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9014b9b0 0x7fde900bc560 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fde9006c020 tx=0x7fde88004ad0 comp rx=0 tx=0).stop 2023-03-08T15:50:21.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.187+0000 7fde94f3f700 1 -- 172.21.15.123:0/3150294181 shutdown_connections 2023-03-08T15:50:21.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.187+0000 7fde94f3f700 1 --2- 172.21.15.123:0/3150294181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9014b9b0 0x7fde900bc560 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:21.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.187+0000 7fde94f3f700 1 --2- 172.21.15.123:0/3150294181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde900b7f80 0x7fde90146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:21.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.187+0000 7fde94f3f700 1 --2- 172.21.15.123:0/3150294181 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fde700698d0 0x7fde7006bd80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:21.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.187+0000 7fde94f3f700 1 --2- 172.21.15.123:0/3150294181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde90142680 0x7fde901e13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:21.189 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.187+0000 7fde94f3f700 1 -- 172.21.15.123:0/3150294181 >> 172.21.15.123:0/3150294181 conn(0x7fde9006b360 msgr2=0x7fde9014ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:21.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.187+0000 7fde94f3f700 1 -- 172.21.15.123:0/3150294181 shutdown_connections 2023-03-08T15:50:21.190 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.187+0000 7fde94f3f700 1 -- 172.21.15.123:0/3150294181 wait complete. 2023-03-08T15:50:21.190 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2023-03-08T15:50:21.202 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-03-08T15:50:21.329 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.327+0000 7eff82571700 1 Processor -- start 2023-03-08T15:50:21.329 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.327+0000 7eff82571700 1 -- start start 2023-03-08T15:50:21.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.328+0000 7eff82571700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7eff7c06fef0 0x7eff7c14ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:21.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.328+0000 7eff82571700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c14b250 0x7eff7c155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:21.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.328+0000 7eff82571700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7c14b6f0 con 0x7eff7c147e50 2023-03-08T15:50:21.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.328+0000 7eff82571700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7c06a960 con 0x7eff7c06fef0 2023-03-08T15:50:21.331 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.328+0000 7eff82571700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c14a810 con 0x7eff7c14b250 2023-03-08T15:50:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.328+0000 7eff7b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7eff7c06fef0 0x7eff7c14ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.328+0000 7eff7bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7eff7c147e50 0x7eff7c06a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51910/0 (socket says 172.21.15.123:51910) 2023-03-08T15:50:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.328+0000 7eff7bfff700 1 -- 172.21.15.123:0/573422113 learned_addr learned my addr 172.21.15.123:0/573422113 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.328+0000 7eff7b7fe700 1 --2- 172.21.15.123:0/573422113 >> v2:172.21.15.123:3300/0 conn(0x7eff7c06fef0 0x7eff7c14ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36728/0 (socket says 172.21.15.123:36728) 2023-03-08T15:50:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.328+0000 7eff7b7fe700 1 -- 172.21.15.123:0/573422113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c14b250 msgr2=0x7eff7c155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.328+0000 7eff7b7fe700 1 --2- 172.21.15.123:0/573422113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c14b250 0x7eff7c155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.328+0000 7eff7b7fe700 1 -- 172.21.15.123:0/573422113 >> v1:172.21.15.123:6789/0 conn(0x7eff7c147e50 legacy=0x7eff7c06a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.328+0000 7eff7b7fe700 1 -- 172.21.15.123:0/573422113 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7c071a40 con 0x7eff7c06fef0 2023-03-08T15:50:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.328+0000 7eff7affd700 1 -- 172.21.15.123:0/573422113 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528576772 0 0) 0x7eff7c14b6f0 con 0x7eff7c147e50 2023-03-08T15:50:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.329+0000 7eff7b7fe700 1 --2- 172.21.15.123:0/573422113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7c06fef0 0x7eff7c14ad10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009840 tx=0x7eff6c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fca927bb9862af server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.329+0000 7eff7affd700 1 -- 172.21.15.123:0/573422113 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c011830 con 0x7eff7c06fef0 2023-03-08T15:50:21.333 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.329+0000 7eff7affd700 1 -- 172.21.15.123:0/573422113 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c011990 con 0x7eff7c06fef0 2023-03-08T15:50:21.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.329+0000 7eff7affd700 1 -- 172.21.15.123:0/573422113 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c011d20 con 0x7eff7c06fef0 2023-03-08T15:50:21.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.329+0000 7eff82571700 1 -- 172.21.15.123:0/573422113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7c06fef0 msgr2=0x7eff7c14ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:21.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.329+0000 7eff82571700 1 --2- 172.21.15.123:0/573422113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7c06fef0 0x7eff7c14ad10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009840 tx=0x7eff6c009b50 comp rx=0 tx=0).stop 2023-03-08T15:50:21.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.329+0000 7eff82571700 1 -- 172.21.15.123:0/573422113 shutdown_connections 2023-03-08T15:50:21.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.329+0000 7eff82571700 1 --2- 172.21.15.123:0/573422113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c14b250 0x7eff7c155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:21.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.329+0000 7eff82571700 1 --2- 172.21.15.123:0/573422113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7c06fef0 0x7eff7c14ad10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:21.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.329+0000 7eff82571700 1 -- 172.21.15.123:0/573422113 >> 172.21.15.123:0/573422113 conn(0x7eff7c06b360 msgr2=0x7eff7c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:21.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.329+0000 7eff82571700 1 -- 172.21.15.123:0/573422113 shutdown_connections 2023-03-08T15:50:21.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.329+0000 7eff82571700 1 -- 172.21.15.123:0/573422113 wait complete. 2023-03-08T15:50:21.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.331+0000 7eff82571700 1 Processor -- start 2023-03-08T15:50:21.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.331+0000 7eff82571700 1 -- start start 2023-03-08T15:50:21.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff82571700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7c06fef0 0x7eff7c0bb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:21.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff82571700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c147e50 0x7eff7c14de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:21.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff82571700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7c14b250 0x7eff7c0b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:21.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff82571700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c14e350 con 0x7eff7c06fef0 2023-03-08T15:50:21.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff82571700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c14baa0 con 0x7eff7c14b250 2023-03-08T15:50:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff82571700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c14caf0 con 0x7eff7c147e50 2023-03-08T15:50:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff7bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7c06fef0 0x7eff7c0bb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff7bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7c06fef0 0x7eff7c0bb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36734/0 (socket says 172.21.15.123:36734) 2023-03-08T15:50:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff7bfff700 1 -- 172.21.15.123:0/2450054357 learned_addr learned my addr 172.21.15.123:0/2450054357 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff7b7fe700 1 --2- 172.21.15.123:0/2450054357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c147e50 0x7eff7c14de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:21.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff80b0e700 1 --2- 172.21.15.123:0/2450054357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7c14b250 0x7eff7c0b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:21.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff7bfff700 1 -- 172.21.15.123:0/2450054357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c147e50 msgr2=0x7eff7c14de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:21.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff7bfff700 1 --2- 172.21.15.123:0/2450054357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c147e50 0x7eff7c14de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:21.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff7bfff700 1 -- 172.21.15.123:0/2450054357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7c14b250 msgr2=0x7eff7c0b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:21.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff7bfff700 1 --2- 172.21.15.123:0/2450054357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7c14b250 0x7eff7c0b5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff7bfff700 1 -- 172.21.15.123:0/2450054357 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c0094a0 con 0x7eff7c06fef0 2023-03-08T15:50:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff80b0e700 1 --2- 172.21.15.123:0/2450054357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7c14b250 0x7eff7c0b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff7bfff700 1 --2- 172.21.15.123:0/2450054357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7c06fef0 0x7eff7c0bb590 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7eff700011e0 tx=0x7eff7000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff78ff9700 1 -- 172.21.15.123:0/2450054357 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70004c80 con 0x7eff7c06fef0 2023-03-08T15:50:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff78ff9700 1 -- 172.21.15.123:0/2450054357 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff70004de0 con 0x7eff7c06fef0 2023-03-08T15:50:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff82571700 1 -- 172.21.15.123:0/2450054357 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff7c072000 con 0x7eff7c06fef0 2023-03-08T15:50:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff78ff9700 1 -- 172.21.15.123:0/2450054357 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70007310 con 0x7eff7c06fef0 2023-03-08T15:50:21.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.332+0000 7eff82571700 1 -- 172.21.15.123:0/2450054357 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7c071d20 con 0x7eff7c06fef0 2023-03-08T15:50:21.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.333+0000 7eff82571700 1 -- 172.21.15.123:0/2450054357 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff7c148220 con 0x7eff7c06fef0 2023-03-08T15:50:21.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.334+0000 7eff78ff9700 1 -- 172.21.15.123:0/2450054357 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7eff7001a020 con 0x7eff7c06fef0 2023-03-08T15:50:21.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.334+0000 7eff78ff9700 1 --2- 172.21.15.123:0/2450054357 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7eff680698d0 0x7eff6806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:21.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.334+0000 7eff7b7fe700 1 --2- 172.21.15.123:0/2450054357 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7eff680698d0 0x7eff6806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:21.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.334+0000 7eff78ff9700 1 -- 172.21.15.123:0/2450054357 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5580+0+0 (secure 0 0 0) 0x7eff70087010 con 0x7eff7c06fef0 2023-03-08T15:50:21.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.335+0000 7eff7b7fe700 1 --2- 172.21.15.123:0/2450054357 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7eff680698d0 0x7eff6806bd80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009840 tx=0x7eff6c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:21.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.339+0000 7eff78ff9700 1 -- 172.21.15.123:0/2450054357 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7eff70052fc0 con 0x7eff7c06fef0 2023-03-08T15:50:21.524 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:21.523+0000 7eff82571700 1 -- 172.21.15.123:0/2450054357 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7eff7c0744c0 con 0x7eff7c06fef0 2023-03-08T15:50:22.195 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.194+0000 7eff78ff9700 1 -- 172.21.15.123:0/2450054357 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7eff700565e0 con 0x7eff7c06fef0 2023-03-08T15:50:22.202 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.201+0000 7eff82571700 1 -- 172.21.15.123:0/2450054357 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7eff680698d0 msgr2=0x7eff6806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:22.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.201+0000 7eff82571700 1 --2- 172.21.15.123:0/2450054357 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7eff680698d0 0x7eff6806bd80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009840 tx=0x7eff6c008030 comp rx=0 tx=0).stop 2023-03-08T15:50:22.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.201+0000 7eff82571700 1 -- 172.21.15.123:0/2450054357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7c06fef0 msgr2=0x7eff7c0bb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:22.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.201+0000 7eff82571700 1 --2- 172.21.15.123:0/2450054357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7c06fef0 0x7eff7c0bb590 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7eff700011e0 tx=0x7eff7000ca30 comp rx=0 tx=0).stop 2023-03-08T15:50:22.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.201+0000 7eff82571700 1 -- 172.21.15.123:0/2450054357 shutdown_connections 2023-03-08T15:50:22.203 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.201+0000 7eff82571700 1 --2- 172.21.15.123:0/2450054357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7c14b250 0x7eff7c0b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.201+0000 7eff82571700 1 --2- 172.21.15.123:0/2450054357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff7c06fef0 0x7eff7c0bb590 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.201+0000 7eff82571700 1 --2- 172.21.15.123:0/2450054357 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7eff680698d0 0x7eff6806bd80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.201+0000 7eff82571700 1 --2- 172.21.15.123:0/2450054357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c147e50 0x7eff7c14de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.201+0000 7eff82571700 1 -- 172.21.15.123:0/2450054357 >> 172.21.15.123:0/2450054357 conn(0x7eff7c06b360 msgr2=0x7eff7c149890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:22.206 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.205+0000 7eff82571700 1 -- 172.21.15.123:0/2450054357 shutdown_connections 2023-03-08T15:50:22.207 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.206+0000 7eff82571700 1 -- 172.21.15.123:0/2450054357 wait complete. 2023-03-08T15:50:22.209 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2023-03-08T15:50:22.222 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-08T15:50:22.345 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.344+0000 7f10bfe1e700 1 Processor -- start 2023-03-08T15:50:22.346 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.344+0000 7f10bfe1e700 1 -- start start 2023-03-08T15:50:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bfe1e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f10b806b530 0x7f10b80b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bfe1e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f10b806f8d0 0x7f10b814a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bfe1e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10b8140980 0x7f10b8140de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bfe1e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b8071630 con 0x7f10b806f8d0 2023-03-08T15:50:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bfe1e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b8071280 con 0x7f10b806b530 2023-03-08T15:50:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bfe1e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b8072020 con 0x7f10b8140980 2023-03-08T15:50:22.348 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bd3b9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f10b806f8d0 0x7f10b814a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:22.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bd3b9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f10b806f8d0 0x7f10b814a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36740/0 (socket says 172.21.15.123:36740) 2023-03-08T15:50:22.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bd3b9700 1 -- 172.21.15.123:0/2011693862 learned_addr learned my addr 172.21.15.123:0/2011693862 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:22.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10be3bb700 1 --2- 172.21.15.123:0/2011693862 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10b8140980 0x7f10b8140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:22.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bdbba700 1 --2- 172.21.15.123:0/2011693862 >> v2:172.21.15.175:3300/0 conn(0x7f10b806b530 0x7f10b80b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:22.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bd3b9700 1 -- 172.21.15.123:0/2011693862 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10b8140980 msgr2=0x7f10b8140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:22.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bd3b9700 1 --2- 172.21.15.123:0/2011693862 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10b8140980 0x7f10b8140de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bd3b9700 1 -- 172.21.15.123:0/2011693862 >> v2:172.21.15.175:3300/0 conn(0x7f10b806b530 msgr2=0x7f10b80b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:22.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bd3b9700 1 --2- 172.21.15.123:0/2011693862 >> v2:172.21.15.175:3300/0 conn(0x7f10b806b530 0x7f10b80b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bd3b9700 1 -- 172.21.15.123:0/2011693862 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b806fe60 con 0x7f10b806f8d0 2023-03-08T15:50:22.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bd3b9700 1 --2- 172.21.15.123:0/2011693862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b806f8d0 0x7f10b814a010 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f10b8073d50 tx=0x7f10b400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ff198b79d2afa server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:22.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.345+0000 7f10bcbb8700 1 -- 172.21.15.123:0/2011693862 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b400dd30 con 0x7f10b806f8d0 2023-03-08T15:50:22.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.346+0000 7f10bcbb8700 1 -- 172.21.15.123:0/2011693862 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b400de90 con 0x7f10b806f8d0 2023-03-08T15:50:22.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.346+0000 7f10bcbb8700 1 -- 172.21.15.123:0/2011693862 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4010690 con 0x7f10b806f8d0 2023-03-08T15:50:22.350 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.346+0000 7f10bfe1e700 1 -- 172.21.15.123:0/2011693862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b806f8d0 msgr2=0x7f10b814a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:22.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.346+0000 7f10bfe1e700 1 --2- 172.21.15.123:0/2011693862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b806f8d0 0x7f10b814a010 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f10b8073d50 tx=0x7f10b400be70 comp rx=0 tx=0).stop 2023-03-08T15:50:22.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.346+0000 7f10bfe1e700 1 -- 172.21.15.123:0/2011693862 shutdown_connections 2023-03-08T15:50:22.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.346+0000 7f10bfe1e700 1 --2- 172.21.15.123:0/2011693862 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10b8140980 0x7f10b8140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.346+0000 7f10bfe1e700 1 --2- 172.21.15.123:0/2011693862 >> v2:172.21.15.175:3300/0 conn(0x7f10b806b530 0x7f10b80b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.346+0000 7f10bfe1e700 1 --2- 172.21.15.123:0/2011693862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b806f8d0 0x7f10b814a010 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.346+0000 7f10bfe1e700 1 -- 172.21.15.123:0/2011693862 >> 172.21.15.123:0/2011693862 conn(0x7f10b80ba3c0 msgr2=0x7f10b80bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:22.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.346+0000 7f10bfe1e700 1 -- 172.21.15.123:0/2011693862 shutdown_connections 2023-03-08T15:50:22.351 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.346+0000 7f10bfe1e700 1 -- 172.21.15.123:0/2011693862 wait complete. 2023-03-08T15:50:22.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.347+0000 7f10bfe1e700 1 Processor -- start 2023-03-08T15:50:22.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.347+0000 7f10bfe1e700 1 -- start start 2023-03-08T15:50:22.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10bfe1e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b806b530 0x7f10b80bbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:22.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10bfe1e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10b806f8d0 0x7f10b80b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:22.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10bfe1e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b8140980 0x7f10b80b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:22.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10bfe1e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b80bc310 con 0x7f10b8140980 2023-03-08T15:50:22.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10bfe1e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b80b89c0 con 0x7f10b806b530 2023-03-08T15:50:22.354 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10bfe1e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b8147b90 con 0x7f10b806f8d0 2023-03-08T15:50:22.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10be3bb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b8140980 0x7f10b80b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:22.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10be3bb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b8140980 0x7f10b80b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36744/0 (socket says 172.21.15.123:36744) 2023-03-08T15:50:22.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10bdbba700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b806b530 0x7f10b80bbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:22.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10bd3b9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10b806f8d0 0x7f10b80b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:22.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10be3bb700 1 -- 172.21.15.123:0/2669472649 learned_addr learned my addr 172.21.15.123:0/2669472649 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:22.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10be3bb700 1 -- 172.21.15.123:0/2669472649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10b806f8d0 msgr2=0x7f10b80b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:22.355 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10be3bb700 1 --2- 172.21.15.123:0/2669472649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10b806f8d0 0x7f10b80b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10be3bb700 1 -- 172.21.15.123:0/2669472649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b806b530 msgr2=0x7f10b80bbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:22.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10be3bb700 1 --2- 172.21.15.123:0/2669472649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b806b530 0x7f10b80bbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10be3bb700 1 -- 172.21.15.123:0/2669472649 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b400b7f0 con 0x7f10b8140980 2023-03-08T15:50:22.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10be3bb700 1 --2- 172.21.15.123:0/2669472649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b8140980 0x7f10b80b4f70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f10b0007e90 tx=0x7f10b000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:22.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10ae7fc700 1 -- 172.21.15.123:0/2669472649 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b000ed30 con 0x7f10b8140980 2023-03-08T15:50:22.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10ae7fc700 1 -- 172.21.15.123:0/2669472649 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b000ee90 con 0x7f10b8140980 2023-03-08T15:50:22.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.348+0000 7f10bfe1e700 1 -- 172.21.15.123:0/2669472649 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b8071b00 con 0x7f10b8140980 2023-03-08T15:50:22.356 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.349+0000 7f10ae7fc700 1 -- 172.21.15.123:0/2669472649 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b0014660 con 0x7f10b8140980 2023-03-08T15:50:22.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.349+0000 7f10bfe1e700 1 -- 172.21.15.123:0/2669472649 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b8071820 con 0x7f10b8140980 2023-03-08T15:50:22.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.349+0000 7f10bfe1e700 1 -- 172.21.15.123:0/2669472649 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b806b900 con 0x7f10b8140980 2023-03-08T15:50:22.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.350+0000 7f10ae7fc700 1 -- 172.21.15.123:0/2669472649 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f10b0012050 con 0x7f10b8140980 2023-03-08T15:50:22.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.350+0000 7f10ae7fc700 1 --2- 172.21.15.123:0/2669472649 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f109c0698d0 0x7f109c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:22.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.350+0000 7f10ae7fc700 1 -- 172.21.15.123:0/2669472649 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f10b0087b10 con 0x7f10b8140980 2023-03-08T15:50:22.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.350+0000 7f10bdbba700 1 --2- 172.21.15.123:0/2669472649 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f109c0698d0 0x7f109c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:22.357 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.351+0000 7f10bdbba700 1 --2- 172.21.15.123:0/2669472649 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f109c0698d0 0x7f109c06bd80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f10a8006b20 tx=0x7f10a8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:22.358 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.355+0000 7f10ae7fc700 1 -- 172.21.15.123:0/2669472649 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f10b0053850 con 0x7f10b8140980 2023-03-08T15:50:22.580 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.579+0000 7f10bfe1e700 1 -- 172.21.15.123:0/2669472649 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f10b814a8e0 con 0x7f10b8140980 2023-03-08T15:50:22.585 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.584+0000 7f10ae7fc700 1 -- 172.21.15.123:0/2669472649 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f10b0056e70 con 0x7f10b8140980 2023-03-08T15:50:22.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.588+0000 7f10bfe1e700 1 -- 172.21.15.123:0/2669472649 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f109c0698d0 msgr2=0x7f109c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:22.589 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.588+0000 7f10bfe1e700 1 --2- 172.21.15.123:0/2669472649 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f109c0698d0 0x7f109c06bd80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f10a8006b20 tx=0x7f10a8008040 comp rx=0 tx=0).stop 2023-03-08T15:50:22.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.588+0000 7f10bfe1e700 1 -- 172.21.15.123:0/2669472649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b8140980 msgr2=0x7f10b80b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:22.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.588+0000 7f10bfe1e700 1 --2- 172.21.15.123:0/2669472649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b8140980 0x7f10b80b4f70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f10b0007e90 tx=0x7f10b000e3c0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.591+0000 7f10bfe1e700 1 -- 172.21.15.123:0/2669472649 shutdown_connections 2023-03-08T15:50:22.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.591+0000 7f10bfe1e700 1 --2- 172.21.15.123:0/2669472649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b8140980 0x7f10b80b4f70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.591+0000 7f10bfe1e700 1 --2- 172.21.15.123:0/2669472649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b806b530 0x7f10b80bbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.591+0000 7f10bfe1e700 1 --2- 172.21.15.123:0/2669472649 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f109c0698d0 0x7f109c06bd80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.592 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.591+0000 7f10bfe1e700 1 --2- 172.21.15.123:0/2669472649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10b806f8d0 0x7f10b80b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.591+0000 7f10bfe1e700 1 -- 172.21.15.123:0/2669472649 >> 172.21.15.123:0/2669472649 conn(0x7f10b80ba3c0 msgr2=0x7f10b814a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:22.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.591+0000 7f10bfe1e700 1 -- 172.21.15.123:0/2669472649 shutdown_connections 2023-03-08T15:50:22.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.591+0000 7f10bfe1e700 1 -- 172.21.15.123:0/2669472649 wait complete. 2023-03-08T15:50:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 5 and data pool 6 2023-03-08T15:50:22.612 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:50:22.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.729+0000 7f57bf445700 1 Processor -- start 2023-03-08T15:50:22.731 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.730+0000 7f57bf445700 1 -- start start 2023-03-08T15:50:22.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.730+0000 7f57bf445700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f57b806abd0 0x7f57b81443c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:22.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.730+0000 7f57bf445700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57b80afb80 0x7f57b8144900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:22.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.730+0000 7f57bf445700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b80b4990 con 0x7f57b80b5830 2023-03-08T15:50:22.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.730+0000 7f57bf445700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b80b0010 con 0x7f57b806abd0 2023-03-08T15:50:22.733 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.730+0000 7f57bf445700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b80b4620 con 0x7f57b80afb80 2023-03-08T15:50:22.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.731+0000 7f57bd1e1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f57b806abd0 0x7f57b81443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:22.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.731+0000 7f57bd1e1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f57b806abd0 0x7f57b81443c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36746/0 (socket says 172.21.15.123:36746) 2023-03-08T15:50:22.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.731+0000 7f57bd1e1700 1 -- 172.21.15.123:0/3360756647 learned_addr learned my addr 172.21.15.123:0/3360756647 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:22.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.731+0000 7f57bd9e2700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f57b80b5830 0x7f57b80b61a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51924/0 (socket says 172.21.15.123:51924) 2023-03-08T15:50:22.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.731+0000 7f57bc9e0700 1 --2- 172.21.15.123:0/3360756647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57b80afb80 0x7f57b8144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:22.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.731+0000 7f57bd1e1700 1 -- 172.21.15.123:0/3360756647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57b80afb80 msgr2=0x7f57b8144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:22.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.731+0000 7f57bd1e1700 1 --2- 172.21.15.123:0/3360756647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57b80afb80 0x7f57b8144900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.734 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.731+0000 7f57bd1e1700 1 -- 172.21.15.123:0/3360756647 >> v1:172.21.15.123:6789/0 conn(0x7f57b80b5830 legacy=0x7f57b80b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:22.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.731+0000 7f57bd1e1700 1 -- 172.21.15.123:0/3360756647 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b806afa0 con 0x7f57b806abd0 2023-03-08T15:50:22.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.731+0000 7f57affff700 1 -- 172.21.15.123:0/3360756647 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664813186 0 0) 0x7f57b80b4990 con 0x7f57b80b5830 2023-03-08T15:50:22.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.731+0000 7f57bc9e0700 1 --2- 172.21.15.123:0/3360756647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57b80afb80 0x7f57b8144900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:22.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.731+0000 7f57bd1e1700 1 --2- 172.21.15.123:0/3360756647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b806abd0 0x7f57b81443c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f57b40098f0 tx=0x7f57b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7defac1a0c94069 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:22.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.731+0000 7f57affff700 1 -- 172.21.15.123:0/3360756647 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b400b8a0 con 0x7f57b806abd0 2023-03-08T15:50:22.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.731+0000 7f57affff700 1 -- 172.21.15.123:0/3360756647 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b400ba00 con 0x7f57b806abd0 2023-03-08T15:50:22.735 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.731+0000 7f57affff700 1 -- 172.21.15.123:0/3360756647 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b400bd90 con 0x7f57b806abd0 2023-03-08T15:50:22.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.732+0000 7f57bf445700 1 -- 172.21.15.123:0/3360756647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b806abd0 msgr2=0x7f57b81443c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:22.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.732+0000 7f57bf445700 1 --2- 172.21.15.123:0/3360756647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b806abd0 0x7f57b81443c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f57b40098f0 tx=0x7f57b4009c00 comp rx=0 tx=0).stop 2023-03-08T15:50:22.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.732+0000 7f57bf445700 1 -- 172.21.15.123:0/3360756647 shutdown_connections 2023-03-08T15:50:22.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.732+0000 7f57bf445700 1 --2- 172.21.15.123:0/3360756647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b806abd0 0x7f57b81443c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.732+0000 7f57bf445700 1 --2- 172.21.15.123:0/3360756647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57b80afb80 0x7f57b8144900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.732+0000 7f57bf445700 1 -- 172.21.15.123:0/3360756647 >> 172.21.15.123:0/3360756647 conn(0x7f57b8065f10 msgr2=0x7f57b806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:22.736 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.732+0000 7f57bf445700 1 -- 172.21.15.123:0/3360756647 shutdown_connections 2023-03-08T15:50:22.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.732+0000 7f57bf445700 1 -- 172.21.15.123:0/3360756647 wait complete. 2023-03-08T15:50:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.733+0000 7f57bf445700 1 Processor -- start 2023-03-08T15:50:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.733+0000 7f57bf445700 1 -- start start 2023-03-08T15:50:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.733+0000 7f57bf445700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57b806abd0 0x7f57b814d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.733+0000 7f57bf445700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57b80afb80 0x7f57b813dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.733+0000 7f57bf445700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b80b5830 0x7f57b81e0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:22.739 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.733+0000 7f57bf445700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b814d2b0 con 0x7f57b80b5830 2023-03-08T15:50:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.733+0000 7f57bf445700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b814de10 con 0x7f57b80afb80 2023-03-08T15:50:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.733+0000 7f57bf445700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b814e000 con 0x7f57b806abd0 2023-03-08T15:50:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.733+0000 7f57bd9e2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b80b5830 0x7f57b81e0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.733+0000 7f57bd9e2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b80b5830 0x7f57b81e0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36760/0 (socket says 172.21.15.123:36760) 2023-03-08T15:50:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.733+0000 7f57bd9e2700 1 -- 172.21.15.123:0/1237670366 learned_addr learned my addr 172.21.15.123:0/1237670366 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.734+0000 7f57bd1e1700 1 --2- 172.21.15.123:0/1237670366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57b806abd0 0x7f57b814d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:22.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.734+0000 7f57bc9e0700 1 --2- 172.21.15.123:0/1237670366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57b80afb80 0x7f57b813dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:22.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.734+0000 7f57bd9e2700 1 -- 172.21.15.123:0/1237670366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57b806abd0 msgr2=0x7f57b814d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:22.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.734+0000 7f57bd9e2700 1 --2- 172.21.15.123:0/1237670366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57b806abd0 0x7f57b814d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.734+0000 7f57bd9e2700 1 -- 172.21.15.123:0/1237670366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57b80afb80 msgr2=0x7f57b813dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:22.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.734+0000 7f57bd9e2700 1 --2- 172.21.15.123:0/1237670366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57b80afb80 0x7f57b813dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.734+0000 7f57bd9e2700 1 -- 172.21.15.123:0/1237670366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b4009550 con 0x7f57b80b5830 2023-03-08T15:50:22.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.734+0000 7f57bd1e1700 1 --2- 172.21.15.123:0/1237670366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57b806abd0 0x7f57b814d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:22.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.734+0000 7f57bd9e2700 1 --2- 172.21.15.123:0/1237670366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b80b5830 0x7f57b81e0210 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f57b000cb70 tx=0x7f57b000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:22.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.734+0000 7f57adffb700 1 -- 172.21.15.123:0/1237670366 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b000ab10 con 0x7f57b80b5830 2023-03-08T15:50:22.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.734+0000 7f57adffb700 1 -- 172.21.15.123:0/1237670366 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b000ac90 con 0x7f57b80b5830 2023-03-08T15:50:22.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.734+0000 7f57bf445700 1 -- 172.21.15.123:0/1237670366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b8072790 con 0x7f57b80b5830 2023-03-08T15:50:22.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.734+0000 7f57adffb700 1 -- 172.21.15.123:0/1237670366 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b00070d0 con 0x7f57b80b5830 2023-03-08T15:50:22.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.734+0000 7f57bf445700 1 -- 172.21.15.123:0/1237670366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b8072600 con 0x7f57b80b5830 2023-03-08T15:50:22.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.735+0000 7f57bf445700 1 -- 172.21.15.123:0/1237670366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b80b68b0 con 0x7f57b80b5830 2023-03-08T15:50:22.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.735+0000 7f57adffb700 1 -- 172.21.15.123:0/1237670366 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f57b0010070 con 0x7f57b80b5830 2023-03-08T15:50:22.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.736+0000 7f57adffb700 1 --2- 172.21.15.123:0/1237670366 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f579c0698d0 0x7f579c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:22.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.736+0000 7f57bd1e1700 1 --2- 172.21.15.123:0/1237670366 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f579c0698d0 0x7f579c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:22.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.736+0000 7f57adffb700 1 -- 172.21.15.123:0/1237670366 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f57b0086f10 con 0x7f57b80b5830 2023-03-08T15:50:22.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.736+0000 7f57bd1e1700 1 --2- 172.21.15.123:0/1237670366 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f579c0698d0 0x7f579c06bd80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f57b4000c00 tx=0x7f57b4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:22.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.740+0000 7f57adffb700 1 -- 172.21.15.123:0/1237670366 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f57b0052ce0 con 0x7f57b80b5830 2023-03-08T15:50:22.929 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.927+0000 7f57bf445700 1 -- 172.21.15.123:0/1237670366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57b80acc00 con 0x7f57b80b5830 2023-03-08T15:50:22.929 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.928+0000 7f57adffb700 1 -- 172.21.15.123:0/1237670366 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+18040 (secure 0 0 0) 0x7f57b0018090 con 0x7f57b80b5830 2023-03-08T15:50:22.930 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:22.930 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":33,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:50:22.580447+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:50:20.856986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-03-08T15:50:21.541149+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:50:22.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.930+0000 7f57bf445700 1 -- 172.21.15.123:0/1237670366 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f579c0698d0 msgr2=0x7f579c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:22.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.931+0000 7f57bf445700 1 --2- 172.21.15.123:0/1237670366 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f579c0698d0 0x7f579c06bd80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f57b4000c00 tx=0x7f57b4008030 comp rx=0 tx=0).stop 2023-03-08T15:50:22.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.931+0000 7f57bf445700 1 -- 172.21.15.123:0/1237670366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b80b5830 msgr2=0x7f57b81e0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:22.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.931+0000 7f57bf445700 1 --2- 172.21.15.123:0/1237670366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b80b5830 0x7f57b81e0210 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f57b000cb70 tx=0x7f57b000cf30 comp rx=0 tx=0).stop 2023-03-08T15:50:22.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.931+0000 7f57bf445700 1 -- 172.21.15.123:0/1237670366 shutdown_connections 2023-03-08T15:50:22.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.931+0000 7f57bf445700 1 --2- 172.21.15.123:0/1237670366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b80b5830 0x7f57b81e0210 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.931+0000 7f57bf445700 1 --2- 172.21.15.123:0/1237670366 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f579c0698d0 0x7f579c06bd80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.931+0000 7f57bf445700 1 --2- 172.21.15.123:0/1237670366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57b806abd0 0x7f57b814d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.931+0000 7f57bf445700 1 --2- 172.21.15.123:0/1237670366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57b80afb80 0x7f57b813dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:22.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.931+0000 7f57bf445700 1 -- 172.21.15.123:0/1237670366 >> 172.21.15.123:0/1237670366 conn(0x7f57b8065f10 msgr2=0x7f57b80b8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:22.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.931+0000 7f57bf445700 1 -- 172.21.15.123:0/1237670366 shutdown_connections 2023-03-08T15:50:22.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:22.931+0000 7f57bf445700 1 -- 172.21.15.123:0/1237670366 wait complete. 2023-03-08T15:50:22.944 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:50:23.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.062+0000 7f5d8358e700 1 Processor -- start 2023-03-08T15:50:23.064 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.063+0000 7f5d8358e700 1 -- start start 2023-03-08T15:50:23.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.063+0000 7f5d8358e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5d7c072760 0x7f5d7c06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:23.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.063+0000 7f5d8358e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d7c071df0 0x7f5d7c14aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:23.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.063+0000 7f5d8358e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7c070670 con 0x7f5d7c0ba280 2023-03-08T15:50:23.066 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.063+0000 7f5d8358e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7c070a40 con 0x7f5d7c072760 2023-03-08T15:50:23.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.063+0000 7f5d8358e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c070c50 con 0x7f5d7c071df0 2023-03-08T15:50:23.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.063+0000 7f5d80b29700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5d7c072760 0x7f5d7c06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:23.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.063+0000 7f5d8132a700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5d7c0ba280 0x7f5d7c141480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51936/0 (socket says 172.21.15.123:51936) 2023-03-08T15:50:23.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.063+0000 7f5d8132a700 1 -- 172.21.15.123:0/1969187909 learned_addr learned my addr 172.21.15.123:0/1969187909 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:23.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.064+0000 7f5d81b2b700 1 --2- 172.21.15.123:0/1969187909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d7c071df0 0x7f5d7c14aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:23.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.064+0000 7f5d80b29700 1 -- 172.21.15.123:0/1969187909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d7c071df0 msgr2=0x7f5d7c14aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:23.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.064+0000 7f5d80b29700 1 --2- 172.21.15.123:0/1969187909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d7c071df0 0x7f5d7c14aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:23.067 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.064+0000 7f5d80b29700 1 -- 172.21.15.123:0/1969187909 >> v1:172.21.15.123:6789/0 conn(0x7f5d7c0ba280 legacy=0x7f5d7c141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:23.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.064+0000 7f5d80b29700 1 -- 172.21.15.123:0/1969187909 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c0ba650 con 0x7f5d7c072760 2023-03-08T15:50:23.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.064+0000 7f5d73fff700 1 -- 172.21.15.123:0/1969187909 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597238543 0 0) 0x7f5d7c070670 con 0x7f5d7c0ba280 2023-03-08T15:50:23.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.064+0000 7f5d80b29700 1 --2- 172.21.15.123:0/1969187909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d7c072760 0x7f5d7c06fff0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009840 tx=0x7f5d78009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59f340777a7a828 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:23.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.064+0000 7f5d73fff700 1 -- 172.21.15.123:0/1969187909 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d78011830 con 0x7f5d7c072760 2023-03-08T15:50:23.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.064+0000 7f5d73fff700 1 -- 172.21.15.123:0/1969187909 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d78011990 con 0x7f5d7c072760 2023-03-08T15:50:23.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.064+0000 7f5d73fff700 1 -- 172.21.15.123:0/1969187909 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d78011d20 con 0x7f5d7c072760 2023-03-08T15:50:23.068 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.065+0000 7f5d8358e700 1 -- 172.21.15.123:0/1969187909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d7c072760 msgr2=0x7f5d7c06fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.065+0000 7f5d8358e700 1 --2- 172.21.15.123:0/1969187909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d7c072760 0x7f5d7c06fff0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009840 tx=0x7f5d78009b50 comp rx=0 tx=0).stop 2023-03-08T15:50:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.065+0000 7f5d8358e700 1 -- 172.21.15.123:0/1969187909 shutdown_connections 2023-03-08T15:50:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.065+0000 7f5d8358e700 1 --2- 172.21.15.123:0/1969187909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d7c071df0 0x7f5d7c14aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.065+0000 7f5d8358e700 1 --2- 172.21.15.123:0/1969187909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d7c072760 0x7f5d7c06fff0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.065+0000 7f5d8358e700 1 -- 172.21.15.123:0/1969187909 >> 172.21.15.123:0/1969187909 conn(0x7f5d7c06b360 msgr2=0x7f5d7c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.065+0000 7f5d8358e700 1 -- 172.21.15.123:0/1969187909 shutdown_connections 2023-03-08T15:50:23.069 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.065+0000 7f5d8358e700 1 -- 172.21.15.123:0/1969187909 wait complete. 2023-03-08T15:50:23.071 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.066+0000 7f5d8358e700 1 Processor -- start 2023-03-08T15:50:23.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.066+0000 7f5d8358e700 1 -- start start 2023-03-08T15:50:23.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.066+0000 7f5d8358e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d7c071df0 0x7f5d7c0b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:23.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.066+0000 7f5d8358e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d7c0ba280 0x7f5d7c147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:23.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.066+0000 7f5d8358e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d7c1478a0 0x7f5d7c1378b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:23.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.066+0000 7f5d8358e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c0b6d10 con 0x7f5d7c071df0 2023-03-08T15:50:23.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.066+0000 7f5d8358e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c0bdbb0 con 0x7f5d7c1478a0 2023-03-08T15:50:23.072 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.066+0000 7f5d8358e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c13af70 con 0x7f5d7c0ba280 2023-03-08T15:50:23.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.066+0000 7f5d8132a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d7c071df0 0x7f5d7c0b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:23.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.066+0000 7f5d8132a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d7c071df0 0x7f5d7c0b67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36776/0 (socket says 172.21.15.123:36776) 2023-03-08T15:50:23.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.066+0000 7f5d8132a700 1 -- 172.21.15.123:0/329148074 learned_addr learned my addr 172.21.15.123:0/329148074 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:23.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.067+0000 7f5d80b29700 1 --2- 172.21.15.123:0/329148074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d7c0ba280 0x7f5d7c147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:23.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.067+0000 7f5d81b2b700 1 --2- 172.21.15.123:0/329148074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d7c1478a0 0x7f5d7c1378b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:23.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.067+0000 7f5d8132a700 1 -- 172.21.15.123:0/329148074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d7c0ba280 msgr2=0x7f5d7c147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:23.073 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.067+0000 7f5d8132a700 1 --2- 172.21.15.123:0/329148074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d7c0ba280 0x7f5d7c147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.067+0000 7f5d8132a700 1 -- 172.21.15.123:0/329148074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d7c1478a0 msgr2=0x7f5d7c1378b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.067+0000 7f5d8132a700 1 --2- 172.21.15.123:0/329148074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d7c1478a0 0x7f5d7c1378b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.067+0000 7f5d8132a700 1 -- 172.21.15.123:0/329148074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d780094a0 con 0x7f5d7c071df0 2023-03-08T15:50:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.067+0000 7f5d8132a700 1 --2- 172.21.15.123:0/329148074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d7c071df0 0x7f5d7c0b67d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00c550 tx=0x7f5d6c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.067+0000 7f5d71ffb700 1 -- 172.21.15.123:0/329148074 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c004c80 con 0x7f5d7c071df0 2023-03-08T15:50:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.067+0000 7f5d71ffb700 1 -- 172.21.15.123:0/329148074 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c004e00 con 0x7f5d7c071df0 2023-03-08T15:50:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.067+0000 7f5d8358e700 1 -- 172.21.15.123:0/329148074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7c141d20 con 0x7f5d7c071df0 2023-03-08T15:50:23.074 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.067+0000 7f5d71ffb700 1 -- 172.21.15.123:0/329148074 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c007310 con 0x7f5d7c071df0 2023-03-08T15:50:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.067+0000 7f5d8358e700 1 -- 172.21.15.123:0/329148074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7c141b90 con 0x7f5d7c071df0 2023-03-08T15:50:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.068+0000 7f5d8358e700 1 -- 172.21.15.123:0/329148074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7c14aff0 con 0x7f5d7c071df0 2023-03-08T15:50:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.068+0000 7f5d71ffb700 1 -- 172.21.15.123:0/329148074 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f5d6c01a020 con 0x7f5d7c071df0 2023-03-08T15:50:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.069+0000 7f5d71ffb700 1 --2- 172.21.15.123:0/329148074 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5d600698d0 0x7f5d6006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.069+0000 7f5d71ffb700 1 -- 172.21.15.123:0/329148074 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d6c087250 con 0x7f5d7c071df0 2023-03-08T15:50:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.069+0000 7f5d80b29700 1 --2- 172.21.15.123:0/329148074 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5d600698d0 0x7f5d6006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.069+0000 7f5d80b29700 1 --2- 172.21.15.123:0/329148074 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5d600698d0 0x7f5d6006bd80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c06f9c0 tx=0x7f5d78008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:23.076 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.073+0000 7f5d71ffb700 1 -- 172.21.15.123:0/329148074 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f5d6c053070 con 0x7f5d7c071df0 2023-03-08T15:50:23.261 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.260+0000 7f5d8358e700 1 -- 172.21.15.123:0/329148074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d7c0744c0 con 0x7f5d7c071df0 2023-03-08T15:50:23.262 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.261+0000 7f5d71ffb700 1 -- 172.21.15.123:0/329148074 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+18040 (secure 0 0 0) 0x7f5d6c056690 con 0x7f5d7c071df0 2023-03-08T15:50:23.263 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:23.263 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":33,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:50:22.580447+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:50:20.856986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-03-08T15:50:21.541149+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:50:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.263+0000 7f5d8358e700 1 -- 172.21.15.123:0/329148074 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5d600698d0 msgr2=0x7f5d6006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.263+0000 7f5d8358e700 1 --2- 172.21.15.123:0/329148074 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5d600698d0 0x7f5d6006bd80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c06f9c0 tx=0x7f5d78008030 comp rx=0 tx=0).stop 2023-03-08T15:50:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.263+0000 7f5d8358e700 1 -- 172.21.15.123:0/329148074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d7c071df0 msgr2=0x7f5d7c0b67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.263+0000 7f5d8358e700 1 --2- 172.21.15.123:0/329148074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d7c071df0 0x7f5d7c0b67d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00c550 tx=0x7f5d6c00c910 comp rx=0 tx=0).stop 2023-03-08T15:50:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.263+0000 7f5d8358e700 1 -- 172.21.15.123:0/329148074 shutdown_connections 2023-03-08T15:50:23.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.263+0000 7f5d8358e700 1 --2- 172.21.15.123:0/329148074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d7c1478a0 0x7f5d7c1378b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.263+0000 7f5d8358e700 1 --2- 172.21.15.123:0/329148074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d7c071df0 0x7f5d7c0b67d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.263+0000 7f5d8358e700 1 --2- 172.21.15.123:0/329148074 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f5d600698d0 0x7f5d6006bd80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.263+0000 7f5d8358e700 1 --2- 172.21.15.123:0/329148074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d7c0ba280 0x7f5d7c147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.263+0000 7f5d8358e700 1 -- 172.21.15.123:0/329148074 >> 172.21.15.123:0/329148074 conn(0x7f5d7c06b360 msgr2=0x7f5d7c140180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.263+0000 7f5d8358e700 1 -- 172.21.15.123:0/329148074 shutdown_connections 2023-03-08T15:50:23.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.263+0000 7f5d8358e700 1 -- 172.21.15.123:0/329148074 wait complete. 2023-03-08T15:50:23.276 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-08T15:50:23.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.397+0000 7fde6563c700 1 Processor -- start 2023-03-08T15:50:23.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.397+0000 7fde6563c700 1 -- start start 2023-03-08T15:50:23.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde6563c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde600bb350 0x7fde601446b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:23.401 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde6563c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6014dc00 con 0x7fde60144bf0 2023-03-08T15:50:23.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde6563c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6006bb70 con 0x7fde6014e090 2023-03-08T15:50:23.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde6563c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde600b9fc0 con 0x7fde600bb350 2023-03-08T15:50:23.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde5e7fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fde60144bf0 0x7fde600bdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51950/0 (socket says 172.21.15.123:51950) 2023-03-08T15:50:23.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde5e7fc700 1 -- 172.21.15.123:0/4228467546 learned_addr learned my addr 172.21.15.123:0/4228467546 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:23.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde5effd700 1 --2- 172.21.15.123:0/4228467546 >> v2:172.21.15.175:3300/0 conn(0x7fde600bb350 0x7fde601446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:23.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde5dffb700 1 -- 172.21.15.123:0/4228467546 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825477614 0 0) 0x7fde6014dc00 con 0x7fde60144bf0 2023-03-08T15:50:23.402 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde5dffb700 1 -- 172.21.15.123:0/4228467546 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde480035b0 con 0x7fde60144bf0 2023-03-08T15:50:23.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde5dffb700 1 -- 172.21.15.123:0/4228467546 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 412015346 0 0) 0x7fde480035b0 con 0x7fde60144bf0 2023-03-08T15:50:23.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde5dffb700 1 -- 172.21.15.123:0/4228467546 >> v2:172.21.15.175:3300/0 conn(0x7fde600bb350 msgr2=0x7fde601446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:23.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde5dffb700 1 --2- 172.21.15.123:0/4228467546 >> v2:172.21.15.175:3300/0 conn(0x7fde600bb350 0x7fde601446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:23.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde5dffb700 1 -- 172.21.15.123:0/4228467546 >> v1:172.21.15.175:6789/0 conn(0x7fde6014e090 legacy=0x7fde6014e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:23.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde5dffb700 1 -- 172.21.15.123:0/4228467546 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde600ba2a0 con 0x7fde60144bf0 2023-03-08T15:50:23.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde5dffb700 1 -- 172.21.15.123:0/4228467546 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7fde50001670 con 0x7fde60144bf0 2023-03-08T15:50:23.403 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.398+0000 7fde5dffb700 1 -- 172.21.15.123:0/4228467546 >> v1:172.21.15.123:6789/0 conn(0x7fde60144bf0 legacy=0x7fde600bdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5dffb700 1 --2- 172.21.15.123:0/4228467546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde48003a00 0x7fde48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5dffb700 1 --2- 172.21.15.123:0/4228467546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde480043f0 0x7fde480048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5dffb700 1 --2- 172.21.15.123:0/4228467546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde480050b0 0x7fde4800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5dffb700 1 -- 172.21.15.123:0/4228467546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde600b9fc0 con 0x7fde480050b0 2023-03-08T15:50:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5dffb700 1 -- 172.21.15.123:0/4228467546 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4800bf50 con 0x7fde48003a00 2023-03-08T15:50:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5dffb700 1 -- 172.21.15.123:0/4228467546 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4800c110 con 0x7fde480043f0 2023-03-08T15:50:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5effd700 1 --2- 172.21.15.123:0/4228467546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde48003a00 0x7fde48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5f7fe700 1 --2- 172.21.15.123:0/4228467546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde480050b0 0x7fde4800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5e7fc700 1 --2- 172.21.15.123:0/4228467546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde480043f0 0x7fde480048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5f7fe700 1 -- 172.21.15.123:0/4228467546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde480043f0 msgr2=0x7fde480048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5f7fe700 1 --2- 172.21.15.123:0/4228467546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde480043f0 0x7fde480048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5f7fe700 1 -- 172.21.15.123:0/4228467546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde48003a00 msgr2=0x7fde48003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5f7fe700 1 --2- 172.21.15.123:0/4228467546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde48003a00 0x7fde48003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5f7fe700 1 -- 172.21.15.123:0/4228467546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde480035b0 con 0x7fde480050b0 2023-03-08T15:50:23.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5f7fe700 1 -- 172.21.15.123:0/4228467546 reap_dead start 2023-03-08T15:50:23.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5f7fe700 1 --2- 172.21.15.123:0/4228467546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde480050b0 0x7fde4800ba10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fde5800c290 tx=0x7fde48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7515a8456d5ff4ef server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:23.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5dffb700 1 -- 172.21.15.123:0/4228467546 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58001e70 con 0x7fde480050b0 2023-03-08T15:50:23.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5dffb700 1 -- 172.21.15.123:0/4228467546 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5800ce50 con 0x7fde480050b0 2023-03-08T15:50:23.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.399+0000 7fde5dffb700 1 -- 172.21.15.123:0/4228467546 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58012660 con 0x7fde480050b0 2023-03-08T15:50:23.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.400+0000 7fde6563c700 1 -- 172.21.15.123:0/4228467546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde480050b0 msgr2=0x7fde4800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:23.406 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.400+0000 7fde6563c700 1 --2- 172.21.15.123:0/4228467546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde480050b0 0x7fde4800ba10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fde5800c290 tx=0x7fde48005880 comp rx=0 tx=0).stop 2023-03-08T15:50:23.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.400+0000 7fde6563c700 1 -- 172.21.15.123:0/4228467546 shutdown_connections 2023-03-08T15:50:23.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.400+0000 7fde6563c700 1 --2- 172.21.15.123:0/4228467546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde480050b0 0x7fde4800ba10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:23.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.400+0000 7fde6563c700 1 -- 172.21.15.123:0/4228467546 >> 172.21.15.123:0/4228467546 conn(0x7fde6006a250 msgr2=0x7fde6006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:23.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.400+0000 7fde6563c700 1 -- 172.21.15.123:0/4228467546 shutdown_connections 2023-03-08T15:50:23.407 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.400+0000 7fde6563c700 1 -- 172.21.15.123:0/4228467546 wait complete. 2023-03-08T15:50:23.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.401+0000 7fde6563c700 1 Processor -- start 2023-03-08T15:50:23.409 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.401+0000 7fde6563c700 1 -- start start 2023-03-08T15:50:23.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde6563c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde480050b0 0x7fde6014b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:23.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde6563c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde6014d390 0x7fde601e3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:23.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde6563c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde6013fe10 0x7fde60136810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:23.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde6563c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde601437c0 con 0x7fde480050b0 2023-03-08T15:50:23.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde6563c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde601e3330 con 0x7fde6013fe10 2023-03-08T15:50:23.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde6563c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde601402b0 con 0x7fde6014d390 2023-03-08T15:50:23.410 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde5effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde480050b0 0x7fde6014b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:23.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde5effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde480050b0 0x7fde6014b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36798/0 (socket says 172.21.15.123:36798) 2023-03-08T15:50:23.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde5effd700 1 -- 172.21.15.123:0/3047939905 learned_addr learned my addr 172.21.15.123:0/3047939905 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:23.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde5e7fc700 1 --2- 172.21.15.123:0/3047939905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde6014d390 0x7fde601e3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:23.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde5f7fe700 1 --2- 172.21.15.123:0/3047939905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde6013fe10 0x7fde60136810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:23.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde5effd700 1 -- 172.21.15.123:0/3047939905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde6014d390 msgr2=0x7fde601e3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:23.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde5effd700 1 --2- 172.21.15.123:0/3047939905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde6014d390 0x7fde601e3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:23.411 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde5effd700 1 -- 172.21.15.123:0/3047939905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde6013fe10 msgr2=0x7fde60136810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:23.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde5effd700 1 --2- 172.21.15.123:0/3047939905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde6013fe10 0x7fde60136810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:23.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde5effd700 1 -- 172.21.15.123:0/3047939905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde600bb720 con 0x7fde480050b0 2023-03-08T15:50:23.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde5effd700 1 --2- 172.21.15.123:0/3047939905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde480050b0 0x7fde6014b7d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fde540119d0 tx=0x7fde54011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:23.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde477fe700 1 -- 172.21.15.123:0/3047939905 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400f940 con 0x7fde480050b0 2023-03-08T15:50:23.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde477fe700 1 -- 172.21.15.123:0/3047939905 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5400faa0 con 0x7fde480050b0 2023-03-08T15:50:23.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde6563c700 1 -- 172.21.15.123:0/3047939905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde600ba580 con 0x7fde480050b0 2023-03-08T15:50:23.412 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde477fe700 1 -- 172.21.15.123:0/3047939905 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400fe30 con 0x7fde480050b0 2023-03-08T15:50:23.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.402+0000 7fde6563c700 1 -- 172.21.15.123:0/3047939905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde601446b0 con 0x7fde480050b0 2023-03-08T15:50:23.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.403+0000 7fde6563c700 1 -- 172.21.15.123:0/3047939905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde600744c0 con 0x7fde480050b0 2023-03-08T15:50:23.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.404+0000 7fde477fe700 1 -- 172.21.15.123:0/3047939905 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fde54014440 con 0x7fde480050b0 2023-03-08T15:50:23.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.404+0000 7fde477fe700 1 --2- 172.21.15.123:0/3047939905 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fde4c0698d0 0x7fde4c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:23.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.404+0000 7fde477fe700 1 -- 172.21.15.123:0/3047939905 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde54087e70 con 0x7fde480050b0 2023-03-08T15:50:23.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.404+0000 7fde5e7fc700 1 --2- 172.21.15.123:0/3047939905 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fde4c0698d0 0x7fde4c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:23.413 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.404+0000 7fde5e7fc700 1 --2- 172.21.15.123:0/3047939905 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fde4c0698d0 0x7fde4c06bd80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde6014b710 tx=0x7fde50000ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:23.414 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.408+0000 7fde477fe700 1 -- 172.21.15.123:0/3047939905 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fde54053be0 con 0x7fde480050b0 2023-03-08T15:50:23.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:23.640+0000 7fde6563c700 1 -- 172.21.15.123:0/3047939905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fde6014da40 con 0x7fde480050b0 2023-03-08T15:50:24.590 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.589+0000 7fde477fe700 1 -- 172.21.15.123:0/3047939905 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fde54057200 con 0x7fde480050b0 2023-03-08T15:50:24.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.591+0000 7fde6563c700 1 -- 172.21.15.123:0/3047939905 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fde4c0698d0 msgr2=0x7fde4c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:24.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.591+0000 7fde6563c700 1 --2- 172.21.15.123:0/3047939905 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fde4c0698d0 0x7fde4c06bd80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde6014b710 tx=0x7fde50000ed0 comp rx=0 tx=0).stop 2023-03-08T15:50:24.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.591+0000 7fde6563c700 1 -- 172.21.15.123:0/3047939905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde480050b0 msgr2=0x7fde6014b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:24.593 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.591+0000 7fde6563c700 1 --2- 172.21.15.123:0/3047939905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde480050b0 0x7fde6014b7d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fde540119d0 tx=0x7fde54011ce0 comp rx=0 tx=0).stop 2023-03-08T15:50:24.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.591+0000 7fde6563c700 1 -- 172.21.15.123:0/3047939905 shutdown_connections 2023-03-08T15:50:24.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.591+0000 7fde6563c700 1 --2- 172.21.15.123:0/3047939905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde6013fe10 0x7fde60136810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:24.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.591+0000 7fde6563c700 1 --2- 172.21.15.123:0/3047939905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde480050b0 0x7fde6014b7d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:24.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.591+0000 7fde6563c700 1 --2- 172.21.15.123:0/3047939905 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fde4c0698d0 0x7fde4c06bd80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:24.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.591+0000 7fde6563c700 1 --2- 172.21.15.123:0/3047939905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde6014d390 0x7fde601e3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:24.594 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.591+0000 7fde6563c700 1 -- 172.21.15.123:0/3047939905 >> 172.21.15.123:0/3047939905 conn(0x7fde6006a250 msgr2=0x7fde6006cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:24.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.592+0000 7fde6563c700 1 -- 172.21.15.123:0/3047939905 shutdown_connections 2023-03-08T15:50:24.595 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.592+0000 7fde6563c700 1 -- 172.21.15.123:0/3047939905 wait complete. 2023-03-08T15:50:24.607 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-03-08T15:50:24.608 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-03-08T15:50:24.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.735+0000 7f252eb10700 1 Processor -- start 2023-03-08T15:50:24.737 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.735+0000 7f252eb10700 1 -- start start 2023-03-08T15:50:24.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.736+0000 7f252eb10700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2528147e50 0x7f252806a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:24.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.736+0000 7f252eb10700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252814a810 con 0x7f252806fef0 2023-03-08T15:50:24.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.736+0000 7f252eb10700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2528071a40 con 0x7f252814b420 2023-03-08T15:50:24.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.736+0000 7f252eb10700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2528071d20 con 0x7f2528147e50 2023-03-08T15:50:24.740 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.736+0000 7f2527fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f252806fef0 0x7f252814ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51962/0 (socket says 172.21.15.123:51962) 2023-03-08T15:50:24.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.736+0000 7f2527fff700 1 -- 172.21.15.123:0/355781228 learned_addr learned my addr 172.21.15.123:0/355781228 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:24.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.736+0000 7f252c8ac700 1 --2- 172.21.15.123:0/355781228 >> v2:172.21.15.175:3300/0 conn(0x7f2528147e50 0x7f252806a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:24.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.736+0000 7f25277fe700 1 -- 172.21.15.123:0/355781228 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294304553 0 0) 0x7f252814a810 con 0x7f252806fef0 2023-03-08T15:50:24.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.736+0000 7f25277fe700 1 -- 172.21.15.123:0/355781228 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25180035b0 con 0x7f252806fef0 2023-03-08T15:50:24.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 -- 172.21.15.123:0/355781228 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1389915227 0 0) 0x7f25180035b0 con 0x7f252806fef0 2023-03-08T15:50:24.741 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 -- 172.21.15.123:0/355781228 >> v2:172.21.15.175:3300/0 conn(0x7f2528147e50 msgr2=0x7f252806a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:24.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 --2- 172.21.15.123:0/355781228 >> v2:172.21.15.175:3300/0 conn(0x7f2528147e50 0x7f252806a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:24.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 -- 172.21.15.123:0/355781228 >> v1:172.21.15.175:6789/0 conn(0x7f252814b420 legacy=0x7f2528155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:24.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 -- 172.21.15.123:0/355781228 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2528072000 con 0x7f252806fef0 2023-03-08T15:50:24.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 -- 172.21.15.123:0/355781228 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f2514001670 con 0x7f252806fef0 2023-03-08T15:50:24.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 -- 172.21.15.123:0/355781228 >> v1:172.21.15.123:6789/0 conn(0x7f252806fef0 legacy=0x7f252814ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:24.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 --2- 172.21.15.123:0/355781228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2518003a00 0x7f2518003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:24.742 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 --2- 172.21.15.123:0/355781228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2518004850 0x7f2518004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:24.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 --2- 172.21.15.123:0/355781228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2518005200 0x7f251800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:24.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 -- 172.21.15.123:0/355781228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2528071d20 con 0x7f2518004850 2023-03-08T15:50:24.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 -- 172.21.15.123:0/355781228 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251800c080 con 0x7f2518005200 2023-03-08T15:50:24.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 -- 172.21.15.123:0/355781228 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251800c240 con 0x7f2518003a00 2023-03-08T15:50:24.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f2527fff700 1 --2- 172.21.15.123:0/355781228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2518004850 0x7f2518004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:24.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f252c8ac700 1 --2- 172.21.15.123:0/355781228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2518003a00 0x7f2518003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:24.743 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f252d0ad700 1 --2- 172.21.15.123:0/355781228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2518005200 0x7f251800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:24.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f2527fff700 1 -- 172.21.15.123:0/355781228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2518003a00 msgr2=0x7f2518003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:24.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f2527fff700 1 --2- 172.21.15.123:0/355781228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2518003a00 0x7f2518003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:24.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f2527fff700 1 -- 172.21.15.123:0/355781228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2518005200 msgr2=0x7f251800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:24.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f2527fff700 1 --2- 172.21.15.123:0/355781228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2518005200 0x7f251800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:24.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f2527fff700 1 -- 172.21.15.123:0/355781228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180035b0 con 0x7f2518004850 2023-03-08T15:50:24.744 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f252d0ad700 1 --2- 172.21.15.123:0/355781228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2518005200 0x7f251800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f252d0ad700 1 -- 172.21.15.123:0/355781228 reap_dead start 2023-03-08T15:50:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f2527fff700 1 --2- 172.21.15.123:0/355781228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2518004850 0x7f2518004cc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f25280bb0f0 tx=0x7f2518005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7c2262017ce4db server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 -- 172.21.15.123:0/355781228 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514007c10 con 0x7f2518004850 2023-03-08T15:50:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 -- 172.21.15.123:0/355781228 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400cd80 con 0x7f2518004850 2023-03-08T15:50:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.737+0000 7f25277fe700 1 -- 172.21.15.123:0/355781228 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514005ba0 con 0x7f2518004850 2023-03-08T15:50:24.745 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.738+0000 7f252eb10700 1 -- 172.21.15.123:0/355781228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2518004850 msgr2=0x7f2518004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.738+0000 7f252eb10700 1 --2- 172.21.15.123:0/355781228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2518004850 0x7f2518004cc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f25280bb0f0 tx=0x7f2518005880 comp rx=0 tx=0).stop 2023-03-08T15:50:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.738+0000 7f252eb10700 1 -- 172.21.15.123:0/355781228 shutdown_connections 2023-03-08T15:50:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.738+0000 7f252eb10700 1 --2- 172.21.15.123:0/355781228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2518004850 0x7f2518004cc0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.738+0000 7f252eb10700 1 -- 172.21.15.123:0/355781228 >> 172.21.15.123:0/355781228 conn(0x7f252806b360 msgr2=0x7f252806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.738+0000 7f252eb10700 1 -- 172.21.15.123:0/355781228 shutdown_connections 2023-03-08T15:50:24.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.738+0000 7f252eb10700 1 -- 172.21.15.123:0/355781228 wait complete. 2023-03-08T15:50:24.748 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.739+0000 7f252eb10700 1 Processor -- start 2023-03-08T15:50:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.739+0000 7f252eb10700 1 -- start start 2023-03-08T15:50:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252eb10700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2518004850 0x7f25281439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252eb10700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25280b5680 0x7f25280b7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252eb10700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25280b7890 0x7f2528140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252eb10700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2528143ef0 con 0x7f25280b7890 2023-03-08T15:50:24.749 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252eb10700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2528143030 con 0x7f25280b5680 2023-03-08T15:50:24.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252eb10700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2528142790 con 0x7f2518004850 2023-03-08T15:50:24.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252d0ad700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25280b7890 0x7f2528140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:24.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252d0ad700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25280b7890 0x7f2528140bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36808/0 (socket says 172.21.15.123:36808) 2023-03-08T15:50:24.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252d0ad700 1 -- 172.21.15.123:0/2318863040 learned_addr learned my addr 172.21.15.123:0/2318863040 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:24.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252c8ac700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2518004850 0x7f25281439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:24.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f2527fff700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25280b5680 0x7f25280b7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:24.750 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252d0ad700 1 -- 172.21.15.123:0/2318863040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2518004850 msgr2=0x7f25281439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:24.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252d0ad700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2518004850 0x7f25281439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:24.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252d0ad700 1 -- 172.21.15.123:0/2318863040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25280b5680 msgr2=0x7f25280b7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:24.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252d0ad700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25280b5680 0x7f25280b7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:24.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252d0ad700 1 -- 172.21.15.123:0/2318863040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25280728f0 con 0x7f25280b7890 2023-03-08T15:50:24.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252c8ac700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2518004850 0x7f25281439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:24.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f2527fff700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25280b5680 0x7f25280b7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:24.751 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252d0ad700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25280b7890 0x7f2528140bb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f252814b880 tx=0x7f252000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:24.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f25257fa700 1 -- 172.21.15.123:0/2318863040 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520003c10 con 0x7f25280b7890 2023-03-08T15:50:24.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f25257fa700 1 -- 172.21.15.123:0/2318863040 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2520003d70 con 0x7f25280b7890 2023-03-08T15:50:24.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252eb10700 1 -- 172.21.15.123:0/2318863040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2528148220 con 0x7f25280b7890 2023-03-08T15:50:24.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f25257fa700 1 -- 172.21.15.123:0/2318863040 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520005310 con 0x7f25280b7890 2023-03-08T15:50:24.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.740+0000 7f252eb10700 1 -- 172.21.15.123:0/2318863040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25280b45f0 con 0x7f25280b7890 2023-03-08T15:50:24.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.741+0000 7f252eb10700 1 -- 172.21.15.123:0/2318863040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25280b7d30 con 0x7f25280b7890 2023-03-08T15:50:24.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.742+0000 7f25257fa700 1 -- 172.21.15.123:0/2318863040 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f2520005470 con 0x7f25280b7890 2023-03-08T15:50:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.742+0000 7f25257fa700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f250c0698d0 0x7f250c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.742+0000 7f25257fa700 1 -- 172.21.15.123:0/2318863040 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2520087780 con 0x7f25280b7890 2023-03-08T15:50:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.742+0000 7f252c8ac700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f250c0698d0 0x7f250c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.742+0000 7f252c8ac700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f250c0698d0 0x7f250c06bd80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f251c009bd0 tx=0x7f251c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:24.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.746+0000 7f25257fa700 1 -- 172.21.15.123:0/2318863040 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f2520053550 con 0x7f25280b7890 2023-03-08T15:50:24.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:24.977+0000 7f252eb10700 1 -- 172.21.15.123:0/2318863040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f25280744c0 con 0x7f25280b7890 2023-03-08T15:50:25.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:25.859+0000 7f25257fa700 1 -- 172.21.15.123:0/2318863040 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f252005c0c0 con 0x7f25280b7890 2023-03-08T15:50:25.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:25.861+0000 7f252eb10700 1 -- 172.21.15.123:0/2318863040 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f250c0698d0 msgr2=0x7f250c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:25.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:25.861+0000 7f252eb10700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f250c0698d0 0x7f250c06bd80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f251c009bd0 tx=0x7f251c008040 comp rx=0 tx=0).stop 2023-03-08T15:50:25.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:25.861+0000 7f252eb10700 1 -- 172.21.15.123:0/2318863040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25280b7890 msgr2=0x7f2528140bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:25.863 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:25.861+0000 7f252eb10700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25280b7890 0x7f2528140bb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f252814b880 tx=0x7f252000ee00 comp rx=0 tx=0).stop 2023-03-08T15:50:25.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:25.862+0000 7f252eb10700 1 -- 172.21.15.123:0/2318863040 shutdown_connections 2023-03-08T15:50:25.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:25.862+0000 7f252eb10700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25280b7890 0x7f2528140bb0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:25.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:25.862+0000 7f252eb10700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f250c0698d0 0x7f250c06bd80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:25.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:25.862+0000 7f252eb10700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2518004850 0x7f25281439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:25.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:25.862+0000 7f252eb10700 1 --2- 172.21.15.123:0/2318863040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25280b5680 0x7f25280b7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:25.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:25.862+0000 7f252eb10700 1 -- 172.21.15.123:0/2318863040 >> 172.21.15.123:0/2318863040 conn(0x7f252806b360 msgr2=0x7f25280b9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:25.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:25.862+0000 7f252eb10700 1 -- 172.21.15.123:0/2318863040 shutdown_connections 2023-03-08T15:50:25.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:25.862+0000 7f252eb10700 1 -- 172.21.15.123:0/2318863040 wait complete. 2023-03-08T15:50:25.877 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-03-08T15:50:25.878 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-08T15:50:26.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.002+0000 7fee1e007700 1 Processor -- start 2023-03-08T15:50:26.003 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.002+0000 7fee1e007700 1 -- start start 2023-03-08T15:50:26.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.002+0000 7fee1e007700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee181446c0 0x7fee180b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.002+0000 7fee1e007700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee180b7fa0 con 0x7fee18144a90 2023-03-08T15:50:26.005 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.002+0000 7fee1e007700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee180b7130 con 0x7fee180ba560 2023-03-08T15:50:26.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.002+0000 7fee1e007700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee180bdc90 con 0x7fee181446c0 2023-03-08T15:50:26.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.003+0000 7fee177fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee181446c0 0x7fee180b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.003+0000 7fee177fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee181446c0 0x7fee180b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36824/0 (socket says 172.21.15.123:36824) 2023-03-08T15:50:26.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.003+0000 7fee16ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fee18144a90 0x7fee180bd580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51970/0 (socket says 172.21.15.123:51970) 2023-03-08T15:50:26.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.003+0000 7fee177fe700 1 -- 172.21.15.123:0/2730274886 learned_addr learned my addr 172.21.15.123:0/2730274886 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:26.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.003+0000 7fee177fe700 1 -- 172.21.15.123:0/2730274886 >> v1:172.21.15.175:6789/0 conn(0x7fee180ba560 legacy=0x7fee18154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:26.006 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.003+0000 7fee177fe700 1 -- 172.21.15.123:0/2730274886 >> v1:172.21.15.123:6789/0 conn(0x7fee18144a90 legacy=0x7fee180bd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.003+0000 7fee177fe700 1 -- 172.21.15.123:0/2730274886 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee180bc030 con 0x7fee181446c0 2023-03-08T15:50:26.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.003+0000 7fee167fc700 1 -- 172.21.15.123:0/2730274886 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668355128 0 0) 0x7fee180b7fa0 con 0x7fee18144a90 2023-03-08T15:50:26.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.003+0000 7fee177fe700 1 --2- 172.21.15.123:0/2730274886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee181446c0 0x7fee180b6bf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fee080098f0 tx=0x7fee08009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ebed6af8b120a4 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:26.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.003+0000 7fee167fc700 1 -- 172.21.15.123:0/2730274886 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08004230 con 0x7fee181446c0 2023-03-08T15:50:26.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.003+0000 7fee167fc700 1 -- 172.21.15.123:0/2730274886 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee08004390 con 0x7fee181446c0 2023-03-08T15:50:26.007 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.003+0000 7fee167fc700 1 -- 172.21.15.123:0/2730274886 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee080036a0 con 0x7fee181446c0 2023-03-08T15:50:26.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.004+0000 7fee1e007700 1 -- 172.21.15.123:0/2730274886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee181446c0 msgr2=0x7fee180b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.004+0000 7fee1e007700 1 --2- 172.21.15.123:0/2730274886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee181446c0 0x7fee180b6bf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fee080098f0 tx=0x7fee08009c00 comp rx=0 tx=0).stop 2023-03-08T15:50:26.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.004+0000 7fee1e007700 1 -- 172.21.15.123:0/2730274886 shutdown_connections 2023-03-08T15:50:26.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.004+0000 7fee1e007700 1 --2- 172.21.15.123:0/2730274886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee181446c0 0x7fee180b6bf0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.004+0000 7fee1e007700 1 -- 172.21.15.123:0/2730274886 >> 172.21.15.123:0/2730274886 conn(0x7fee18071980 msgr2=0x7fee18071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:26.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.004+0000 7fee1e007700 1 -- 172.21.15.123:0/2730274886 shutdown_connections 2023-03-08T15:50:26.008 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.004+0000 7fee1e007700 1 -- 172.21.15.123:0/2730274886 wait complete. 2023-03-08T15:50:26.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.005+0000 7fee1e007700 1 Processor -- start 2023-03-08T15:50:26.010 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.005+0000 7fee1e007700 1 -- start start 2023-03-08T15:50:26.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.005+0000 7fee1e007700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee180ba560 0x7fee18141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.005+0000 7fee1e007700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee181446c0 0x7fee181e0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fee1e007700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee18144a90 0x7fee181e0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fee1e007700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee181e0dd0 con 0x7fee180ba560 2023-03-08T15:50:26.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fee1e007700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee18145c10 con 0x7fee18144a90 2023-03-08T15:50:26.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fee1e007700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee180c0c70 con 0x7fee181446c0 2023-03-08T15:50:26.011 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fee177fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee180ba560 0x7fee18141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fee177fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee180ba560 0x7fee18141e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36830/0 (socket says 172.21.15.123:36830) 2023-03-08T15:50:26.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fee177fe700 1 -- 172.21.15.123:0/1251892317 learned_addr learned my addr 172.21.15.123:0/1251892317 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:26.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fee177fe700 1 -- 172.21.15.123:0/1251892317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee181446c0 msgr2=0x7fee181e0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fee177fe700 1 --2- 172.21.15.123:0/1251892317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee181446c0 0x7fee181e0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fee177fe700 1 -- 172.21.15.123:0/1251892317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee18144a90 msgr2=0x7fee181e0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fee177fe700 1 --2- 172.21.15.123:0/1251892317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee18144a90 0x7fee181e0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fee177fe700 1 -- 172.21.15.123:0/1251892317 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee08009550 con 0x7fee180ba560 2023-03-08T15:50:26.012 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fee177fe700 1 --2- 172.21.15.123:0/1251892317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee180ba560 0x7fee18141e50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fee08000c00 tx=0x7fee08004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:26.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fedfffff700 1 -- 172.21.15.123:0/1251892317 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08003db0 con 0x7fee180ba560 2023-03-08T15:50:26.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fedfffff700 1 -- 172.21.15.123:0/1251892317 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0801f070 con 0x7fee180ba560 2023-03-08T15:50:26.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fee1e007700 1 -- 172.21.15.123:0/1251892317 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee180bc5f0 con 0x7fee180ba560 2023-03-08T15:50:26.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fedfffff700 1 -- 172.21.15.123:0/1251892317 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0800b8a0 con 0x7fee180ba560 2023-03-08T15:50:26.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.006+0000 7fee1e007700 1 -- 172.21.15.123:0/1251892317 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee180bc310 con 0x7fee180ba560 2023-03-08T15:50:26.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.007+0000 7fee1e007700 1 -- 172.21.15.123:0/1251892317 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1814db90 con 0x7fee180ba560 2023-03-08T15:50:26.013 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.007+0000 7fedfffff700 1 -- 172.21.15.123:0/1251892317 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fee0802a020 con 0x7fee180ba560 2023-03-08T15:50:26.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.008+0000 7fedfffff700 1 --2- 172.21.15.123:0/1251892317 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee040698d0 0x7fee0406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.008+0000 7fee16ffd700 1 --2- 172.21.15.123:0/1251892317 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee040698d0 0x7fee0406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.008+0000 7fedfffff700 1 -- 172.21.15.123:0/1251892317 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee08089040 con 0x7fee180ba560 2023-03-08T15:50:26.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.008+0000 7fee16ffd700 1 --2- 172.21.15.123:0/1251892317 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee040698d0 0x7fee0406bd80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fee180c18d0 tx=0x7fee0c0079f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:26.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.012+0000 7fedfffff700 1 -- 172.21.15.123:0/1251892317 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fee080bb150 con 0x7fee180ba560 2023-03-08T15:50:26.099 INFO:tasks.ceph.mds.c.smithi123.stderr:2023-03-08T15:50:26.098+0000 7f291c480700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-08T15:50:26.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.240+0000 7fee1e007700 1 -- 172.21.15.123:0/1251892317 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee1814db90 con 0x7fee180ba560 2023-03-08T15:50:26.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.240+0000 7fedfffff700 1 -- 172.21.15.123:0/1251892317 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3920 (secure 0 0 0) 0x7fee08054cc0 con 0x7fee180ba560 2023-03-08T15:50:26.242 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:26.242 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/583987808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":583987808},{"type":"v1","addr":"172.21.15.175:6833","nonce":583987808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4822,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1923847563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":1923847563},{"type":"v1","addr":"172.21.15.123:6837","nonce":1923847563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-08T15:50:22.580766+0000","modified":"2023-03-08T15:50:25.857523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4896},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4896":{"gid":4896,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/2780487159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2780487159},{"type":"v1","addr":"172.21.15.123:6836","nonce":2780487159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-08T15:50:26.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.242+0000 7fee1e007700 1 -- 172.21.15.123:0/1251892317 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee040698d0 msgr2=0x7fee0406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.242+0000 7fee1e007700 1 --2- 172.21.15.123:0/1251892317 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee040698d0 0x7fee0406bd80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fee180c18d0 tx=0x7fee0c0079f0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.242+0000 7fee1e007700 1 -- 172.21.15.123:0/1251892317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee180ba560 msgr2=0x7fee18141e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.242+0000 7fee1e007700 1 --2- 172.21.15.123:0/1251892317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee180ba560 0x7fee18141e50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fee08000c00 tx=0x7fee08004750 comp rx=0 tx=0).stop 2023-03-08T15:50:26.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.242+0000 7fee1e007700 1 -- 172.21.15.123:0/1251892317 shutdown_connections 2023-03-08T15:50:26.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.242+0000 7fee1e007700 1 --2- 172.21.15.123:0/1251892317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee18144a90 0x7fee181e0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.242+0000 7fee1e007700 1 --2- 172.21.15.123:0/1251892317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee180ba560 0x7fee18141e50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.242+0000 7fee1e007700 1 --2- 172.21.15.123:0/1251892317 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee040698d0 0x7fee0406bd80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.242+0000 7fee1e007700 1 --2- 172.21.15.123:0/1251892317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee181446c0 0x7fee181e0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.242+0000 7fee1e007700 1 -- 172.21.15.123:0/1251892317 >> 172.21.15.123:0/1251892317 conn(0x7fee18071980 msgr2=0x7fee1814ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:26.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.243+0000 7fee1e007700 1 -- 172.21.15.123:0/1251892317 shutdown_connections 2023-03-08T15:50:26.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.243+0000 7fee1e007700 1 -- 172.21.15.123:0/1251892317 wait complete. 2023-03-08T15:50:26.246 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 16 2023-03-08T15:50:26.256 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-08T15:50:26.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.375+0000 7f1f85e6a700 1 Processor -- start 2023-03-08T15:50:26.376 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.375+0000 7f1f85e6a700 1 -- start start 2023-03-08T15:50:26.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.375+0000 7f1f85e6a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1f8014b9b0 0x7f1f800b92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f85e6a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f800ba690 con 0x7f1f80142680 2023-03-08T15:50:26.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f85e6a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f80072330 con 0x7f1f800b7f80 2023-03-08T15:50:26.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f85e6a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f800b71e0 con 0x7f1f8014b9b0 2023-03-08T15:50:26.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7f7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1f80142680 0x7f1f80071c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56518/0 (socket says 172.21.15.123:56518) 2023-03-08T15:50:26.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7f7fe700 1 -- 172.21.15.123:0/1186438297 learned_addr learned my addr 172.21.15.123:0/1186438297 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:26.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7e7fc700 1 -- 172.21.15.123:0/1186438297 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653662078 0 0) 0x7f1f800ba690 con 0x7f1f80142680 2023-03-08T15:50:26.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7e7fc700 1 -- 172.21.15.123:0/1186438297 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f680035b0 con 0x7f1f80142680 2023-03-08T15:50:26.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7ffff700 1 --2- 172.21.15.123:0/1186438297 >> v2:172.21.15.175:3300/0 conn(0x7f1f8014b9b0 0x7f1f800b92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7e7fc700 1 -- 172.21.15.123:0/1186438297 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3507857460 0 0) 0x7f1f680035b0 con 0x7f1f80142680 2023-03-08T15:50:26.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7e7fc700 1 -- 172.21.15.123:0/1186438297 >> v2:172.21.15.175:3300/0 conn(0x7f1f8014b9b0 msgr2=0x7f1f800b92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:26.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7e7fc700 1 --2- 172.21.15.123:0/1186438297 >> v2:172.21.15.175:3300/0 conn(0x7f1f8014b9b0 0x7f1f800b92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7e7fc700 1 -- 172.21.15.123:0/1186438297 >> v1:172.21.15.175:6789/0 conn(0x7f1f800b7f80 legacy=0x7f1f80150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7e7fc700 1 -- 172.21.15.123:0/1186438297 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f800ba8e0 con 0x7f1f80142680 2023-03-08T15:50:26.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7e7fc700 1 -- 172.21.15.123:0/1186438297 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f1f70001670 con 0x7f1f80142680 2023-03-08T15:50:26.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7e7fc700 1 -- 172.21.15.123:0/1186438297 >> v1:172.21.15.123:6789/0 conn(0x7f1f80142680 legacy=0x7f1f80071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7e7fc700 1 --2- 172.21.15.123:0/1186438297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f68003a00 0x7f1f68003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7e7fc700 1 --2- 172.21.15.123:0/1186438297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f68004850 0x7f1f68004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7e7fc700 1 --2- 172.21.15.123:0/1186438297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f68005200 0x7f1f6800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7e7fc700 1 -- 172.21.15.123:0/1186438297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800b71e0 con 0x7f1f68003a00 2023-03-08T15:50:26.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7e7fc700 1 -- 172.21.15.123:0/1186438297 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6800c190 con 0x7f1f68004850 2023-03-08T15:50:26.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7e7fc700 1 -- 172.21.15.123:0/1186438297 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6800c350 con 0x7f1f68005200 2023-03-08T15:50:26.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7f7fe700 1 --2- 172.21.15.123:0/1186438297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f68003a00 0x7f1f68003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7effd700 1 --2- 172.21.15.123:0/1186438297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f68004850 0x7f1f68004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7ffff700 1 --2- 172.21.15.123:0/1186438297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f68005200 0x7f1f6800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7f7fe700 1 -- 172.21.15.123:0/1186438297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f68005200 msgr2=0x7f1f6800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:26.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7f7fe700 1 --2- 172.21.15.123:0/1186438297 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f68005200 0x7f1f6800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7f7fe700 1 -- 172.21.15.123:0/1186438297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f68004850 msgr2=0x7f1f68004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:26.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7f7fe700 1 --2- 172.21.15.123:0/1186438297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f68004850 0x7f1f68004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7ffff700 1 -- 172.21.15.123:0/1186438297 reap_dead start 2023-03-08T15:50:26.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.376+0000 7f1f7f7fe700 1 -- 172.21.15.123:0/1186438297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680035b0 con 0x7f1f68003a00 2023-03-08T15:50:26.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.377+0000 7f1f7f7fe700 1 --2- 172.21.15.123:0/1186438297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f68003a00 0x7f1f68003e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c210 tx=0x7f1f68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e271cc15b2070e server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:26.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.377+0000 7f1f7e7fc700 1 -- 172.21.15.123:0/1186438297 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70007c10 con 0x7f1f68003a00 2023-03-08T15:50:26.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.377+0000 7f1f7e7fc700 1 -- 172.21.15.123:0/1186438297 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7000cd70 con 0x7f1f68003a00 2023-03-08T15:50:26.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.377+0000 7f1f7e7fc700 1 -- 172.21.15.123:0/1186438297 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70005ba0 con 0x7f1f68003a00 2023-03-08T15:50:26.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.377+0000 7f1f85e6a700 1 -- 172.21.15.123:0/1186438297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f68003a00 msgr2=0x7f1f68003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.377+0000 7f1f85e6a700 1 --2- 172.21.15.123:0/1186438297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f68003a00 0x7f1f68003e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c210 tx=0x7f1f68005880 comp rx=0 tx=0).stop 2023-03-08T15:50:26.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.377+0000 7f1f85e6a700 1 -- 172.21.15.123:0/1186438297 shutdown_connections 2023-03-08T15:50:26.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.377+0000 7f1f85e6a700 1 --2- 172.21.15.123:0/1186438297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f68003a00 0x7f1f68003e10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.377+0000 7f1f85e6a700 1 -- 172.21.15.123:0/1186438297 >> 172.21.15.123:0/1186438297 conn(0x7f1f8006b360 msgr2=0x7f1f8006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:26.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.377+0000 7f1f85e6a700 1 -- 172.21.15.123:0/1186438297 shutdown_connections 2023-03-08T15:50:26.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.377+0000 7f1f85e6a700 1 -- 172.21.15.123:0/1186438297 wait complete. 2023-03-08T15:50:26.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.378+0000 7f1f85e6a700 1 Processor -- start 2023-03-08T15:50:26.386 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f85e6a700 1 -- start start 2023-03-08T15:50:26.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f85e6a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f68003a00 0x7f1f8006faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f85e6a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f801401e0 0x7f1f800712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f85e6a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f800717e0 0x7f1f8013b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f85e6a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f80071f50 con 0x7f1f68003a00 2023-03-08T15:50:26.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f85e6a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f80141440 con 0x7f1f800717e0 2023-03-08T15:50:26.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f85e6a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f80070800 con 0x7f1f801401e0 2023-03-08T15:50:26.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f7f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f68003a00 0x7f1f8006faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f7f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f68003a00 0x7f1f8006faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35464/0 (socket says 172.21.15.123:35464) 2023-03-08T15:50:26.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f7f7fe700 1 -- 172.21.15.123:0/3011621536 learned_addr learned my addr 172.21.15.123:0/3011621536 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:26.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f7ffff700 1 --2- 172.21.15.123:0/3011621536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f800717e0 0x7f1f8013b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f7effd700 1 --2- 172.21.15.123:0/3011621536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f801401e0 0x7f1f800712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f7f7fe700 1 -- 172.21.15.123:0/3011621536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f801401e0 msgr2=0x7f1f800712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f7f7fe700 1 --2- 172.21.15.123:0/3011621536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f801401e0 0x7f1f800712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f7f7fe700 1 -- 172.21.15.123:0/3011621536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f800717e0 msgr2=0x7f1f8013b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.379+0000 7f1f7f7fe700 1 --2- 172.21.15.123:0/3011621536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f800717e0 0x7f1f8013b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.380+0000 7f1f7f7fe700 1 -- 172.21.15.123:0/3011621536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f80142a50 con 0x7f1f68003a00 2023-03-08T15:50:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.380+0000 7f1f7f7fe700 1 --2- 172.21.15.123:0/3011621536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f68003a00 0x7f1f8006faa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c800 tx=0x7f1f70001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.380+0000 7f1f67fff700 1 -- 172.21.15.123:0/3011621536 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70005ea0 con 0x7f1f68003a00 2023-03-08T15:50:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.380+0000 7f1f67fff700 1 -- 172.21.15.123:0/3011621536 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f70001640 con 0x7f1f68003a00 2023-03-08T15:50:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.380+0000 7f1f85e6a700 1 -- 172.21.15.123:0/3011621536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f800b8dd0 con 0x7f1f68003a00 2023-03-08T15:50:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.380+0000 7f1f67fff700 1 -- 172.21.15.123:0/3011621536 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f700072f0 con 0x7f1f68003a00 2023-03-08T15:50:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.380+0000 7f1f85e6a700 1 -- 172.21.15.123:0/3011621536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f800bad10 con 0x7f1f68003a00 2023-03-08T15:50:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.381+0000 7f1f85e6a700 1 -- 172.21.15.123:0/3011621536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f800744c0 con 0x7f1f68003a00 2023-03-08T15:50:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.381+0000 7f1f67fff700 1 -- 172.21.15.123:0/3011621536 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f1f70024070 con 0x7f1f68003a00 2023-03-08T15:50:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.382+0000 7f1f67fff700 1 --2- 172.21.15.123:0/3011621536 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f1f6c0698d0 0x7f1f6c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.382+0000 7f1f67fff700 1 -- 172.21.15.123:0/3011621536 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f70088c80 con 0x7f1f68003a00 2023-03-08T15:50:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.382+0000 7f1f7effd700 1 --2- 172.21.15.123:0/3011621536 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f1f6c0698d0 0x7f1f6c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.382+0000 7f1f7effd700 1 --2- 172.21.15.123:0/3011621536 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f1f6c0698d0 0x7f1f6c06bd80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1f800b3eb0 tx=0x7f1f74009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.386+0000 7f1f67fff700 1 -- 172.21.15.123:0/3011621536 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f1f70054a50 con 0x7f1f68003a00 2023-03-08T15:50:26.572 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.570+0000 7f1f85e6a700 1 -- 172.21.15.123:0/3011621536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f80149360 con 0x7f1f68003a00 2023-03-08T15:50:26.573 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.571+0000 7f1f67fff700 1 -- 172.21.15.123:0/3011621536 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18027 (secure 0 0 0) 0x7f1f70007d70 con 0x7f1f68003a00 2023-03-08T15:50:26.573 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:26.573 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":34,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","created":"2023-03-08T15:49:14.078281+0000","modified":"2023-03-08T15:50:23.582655+0000","last_up_change":"2023-03-08T15:49:25.096231+0000","last_in_change":"2023-03-08T15:49:16.632999+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-08T15:49:26.011228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-08T15:49:32.528343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-03-08T15:50:20.856986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-03-08T15:50:21.541149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fd40c70-d43e-4434-b1c4-3b90fad2fd47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":143185},{"type":"v1","addr":"172.21.15.123:6801","nonce":143185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":143185},{"type":"v1","addr":"172.21.15.123:6803","nonce":143185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":143185},{"type":"v1","addr":"172.21.15.123:6807","nonce":143185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":143185},{"type":"v1","addr":"172.21.15.123:6805","nonce":143185}]},"public_addr":"172.21.15.123:6801/143185","cluster_addr":"172.21.15.123:6803/143185","heartbeat_back_addr":"172.21.15.123:6807/143185","heartbeat_front_addr":"172.21.15.123:6805/143185","state":["exists","up"]},{"osd":1,"uuid":"bec1799b-fafb-4479-bc98-75096068107f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":143187},{"type":"v1","addr":"172.21.15.123:6825","nonce":143187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":143187},{"type":"v1","addr":"172.21.15.123:6827","nonce":143187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":143187},{"type":"v1","addr":"172.21.15.123:6831","nonce":143187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":143187},{"type":"v1","addr":"172.21.15.123:6829","nonce":143187}]},"public_addr":"172.21.15.123:6825/143187","cluster_addr":"172.21.15.123:6827/143187","heartbeat_back_addr":"172.21.15.123:6831/143187","heartbeat_front_addr":"172.21.15.123:6829/143187","state":["exists","up"]},{"osd":2,"uuid":"0330f8e5-4001-448b-8337-eb5d166bd58b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":143186},{"type":"v1","addr":"172.21.15.123:6809","nonce":143186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":143186},{"type":"v1","addr":"172.21.15.123:6811","nonce":143186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":143186},{"type":"v1","addr":"172.21.15.123:6815","nonce":143186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":143186},{"type":"v1","addr":"172.21.15.123:6813","nonce":143186}]},"public_addr":"172.21.15.123:6809/143186","cluster_addr":"172.21.15.123:6811/143186","heartbeat_back_addr":"172.21.15.123:6815/143186","heartbeat_front_addr":"172.21.15.123:6813/143186","state":["exists","up"]},{"osd":3,"uuid":"9706b3c9-3521-4f32-9cd9-2a672751b830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":143196},{"type":"v1","addr":"172.21.15.123:6817","nonce":143196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":143196},{"type":"v1","addr":"172.21.15.123:6819","nonce":143196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":143196},{"type":"v1","addr":"172.21.15.123:6823","nonce":143196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":143196},{"type":"v1","addr":"172.21.15.123:6821","nonce":143196}]},"public_addr":"172.21.15.123:6817/143196","cluster_addr":"172.21.15.123:6819/143196","heartbeat_back_addr":"172.21.15.123:6823/143196","heartbeat_front_addr":"172.21.15.123:6821/143196","state":["exists","up"]},{"osd":4,"uuid":"8677c2aa-a97f-4594-8a3d-bcc3c3eea244","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":114829},{"type":"v1","addr":"172.21.15.175:6801","nonce":114829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":114829},{"type":"v1","addr":"172.21.15.175:6803","nonce":114829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":114829},{"type":"v1","addr":"172.21.15.175:6807","nonce":114829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":114829},{"type":"v1","addr":"172.21.15.175:6805","nonce":114829}]},"public_addr":"172.21.15.175:6801/114829","cluster_addr":"172.21.15.175:6803/114829","heartbeat_back_addr":"172.21.15.175:6807/114829","heartbeat_front_addr":"172.21.15.175:6805/114829","state":["exists","up"]},{"osd":5,"uuid":"fc0759ee-94f0-46df-a298-5cdc9be436df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":114842},{"type":"v1","addr":"172.21.15.175:6817","nonce":114842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":114842},{"type":"v1","addr":"172.21.15.175:6819","nonce":114842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":114842},{"type":"v1","addr":"172.21.15.175:6823","nonce":114842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":114842},{"type":"v1","addr":"172.21.15.175:6821","nonce":114842}]},"public_addr":"172.21.15.175:6817/114842","cluster_addr":"172.21.15.175:6819/114842","heartbeat_back_addr":"172.21.15.175:6823/114842","heartbeat_front_addr":"172.21.15.175:6821/114842","state":["exists","up"]},{"osd":6,"uuid":"2baaf193-569a-477b-823b-c52f1d931872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":114830},{"type":"v1","addr":"172.21.15.175:6809","nonce":114830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":114830},{"type":"v1","addr":"172.21.15.175:6811","nonce":114830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":114830},{"type":"v1","addr":"172.21.15.175:6815","nonce":114830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":114830},{"type":"v1","addr":"172.21.15.175:6813","nonce":114830}]},"public_addr":"172.21.15.175:6809/114830","cluster_addr":"172.21.15.175:6811/114830","heartbeat_back_addr":"172.21.15.175:6815/114830","heartbeat_front_addr":"172.21.15.175:6813/114830","state":["exists","up"]},{"osd":7,"uuid":"39c8e50b-8b86-4f2e-8bf9-130df0e51aec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":114862},{"type":"v1","addr":"172.21.15.175:6825","nonce":114862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":114862},{"type":"v1","addr":"172.21.15.175:6827","nonce":114862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":114862},{"type":"v1","addr":"172.21.15.175:6831","nonce":114862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":114862},{"type":"v1","addr":"172.21.15.175:6829","nonce":114862}]},"public_addr":"172.21.15.175:6825/114862","cluster_addr":"172.21.15.175:6827/114862","heartbeat_back_addr":"172.21.15.175:6831/114862","heartbeat_front_addr":"172.21.15.175:6829/114862","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.826043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.798407+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.763663+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.832505+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.855309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.852017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-08T15:49:21.844990+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-08T15:50:26.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.573+0000 7f1f85e6a700 1 -- 172.21.15.123:0/3011621536 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f1f6c0698d0 msgr2=0x7f1f6c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.573+0000 7f1f85e6a700 1 --2- 172.21.15.123:0/3011621536 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f1f6c0698d0 0x7f1f6c06bd80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1f800b3eb0 tx=0x7f1f74009040 comp rx=0 tx=0).stop 2023-03-08T15:50:26.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.573+0000 7f1f85e6a700 1 -- 172.21.15.123:0/3011621536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f68003a00 msgr2=0x7f1f8006faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.575 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.573+0000 7f1f85e6a700 1 --2- 172.21.15.123:0/3011621536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f68003a00 0x7f1f8006faa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c800 tx=0x7f1f70001a00 comp rx=0 tx=0).stop 2023-03-08T15:50:26.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.574+0000 7f1f85e6a700 1 -- 172.21.15.123:0/3011621536 shutdown_connections 2023-03-08T15:50:26.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.574+0000 7f1f85e6a700 1 --2- 172.21.15.123:0/3011621536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f800717e0 0x7f1f8013b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.574+0000 7f1f85e6a700 1 --2- 172.21.15.123:0/3011621536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f68003a00 0x7f1f8006faa0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.574+0000 7f1f85e6a700 1 --2- 172.21.15.123:0/3011621536 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f1f6c0698d0 0x7f1f6c06bd80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.574+0000 7f1f85e6a700 1 --2- 172.21.15.123:0/3011621536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f801401e0 0x7f1f800712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.574+0000 7f1f85e6a700 1 -- 172.21.15.123:0/3011621536 >> 172.21.15.123:0/3011621536 conn(0x7f1f8006b360 msgr2=0x7f1f8013dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:26.576 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.574+0000 7f1f85e6a700 1 -- 172.21.15.123:0/3011621536 shutdown_connections 2023-03-08T15:50:26.577 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.574+0000 7f1f85e6a700 1 -- 172.21.15.123:0/3011621536 wait complete. 2023-03-08T15:50:26.587 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-08T15:50:26.587 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-08T15:50:26.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.705+0000 7fc1b4efa700 1 Processor -- start 2023-03-08T15:50:26.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.705+0000 7fc1b4efa700 1 -- start start 2023-03-08T15:50:26.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.706+0000 7fc1b4efa700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc1b00bb350 0x7fc1b01446b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.706+0000 7fc1b4efa700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc1b0144bf0 0x7fc1b00bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.706+0000 7fc1b4efa700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b014dc00 con 0x7fc1b00be1f0 2023-03-08T15:50:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.706+0000 7fc1b4efa700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b006bb70 con 0x7fc1b0144bf0 2023-03-08T15:50:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.706+0000 7fc1b4efa700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b00b9fc0 con 0x7fc1b00bb350 2023-03-08T15:50:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.706+0000 7fc1add9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc1b0144bf0 0x7fc1b00bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.706+0000 7fc1add9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc1b0144bf0 0x7fc1b00bdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35476/0 (socket says 172.21.15.123:35476) 2023-03-08T15:50:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.706+0000 7fc1add9b700 1 -- 172.21.15.123:0/4053309572 learned_addr learned my addr 172.21.15.123:0/4053309572 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.707+0000 7fc1ae59c700 1 --2- 172.21.15.123:0/4053309572 >> v2:172.21.15.175:3300/0 conn(0x7fc1b00bb350 0x7fc1b01446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.707+0000 7fc1add9b700 1 -- 172.21.15.123:0/4053309572 >> v2:172.21.15.175:3300/0 conn(0x7fc1b00bb350 msgr2=0x7fc1b01446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.707+0000 7fc1add9b700 1 --2- 172.21.15.123:0/4053309572 >> v2:172.21.15.175:3300/0 conn(0x7fc1b00bb350 0x7fc1b01446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.707+0000 7fc1add9b700 1 -- 172.21.15.123:0/4053309572 >> v1:172.21.15.175:6789/0 conn(0x7fc1b00be1f0 legacy=0x7fc1b014e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.707+0000 7fc1add9b700 1 -- 172.21.15.123:0/4053309572 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b00ba2a0 con 0x7fc1b0144bf0 2023-03-08T15:50:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.707+0000 7fc1add9b700 1 --2- 172.21.15.123:0/4053309572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b0144bf0 0x7fc1b00bdcb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00703b0 tx=0x7fc1a0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5ee96558e0d5d5 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.707+0000 7fc1ad59a700 1 -- 172.21.15.123:0/4053309572 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a000b870 con 0x7fc1b0144bf0 2023-03-08T15:50:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.707+0000 7fc1ad59a700 1 -- 172.21.15.123:0/4053309572 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a000b9d0 con 0x7fc1b0144bf0 2023-03-08T15:50:26.711 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.707+0000 7fc1ad59a700 1 -- 172.21.15.123:0/4053309572 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a000bd60 con 0x7fc1b0144bf0 2023-03-08T15:50:26.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.707+0000 7fc1b4efa700 1 -- 172.21.15.123:0/4053309572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b0144bf0 msgr2=0x7fc1b00bdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.707+0000 7fc1b4efa700 1 --2- 172.21.15.123:0/4053309572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b0144bf0 0x7fc1b00bdcb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00703b0 tx=0x7fc1a0009bd0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.708+0000 7fc1b4efa700 1 -- 172.21.15.123:0/4053309572 shutdown_connections 2023-03-08T15:50:26.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.708+0000 7fc1b4efa700 1 --2- 172.21.15.123:0/4053309572 >> v2:172.21.15.175:3300/0 conn(0x7fc1b00bb350 0x7fc1b01446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.708+0000 7fc1b4efa700 1 --2- 172.21.15.123:0/4053309572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b0144bf0 0x7fc1b00bdcb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.713 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.708+0000 7fc1b4efa700 1 -- 172.21.15.123:0/4053309572 >> 172.21.15.123:0/4053309572 conn(0x7fc1b006a250 msgr2=0x7fc1b006a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:26.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.708+0000 7fc1b4efa700 1 -- 172.21.15.123:0/4053309572 shutdown_connections 2023-03-08T15:50:26.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.708+0000 7fc1b4efa700 1 -- 172.21.15.123:0/4053309572 wait complete. 2023-03-08T15:50:26.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.709+0000 7fc1b4efa700 1 Processor -- start 2023-03-08T15:50:26.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.709+0000 7fc1b4efa700 1 -- start start 2023-03-08T15:50:26.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.709+0000 7fc1b4efa700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1b00bb350 0x7fc1b0147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.709+0000 7fc1b4efa700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00be1f0 0x7fc1b013a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.709+0000 7fc1b4efa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b0144bf0 0x7fc1b013ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.709+0000 7fc1b4efa700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b01487c0 con 0x7fc1b0144bf0 2023-03-08T15:50:26.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.709+0000 7fc1b4efa700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b01484e0 con 0x7fc1b00bb350 2023-03-08T15:50:26.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.709+0000 7fc1b4efa700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0146770 con 0x7fc1b00be1f0 2023-03-08T15:50:26.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.709+0000 7fc1aed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b0144bf0 0x7fc1b013ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1aed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b0144bf0 0x7fc1b013ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35478/0 (socket says 172.21.15.123:35478) 2023-03-08T15:50:26.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1aed9d700 1 -- 172.21.15.123:0/2185251610 learned_addr learned my addr 172.21.15.123:0/2185251610 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:26.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1add9b700 1 --2- 172.21.15.123:0/2185251610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00be1f0 0x7fc1b013a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1aed9d700 1 -- 172.21.15.123:0/2185251610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00be1f0 msgr2=0x7fc1b013a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1aed9d700 1 --2- 172.21.15.123:0/2185251610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00be1f0 0x7fc1b013a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1aed9d700 1 -- 172.21.15.123:0/2185251610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1b00bb350 msgr2=0x7fc1b0147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1ae59c700 1 --2- 172.21.15.123:0/2185251610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1b00bb350 0x7fc1b0147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1aed9d700 1 --2- 172.21.15.123:0/2185251610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1b00bb350 0x7fc1b0147840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1aed9d700 1 -- 172.21.15.123:0/2185251610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a0009550 con 0x7fc1b0144bf0 2023-03-08T15:50:26.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1ae59c700 1 --2- 172.21.15.123:0/2185251610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1b00bb350 0x7fc1b0147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:26.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1aed9d700 1 --2- 172.21.15.123:0/2185251610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b0144bf0 0x7fc1b013ae90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800cc50 tx=0x7fc1a800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:26.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1a6ffd700 1 -- 172.21.15.123:0/2185251610 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8003c00 con 0x7fc1b0144bf0 2023-03-08T15:50:26.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1a6ffd700 1 -- 172.21.15.123:0/2185251610 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a8003d60 con 0x7fc1b0144bf0 2023-03-08T15:50:26.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1b4efa700 1 -- 172.21.15.123:0/2185251610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b00bb720 con 0x7fc1b0144bf0 2023-03-08T15:50:26.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1a6ffd700 1 -- 172.21.15.123:0/2185251610 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a800ab60 con 0x7fc1b0144bf0 2023-03-08T15:50:26.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.710+0000 7fc1b4efa700 1 -- 172.21.15.123:0/2185251610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b00ba580 con 0x7fc1b0144bf0 2023-03-08T15:50:26.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.711+0000 7fc1b4efa700 1 -- 172.21.15.123:0/2185251610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b014e7a0 con 0x7fc1b0144bf0 2023-03-08T15:50:26.717 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.712+0000 7fc1a6ffd700 1 -- 172.21.15.123:0/2185251610 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fc1a8010050 con 0x7fc1b0144bf0 2023-03-08T15:50:26.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.712+0000 7fc1a6ffd700 1 --2- 172.21.15.123:0/2185251610 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc190069900 0x7fc19006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:26.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.712+0000 7fc1ae59c700 1 --2- 172.21.15.123:0/2185251610 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc190069900 0x7fc19006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:26.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.712+0000 7fc1a6ffd700 1 -- 172.21.15.123:0/2185251610 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1a8087530 con 0x7fc1b0144bf0 2023-03-08T15:50:26.718 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.712+0000 7fc1ae59c700 1 --2- 172.21.15.123:0/2185251610 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc190069900 0x7fc19006bdb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc198009a00 tx=0x7fc198008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:26.719 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.716+0000 7fc1a6ffd700 1 -- 172.21.15.123:0/2185251610 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fc1a8053300 con 0x7fc1b0144bf0 2023-03-08T15:50:26.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.899+0000 7fc1b4efa700 1 -- 172.21.15.123:0/2185251610 --> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1b00739f0 con 0x7fc190069900 2023-03-08T15:50:26.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.906+0000 7fc1a6ffd700 1 -- 172.21.15.123:0/2185251610 <== mgr.4098 v2:172.21.15.123:6832/142884 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271903 (secure 0 0 0) 0x7fc1b00739f0 con 0x7fc190069900 2023-03-08T15:50:26.910 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:26.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.909+0000 7fc1b4efa700 1 -- 172.21.15.123:0/2185251610 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc190069900 msgr2=0x7fc19006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.909+0000 7fc1b4efa700 1 --2- 172.21.15.123:0/2185251610 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc190069900 0x7fc19006bdb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc198009a00 tx=0x7fc198008040 comp rx=0 tx=0).stop 2023-03-08T15:50:26.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.909+0000 7fc1b4efa700 1 -- 172.21.15.123:0/2185251610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b0144bf0 msgr2=0x7fc1b013ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:26.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.909+0000 7fc1b4efa700 1 --2- 172.21.15.123:0/2185251610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b0144bf0 0x7fc1b013ae90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800cc50 tx=0x7fc1a800cf60 comp rx=0 tx=0).stop 2023-03-08T15:50:26.912 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.910+0000 7fc1b4efa700 1 -- 172.21.15.123:0/2185251610 shutdown_connections 2023-03-08T15:50:26.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.910+0000 7fc1b4efa700 1 --2- 172.21.15.123:0/2185251610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1b0144bf0 0x7fc1b013ae90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.910+0000 7fc1b4efa700 1 --2- 172.21.15.123:0/2185251610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1b00bb350 0x7fc1b0147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.910+0000 7fc1b4efa700 1 --2- 172.21.15.123:0/2185251610 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc190069900 0x7fc19006bdb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.910+0000 7fc1b4efa700 1 --2- 172.21.15.123:0/2185251610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00be1f0 0x7fc1b013a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:26.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.910+0000 7fc1b4efa700 1 -- 172.21.15.123:0/2185251610 >> 172.21.15.123:0/2185251610 conn(0x7fc1b006a250 msgr2=0x7fc1b00bd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:26.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.910+0000 7fc1b4efa700 1 -- 172.21.15.123:0/2185251610 shutdown_connections 2023-03-08T15:50:26.913 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:26.910+0000 7fc1b4efa700 1 -- 172.21.15.123:0/2185251610 wait complete. 2023-03-08T15:50:26.914 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-03-08T15:50:26.923 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-03-08T15:50:25.982253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":67720,"kb_used_data":3784,"kb_used_omap":0,"kb_used_meta":63872,"kb_avail":754907000,"statfs":{"total":773094113280,"available":773024768000,"internally_reserved":0,"allocated":3874816,"data_stored":2222936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65404928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.799505"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:15.278796+0000","last_change":"2023-03-08T15:49:34.914364+0000","last_active":"2023-03-08T15:50:15.278796+0000","last_peered":"2023-03-08T15:50:15.278796+0000","last_clean":"2023-03-08T15:50:15.278796+0000","last_became_active":"2023-03-08T15:49:34.914037+0000","last_became_peered":"2023-03-08T15:49:34.914037+0000","last_unstale":"2023-03-08T15:50:15.278796+0000","last_undegraded":"2023-03-08T15:50:15.278796+0000","last_fullsized":"2023-03-08T15:50:15.278796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:55:29.151326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-08T15:50:15.253707+0000","last_change":"2023-03-08T15:49:34.036801+0000","last_active":"2023-03-08T15:50:15.253707+0000","last_peered":"2023-03-08T15:50:15.253707+0000","last_clean":"2023-03-08T15:50:15.253707+0000","last_became_active":"2023-03-08T15:49:34.036484+0000","last_became_peered":"2023-03-08T15:49:34.036484+0000","last_unstale":"2023-03-08T15:50:15.253707+0000","last_undegraded":"2023-03-08T15:50:15.253707+0000","last_fullsized":"2023-03-08T15:50:15.253707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:16.616688+0000","last_change":"2023-03-08T15:49:34.968598+0000","last_active":"2023-03-08T15:50:16.616688+0000","last_peered":"2023-03-08T15:50:16.616688+0000","last_clean":"2023-03-08T15:50:16.616688+0000","last_became_active":"2023-03-08T15:49:34.968300+0000","last_became_peered":"2023-03-08T15:49:34.968300+0000","last_unstale":"2023-03-08T15:50:16.616688+0000","last_undegraded":"2023-03-08T15:50:16.616688+0000","last_fullsized":"2023-03-08T15:50:16.616688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:39:14.985725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-08T15:50:15.253707+0000","last_change":"2023-03-08T15:49:34.042076+0000","last_active":"2023-03-08T15:50:15.253707+0000","last_peered":"2023-03-08T15:50:15.253707+0000","last_clean":"2023-03-08T15:50:15.253707+0000","last_became_active":"2023-03-08T15:49:34.041670+0000","last_became_peered":"2023-03-08T15:49:34.041670+0000","last_unstale":"2023-03-08T15:50:15.253707+0000","last_undegraded":"2023-03-08T15:50:15.253707+0000","last_fullsized":"2023-03-08T15:50:15.253707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:46:37.870016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:16.726854+0000","last_change":"2023-03-08T15:49:27.814075+0000","last_active":"2023-03-08T15:50:16.726854+0000","last_peered":"2023-03-08T15:50:16.726854+0000","last_clean":"2023-03-08T15:50:16.726854+0000","last_became_active":"2023-03-08T15:49:27.813798+0000","last_became_peered":"2023-03-08T15:49:27.813798+0000","last_unstale":"2023-03-08T15:50:16.726854+0000","last_undegraded":"2023-03-08T15:50:16.726854+0000","last_fullsized":"2023-03-08T15:50:16.726854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_clean_scrub_stamp":"2023-03-08T15:49:26.430262+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:31:30.865216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:16.726974+0000","last_change":"2023-03-08T15:49:34.042085+0000","last_active":"2023-03-08T15:50:16.726974+0000","last_peered":"2023-03-08T15:50:16.726974+0000","last_clean":"2023-03-08T15:50:16.726974+0000","last_became_active":"2023-03-08T15:49:34.041754+0000","last_became_peered":"2023-03-08T15:49:34.041754+0000","last_unstale":"2023-03-08T15:50:16.726974+0000","last_undegraded":"2023-03-08T15:50:16.726974+0000","last_fullsized":"2023-03-08T15:50:16.726974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:16.726904+0000","last_change":"2023-03-08T15:49:34.914757+0000","last_active":"2023-03-08T15:50:16.726904+0000","last_peered":"2023-03-08T15:50:16.726904+0000","last_clean":"2023-03-08T15:50:16.726904+0000","last_became_active":"2023-03-08T15:49:34.914391+0000","last_became_peered":"2023-03-08T15:49:34.914391+0000","last_unstale":"2023-03-08T15:50:16.726904+0000","last_undegraded":"2023-03-08T15:50:16.726904+0000","last_fullsized":"2023-03-08T15:50:16.726904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:09:02.620210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:15.278822+0000","last_change":"2023-03-08T15:49:34.039636+0000","last_active":"2023-03-08T15:50:15.278822+0000","last_peered":"2023-03-08T15:50:15.278822+0000","last_clean":"2023-03-08T15:50:15.278822+0000","last_became_active":"2023-03-08T15:49:34.039383+0000","last_became_peered":"2023-03-08T15:49:34.039383+0000","last_unstale":"2023-03-08T15:50:15.278822+0000","last_undegraded":"2023-03-08T15:50:15.278822+0000","last_fullsized":"2023-03-08T15:50:15.278822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:27:38.358539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:16.726403+0000","last_change":"2023-03-08T15:49:34.040711+0000","last_active":"2023-03-08T15:50:16.726403+0000","last_peered":"2023-03-08T15:50:16.726403+0000","last_clean":"2023-03-08T15:50:16.726403+0000","last_became_active":"2023-03-08T15:49:34.040328+0000","last_became_peered":"2023-03-08T15:49:34.040328+0000","last_unstale":"2023-03-08T15:50:16.726403+0000","last_undegraded":"2023-03-08T15:50:16.726403+0000","last_fullsized":"2023-03-08T15:50:16.726403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:34:43.169713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9300,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362540,"statfs":{"total":96636764160,"available":96627240960,"internally_reserved":0,"allocated":929792,"data_stored":720643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8144,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363696,"statfs":{"total":96636764160,"available":96628424704,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8208,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363632,"statfs":{"total":96636764160,"available":96628359168,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9300,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362540,"statfs":{"total":96636764160,"available":96627240960,"internally_reserved":0,"allocated":929792,"data_stored":720643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8080,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363760,"statfs":{"total":96636764160,"available":96628490240,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8272,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363568,"statfs":{"total":96636764160,"available":96628293632,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":8272,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363568,"statfs":{"total":96636764160,"available":96628293632,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8144,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363696,"statfs":{"total":96636764160,"available":96628424704,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-08T15:50:26.929 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-08T15:50:27.083 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.082+0000 7fda2a42e700 1 Processor -- start 2023-03-08T15:50:27.084 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.082+0000 7fda2a42e700 1 -- start start 2023-03-08T15:50:27.086 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.082+0000 7fda2a42e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fda240b7900 0x7fda24140990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda2a42e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda240b59c0 con 0x7fda241476e0 2023-03-08T15:50:27.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda2a42e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda240b8b10 con 0x7fda2406aee0 2023-03-08T15:50:27.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda2a42e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda240b56e0 con 0x7fda240b7900 2023-03-08T15:50:27.087 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda289cb700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fda241476e0 0x7fda24151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56520/0 (socket says 172.21.15.123:56520) 2023-03-08T15:50:27.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda289cb700 1 -- 172.21.15.123:0/2567704178 learned_addr learned my addr 172.21.15.123:0/2567704178 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:27.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda23fff700 1 --2- 172.21.15.123:0/2567704178 >> v2:172.21.15.175:3300/0 conn(0x7fda240b7900 0x7fda24140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda22ffd700 1 -- 172.21.15.123:0/2567704178 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981643299 0 0) 0x7fda240b59c0 con 0x7fda241476e0 2023-03-08T15:50:27.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda22ffd700 1 -- 172.21.15.123:0/2567704178 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda0c0035b0 con 0x7fda241476e0 2023-03-08T15:50:27.088 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda22ffd700 1 -- 172.21.15.123:0/2567704178 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1415217141 0 0) 0x7fda0c0035b0 con 0x7fda241476e0 2023-03-08T15:50:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda22ffd700 1 -- 172.21.15.123:0/2567704178 >> v2:172.21.15.175:3300/0 conn(0x7fda240b7900 msgr2=0x7fda24140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda22ffd700 1 --2- 172.21.15.123:0/2567704178 >> v2:172.21.15.175:3300/0 conn(0x7fda240b7900 0x7fda24140990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda22ffd700 1 -- 172.21.15.123:0/2567704178 >> v1:172.21.15.175:6789/0 conn(0x7fda2406aee0 legacy=0x7fda24146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda22ffd700 1 -- 172.21.15.123:0/2567704178 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda240b7cd0 con 0x7fda241476e0 2023-03-08T15:50:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda22ffd700 1 -- 172.21.15.123:0/2567704178 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7fda1c0019f0 con 0x7fda241476e0 2023-03-08T15:50:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda22ffd700 1 -- 172.21.15.123:0/2567704178 >> v1:172.21.15.123:6789/0 conn(0x7fda241476e0 legacy=0x7fda24151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda22ffd700 1 --2- 172.21.15.123:0/2567704178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda0c003a00 0x7fda0c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda22ffd700 1 --2- 172.21.15.123:0/2567704178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda0c004850 0x7fda0c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda22ffd700 1 --2- 172.21.15.123:0/2567704178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda0c005200 0x7fda0c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda22ffd700 1 -- 172.21.15.123:0/2567704178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda240b56e0 con 0x7fda0c005200 2023-03-08T15:50:27.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda22ffd700 1 -- 172.21.15.123:0/2567704178 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c00c110 con 0x7fda0c004850 2023-03-08T15:50:27.090 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda22ffd700 1 -- 172.21.15.123:0/2567704178 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c00c2d0 con 0x7fda0c003a00 2023-03-08T15:50:27.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda289cb700 1 --2- 172.21.15.123:0/2567704178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda0c005200 0x7fda0c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda237fe700 1 --2- 172.21.15.123:0/2567704178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda0c004850 0x7fda0c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda23fff700 1 --2- 172.21.15.123:0/2567704178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda0c003a00 0x7fda0c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.083+0000 7fda289cb700 1 -- 172.21.15.123:0/2567704178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda0c003a00 msgr2=0x7fda0c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:27.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.084+0000 7fda289cb700 1 --2- 172.21.15.123:0/2567704178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda0c003a00 0x7fda0c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.091 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.084+0000 7fda289cb700 1 -- 172.21.15.123:0/2567704178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda0c004850 msgr2=0x7fda0c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:27.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.084+0000 7fda289cb700 1 --2- 172.21.15.123:0/2567704178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda0c004850 0x7fda0c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.084+0000 7fda289cb700 1 -- 172.21.15.123:0/2567704178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0035b0 con 0x7fda0c005200 2023-03-08T15:50:27.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.084+0000 7fda23fff700 1 --2- 172.21.15.123:0/2567704178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda0c003a00 0x7fda0c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:27.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.084+0000 7fda289cb700 1 -- 172.21.15.123:0/2567704178 reap_dead start 2023-03-08T15:50:27.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.084+0000 7fda289cb700 1 --2- 172.21.15.123:0/2567704178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda0c005200 0x7fda0c00ba10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00a410 tx=0x7fda0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af383de3edf050d4 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:27.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.084+0000 7fda22ffd700 1 -- 172.21.15.123:0/2567704178 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c010690 con 0x7fda0c005200 2023-03-08T15:50:27.092 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.084+0000 7fda22ffd700 1 -- 172.21.15.123:0/2567704178 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c010810 con 0x7fda0c005200 2023-03-08T15:50:27.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.084+0000 7fda22ffd700 1 -- 172.21.15.123:0/2567704178 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c010bc0 con 0x7fda0c005200 2023-03-08T15:50:27.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.084+0000 7fda2a42e700 1 -- 172.21.15.123:0/2567704178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda0c005200 msgr2=0x7fda0c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.084+0000 7fda2a42e700 1 --2- 172.21.15.123:0/2567704178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda0c005200 0x7fda0c00ba10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00a410 tx=0x7fda0c005880 comp rx=0 tx=0).stop 2023-03-08T15:50:27.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.084+0000 7fda2a42e700 1 -- 172.21.15.123:0/2567704178 shutdown_connections 2023-03-08T15:50:27.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.084+0000 7fda2a42e700 1 --2- 172.21.15.123:0/2567704178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda0c005200 0x7fda0c00ba10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.093 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.084+0000 7fda2a42e700 1 -- 172.21.15.123:0/2567704178 >> 172.21.15.123:0/2567704178 conn(0x7fda240bc480 msgr2=0x7fda240bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:27.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.085+0000 7fda2a42e700 1 -- 172.21.15.123:0/2567704178 shutdown_connections 2023-03-08T15:50:27.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.085+0000 7fda2a42e700 1 -- 172.21.15.123:0/2567704178 wait complete. 2023-03-08T15:50:27.094 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.086+0000 7fda2a42e700 1 Processor -- start 2023-03-08T15:50:27.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.086+0000 7fda2a42e700 1 -- start start 2023-03-08T15:50:27.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.086+0000 7fda2a42e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda0c005200 0x7fda241e0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.086+0000 7fda2a42e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda24143a80 0x7fda241d41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.096 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.086+0000 7fda2a42e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda240706e0 0x7fda2413b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.086+0000 7fda2a42e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda241d4710 con 0x7fda0c005200 2023-03-08T15:50:27.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.086+0000 7fda2a42e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda241434c0 con 0x7fda24143a80 2023-03-08T15:50:27.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.086+0000 7fda2a42e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda240711d0 con 0x7fda240706e0 2023-03-08T15:50:27.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.086+0000 7fda23fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda0c005200 0x7fda241e0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.086+0000 7fda23fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda0c005200 0x7fda241e0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35498/0 (socket says 172.21.15.123:35498) 2023-03-08T15:50:27.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.086+0000 7fda23fff700 1 -- 172.21.15.123:0/2594186680 learned_addr learned my addr 172.21.15.123:0/2594186680 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:27.097 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.087+0000 7fda237fe700 1 --2- 172.21.15.123:0/2594186680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda24143a80 0x7fda241d41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.087+0000 7fda289cb700 1 --2- 172.21.15.123:0/2594186680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda240706e0 0x7fda2413b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.087+0000 7fda23fff700 1 -- 172.21.15.123:0/2594186680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda240706e0 msgr2=0x7fda2413b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.087+0000 7fda23fff700 1 --2- 172.21.15.123:0/2594186680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda240706e0 0x7fda2413b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.087+0000 7fda23fff700 1 -- 172.21.15.123:0/2594186680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda24143a80 msgr2=0x7fda241d41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.087+0000 7fda23fff700 1 --2- 172.21.15.123:0/2594186680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda24143a80 0x7fda241d41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.087+0000 7fda23fff700 1 -- 172.21.15.123:0/2594186680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda240bd360 con 0x7fda0c005200 2023-03-08T15:50:27.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.087+0000 7fda237fe700 1 --2- 172.21.15.123:0/2594186680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda24143a80 0x7fda241d41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:27.098 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.087+0000 7fda23fff700 1 --2- 172.21.15.123:0/2594186680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda0c005200 0x7fda241e0020 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fda18010850 tx=0x7fda18010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:27.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.087+0000 7fda20ff9700 1 -- 172.21.15.123:0/2594186680 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18010e50 con 0x7fda0c005200 2023-03-08T15:50:27.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.087+0000 7fda20ff9700 1 -- 172.21.15.123:0/2594186680 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18004020 con 0x7fda0c005200 2023-03-08T15:50:27.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.087+0000 7fda2a42e700 1 -- 172.21.15.123:0/2594186680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda240bd1d0 con 0x7fda0c005200 2023-03-08T15:50:27.099 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.087+0000 7fda20ff9700 1 -- 172.21.15.123:0/2594186680 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda180043b0 con 0x7fda0c005200 2023-03-08T15:50:27.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.087+0000 7fda2a42e700 1 -- 172.21.15.123:0/2594186680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda240b8320 con 0x7fda0c005200 2023-03-08T15:50:27.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.088+0000 7fda2a42e700 1 -- 172.21.15.123:0/2594186680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda240b61f0 con 0x7fda0c005200 2023-03-08T15:50:27.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.088+0000 7fda20ff9700 1 -- 172.21.15.123:0/2594186680 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fda18025070 con 0x7fda0c005200 2023-03-08T15:50:27.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.089+0000 7fda20ff9700 1 --2- 172.21.15.123:0/2594186680 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fda100698d0 0x7fda1006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.089+0000 7fda20ff9700 1 -- 172.21.15.123:0/2594186680 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda18087830 con 0x7fda0c005200 2023-03-08T15:50:27.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.089+0000 7fda237fe700 1 --2- 172.21.15.123:0/2594186680 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fda100698d0 0x7fda1006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.089+0000 7fda237fe700 1 --2- 172.21.15.123:0/2594186680 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fda100698d0 0x7fda1006bd80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fda24140e20 tx=0x7fda14009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:27.101 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.093+0000 7fda20ff9700 1 -- 172.21.15.123:0/2594186680 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fda18053600 con 0x7fda0c005200 2023-03-08T15:50:27.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.275+0000 7fda2a42e700 1 -- 172.21.15.123:0/2594186680 --> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda240744c0 con 0x7fda100698d0 2023-03-08T15:50:27.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.282+0000 7fda20ff9700 1 -- 172.21.15.123:0/2594186680 <== mgr.4098 v2:172.21.15.123:6832/142884 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271903 (secure 0 0 0) 0x7fda240744c0 con 0x7fda100698d0 2023-03-08T15:50:27.286 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.285+0000 7fda2a42e700 1 -- 172.21.15.123:0/2594186680 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fda100698d0 msgr2=0x7fda1006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.285+0000 7fda2a42e700 1 --2- 172.21.15.123:0/2594186680 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fda100698d0 0x7fda1006bd80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fda24140e20 tx=0x7fda14009040 comp rx=0 tx=0).stop 2023-03-08T15:50:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.285+0000 7fda2a42e700 1 -- 172.21.15.123:0/2594186680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda0c005200 msgr2=0x7fda241e0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.285+0000 7fda2a42e700 1 --2- 172.21.15.123:0/2594186680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda0c005200 0x7fda241e0020 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fda18010850 tx=0x7fda18010c10 comp rx=0 tx=0).stop 2023-03-08T15:50:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.285+0000 7fda2a42e700 1 -- 172.21.15.123:0/2594186680 shutdown_connections 2023-03-08T15:50:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.285+0000 7fda2a42e700 1 --2- 172.21.15.123:0/2594186680 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fda100698d0 0x7fda1006bd80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.285+0000 7fda2a42e700 1 --2- 172.21.15.123:0/2594186680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda240706e0 0x7fda2413b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.285+0000 7fda2a42e700 1 --2- 172.21.15.123:0/2594186680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda0c005200 0x7fda241e0020 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.285+0000 7fda2a42e700 1 --2- 172.21.15.123:0/2594186680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda24143a80 0x7fda241d41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.285+0000 7fda2a42e700 1 -- 172.21.15.123:0/2594186680 >> 172.21.15.123:0/2594186680 conn(0x7fda240bc480 msgr2=0x7fda2413dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.286+0000 7fda2a42e700 1 -- 172.21.15.123:0/2594186680 shutdown_connections 2023-03-08T15:50:27.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.286+0000 7fda2a42e700 1 -- 172.21.15.123:0/2594186680 wait complete. 2023-03-08T15:50:27.290 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-03-08T15:50:27.299 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-03-08T15:50:25.982253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":67720,"kb_used_data":3784,"kb_used_omap":0,"kb_used_meta":63872,"kb_avail":754907000,"statfs":{"total":773094113280,"available":773024768000,"internally_reserved":0,"allocated":3874816,"data_stored":2222936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65404928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.799505"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:15.278796+0000","last_change":"2023-03-08T15:49:34.914364+0000","last_active":"2023-03-08T15:50:15.278796+0000","last_peered":"2023-03-08T15:50:15.278796+0000","last_clean":"2023-03-08T15:50:15.278796+0000","last_became_active":"2023-03-08T15:49:34.914037+0000","last_became_peered":"2023-03-08T15:49:34.914037+0000","last_unstale":"2023-03-08T15:50:15.278796+0000","last_undegraded":"2023-03-08T15:50:15.278796+0000","last_fullsized":"2023-03-08T15:50:15.278796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:55:29.151326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-08T15:50:15.253707+0000","last_change":"2023-03-08T15:49:34.036801+0000","last_active":"2023-03-08T15:50:15.253707+0000","last_peered":"2023-03-08T15:50:15.253707+0000","last_clean":"2023-03-08T15:50:15.253707+0000","last_became_active":"2023-03-08T15:49:34.036484+0000","last_became_peered":"2023-03-08T15:49:34.036484+0000","last_unstale":"2023-03-08T15:50:15.253707+0000","last_undegraded":"2023-03-08T15:50:15.253707+0000","last_fullsized":"2023-03-08T15:50:15.253707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:16.616688+0000","last_change":"2023-03-08T15:49:34.968598+0000","last_active":"2023-03-08T15:50:16.616688+0000","last_peered":"2023-03-08T15:50:16.616688+0000","last_clean":"2023-03-08T15:50:16.616688+0000","last_became_active":"2023-03-08T15:49:34.968300+0000","last_became_peered":"2023-03-08T15:49:34.968300+0000","last_unstale":"2023-03-08T15:50:16.616688+0000","last_undegraded":"2023-03-08T15:50:16.616688+0000","last_fullsized":"2023-03-08T15:50:16.616688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:39:14.985725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-08T15:50:15.253707+0000","last_change":"2023-03-08T15:49:34.042076+0000","last_active":"2023-03-08T15:50:15.253707+0000","last_peered":"2023-03-08T15:50:15.253707+0000","last_clean":"2023-03-08T15:50:15.253707+0000","last_became_active":"2023-03-08T15:49:34.041670+0000","last_became_peered":"2023-03-08T15:49:34.041670+0000","last_unstale":"2023-03-08T15:50:15.253707+0000","last_undegraded":"2023-03-08T15:50:15.253707+0000","last_fullsized":"2023-03-08T15:50:15.253707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:46:37.870016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:16.726854+0000","last_change":"2023-03-08T15:49:27.814075+0000","last_active":"2023-03-08T15:50:16.726854+0000","last_peered":"2023-03-08T15:50:16.726854+0000","last_clean":"2023-03-08T15:50:16.726854+0000","last_became_active":"2023-03-08T15:49:27.813798+0000","last_became_peered":"2023-03-08T15:49:27.813798+0000","last_unstale":"2023-03-08T15:50:16.726854+0000","last_undegraded":"2023-03-08T15:50:16.726854+0000","last_fullsized":"2023-03-08T15:50:16.726854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_clean_scrub_stamp":"2023-03-08T15:49:26.430262+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:31:30.865216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:16.726974+0000","last_change":"2023-03-08T15:49:34.042085+0000","last_active":"2023-03-08T15:50:16.726974+0000","last_peered":"2023-03-08T15:50:16.726974+0000","last_clean":"2023-03-08T15:50:16.726974+0000","last_became_active":"2023-03-08T15:49:34.041754+0000","last_became_peered":"2023-03-08T15:49:34.041754+0000","last_unstale":"2023-03-08T15:50:16.726974+0000","last_undegraded":"2023-03-08T15:50:16.726974+0000","last_fullsized":"2023-03-08T15:50:16.726974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:16.726904+0000","last_change":"2023-03-08T15:49:34.914757+0000","last_active":"2023-03-08T15:50:16.726904+0000","last_peered":"2023-03-08T15:50:16.726904+0000","last_clean":"2023-03-08T15:50:16.726904+0000","last_became_active":"2023-03-08T15:49:34.914391+0000","last_became_peered":"2023-03-08T15:49:34.914391+0000","last_unstale":"2023-03-08T15:50:16.726904+0000","last_undegraded":"2023-03-08T15:50:16.726904+0000","last_fullsized":"2023-03-08T15:50:16.726904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:09:02.620210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:15.278822+0000","last_change":"2023-03-08T15:49:34.039636+0000","last_active":"2023-03-08T15:50:15.278822+0000","last_peered":"2023-03-08T15:50:15.278822+0000","last_clean":"2023-03-08T15:50:15.278822+0000","last_became_active":"2023-03-08T15:49:34.039383+0000","last_became_peered":"2023-03-08T15:49:34.039383+0000","last_unstale":"2023-03-08T15:50:15.278822+0000","last_undegraded":"2023-03-08T15:50:15.278822+0000","last_fullsized":"2023-03-08T15:50:15.278822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:27:38.358539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:16.726403+0000","last_change":"2023-03-08T15:49:34.040711+0000","last_active":"2023-03-08T15:50:16.726403+0000","last_peered":"2023-03-08T15:50:16.726403+0000","last_clean":"2023-03-08T15:50:16.726403+0000","last_became_active":"2023-03-08T15:49:34.040328+0000","last_became_peered":"2023-03-08T15:49:34.040328+0000","last_unstale":"2023-03-08T15:50:16.726403+0000","last_undegraded":"2023-03-08T15:50:16.726403+0000","last_fullsized":"2023-03-08T15:50:16.726403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:34:43.169713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9300,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362540,"statfs":{"total":96636764160,"available":96627240960,"internally_reserved":0,"allocated":929792,"data_stored":720643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8144,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363696,"statfs":{"total":96636764160,"available":96628424704,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8208,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363632,"statfs":{"total":96636764160,"available":96628359168,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9300,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362540,"statfs":{"total":96636764160,"available":96627240960,"internally_reserved":0,"allocated":929792,"data_stored":720643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8080,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363760,"statfs":{"total":96636764160,"available":96628490240,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8272,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363568,"statfs":{"total":96636764160,"available":96628293632,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":8272,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363568,"statfs":{"total":96636764160,"available":96628293632,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8144,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363696,"statfs":{"total":96636764160,"available":96628424704,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-08T15:50:27.305 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-08T15:50:27.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.457+0000 7f9cdd655700 1 Processor -- start 2023-03-08T15:50:27.459 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.457+0000 7f9cdd655700 1 -- start start 2023-03-08T15:50:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.458+0000 7f9cdd655700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9cd8140ef0 0x7f9cd80b6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.458+0000 7f9cdd655700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9cd80b5310 0x7f9cd8146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.458+0000 7f9cdd655700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd80b8470 con 0x7f9cd80b5790 2023-03-08T15:50:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.458+0000 7f9cdd655700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd81412c0 con 0x7f9cd80b5310 2023-03-08T15:50:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.458+0000 7f9cdd655700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd80bd730 con 0x7f9cd8140ef0 2023-03-08T15:50:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.458+0000 7f9cd67fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9cd80b5310 0x7f9cd8146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.458+0000 7f9cd77fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9cd80b5790 0x7f9cd814a140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56528/0 (socket says 172.21.15.123:56528) 2023-03-08T15:50:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.458+0000 7f9cd67fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9cd80b5310 0x7f9cd8146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35512/0 (socket says 172.21.15.123:35512) 2023-03-08T15:50:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.458+0000 7f9cd77fe700 1 -- 172.21.15.123:0/1292457244 learned_addr learned my addr 172.21.15.123:0/1292457244 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.458+0000 7f9cd6ffd700 1 --2- 172.21.15.123:0/1292457244 >> v2:172.21.15.175:3300/0 conn(0x7f9cd8140ef0 0x7f9cd80b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.458+0000 7f9cd67fc700 1 -- 172.21.15.123:0/1292457244 >> v2:172.21.15.175:3300/0 conn(0x7f9cd8140ef0 msgr2=0x7f9cd80b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.458+0000 7f9cd67fc700 1 --2- 172.21.15.123:0/1292457244 >> v2:172.21.15.175:3300/0 conn(0x7f9cd8140ef0 0x7f9cd80b6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.458+0000 7f9cd67fc700 1 -- 172.21.15.123:0/1292457244 >> v1:172.21.15.123:6789/0 conn(0x7f9cd80b5790 legacy=0x7f9cd814a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.458+0000 7f9cd67fc700 1 -- 172.21.15.123:0/1292457244 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd80b7e20 con 0x7f9cd80b5310 2023-03-08T15:50:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.458+0000 7f9cd5ffb700 1 -- 172.21.15.123:0/1292457244 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262471824 0 0) 0x7f9cd80b8470 con 0x7f9cd80b5790 2023-03-08T15:50:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.459+0000 7f9cd67fc700 1 --2- 172.21.15.123:0/1292457244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd80b5310 0x7f9cd8146cc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9cd806e970 tx=0x7f9ccc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab5e9ee2f4dc937 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.459+0000 7f9cd5ffb700 1 -- 172.21.15.123:0/1292457244 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc011830 con 0x7f9cd80b5310 2023-03-08T15:50:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.459+0000 7f9cd5ffb700 1 -- 172.21.15.123:0/1292457244 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ccc011990 con 0x7f9cd80b5310 2023-03-08T15:50:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.459+0000 7f9cd5ffb700 1 -- 172.21.15.123:0/1292457244 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc011d20 con 0x7f9cd80b5310 2023-03-08T15:50:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.459+0000 7f9cdd655700 1 -- 172.21.15.123:0/1292457244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd80b5310 msgr2=0x7f9cd8146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.459+0000 7f9cdd655700 1 --2- 172.21.15.123:0/1292457244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd80b5310 0x7f9cd8146cc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9cd806e970 tx=0x7f9ccc009b20 comp rx=0 tx=0).stop 2023-03-08T15:50:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.459+0000 7f9cdd655700 1 -- 172.21.15.123:0/1292457244 shutdown_connections 2023-03-08T15:50:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.459+0000 7f9cdd655700 1 --2- 172.21.15.123:0/1292457244 >> v2:172.21.15.175:3300/0 conn(0x7f9cd8140ef0 0x7f9cd80b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.459+0000 7f9cdd655700 1 --2- 172.21.15.123:0/1292457244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd80b5310 0x7f9cd8146cc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.459+0000 7f9cdd655700 1 -- 172.21.15.123:0/1292457244 >> 172.21.15.123:0/1292457244 conn(0x7f9cd80bc930 msgr2=0x7f9cd80bcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.459+0000 7f9cdd655700 1 -- 172.21.15.123:0/1292457244 shutdown_connections 2023-03-08T15:50:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.459+0000 7f9cdd655700 1 -- 172.21.15.123:0/1292457244 wait complete. 2023-03-08T15:50:27.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.461+0000 7f9cdd655700 1 Processor -- start 2023-03-08T15:50:27.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.461+0000 7f9cdd655700 1 -- start start 2023-03-08T15:50:27.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cdd655700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd80b5310 0x7f9cd8135420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cdd655700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cd80b5790 0x7f9cd806f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cdd655700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd8140ef0 0x7f9cd806f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.467 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cdd655700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd8135960 con 0x7f9cd8140ef0 2023-03-08T15:50:27.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cdd655700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd8141650 con 0x7f9cd80b5310 2023-03-08T15:50:27.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cdd655700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd8142cf0 con 0x7f9cd80b5790 2023-03-08T15:50:27.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd8140ef0 0x7f9cd806f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cd77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd8140ef0 0x7f9cd806f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35516/0 (socket says 172.21.15.123:35516) 2023-03-08T15:50:27.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cd77fe700 1 -- 172.21.15.123:0/3693395833 learned_addr learned my addr 172.21.15.123:0/3693395833 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:27.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cd6ffd700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd80b5310 0x7f9cd8135420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cd77fe700 1 -- 172.21.15.123:0/3693395833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cd80b5790 msgr2=0x7f9cd806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.468 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cd67fc700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cd80b5790 0x7f9cd806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cd77fe700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cd80b5790 0x7f9cd806f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cd77fe700 1 -- 172.21.15.123:0/3693395833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd80b5310 msgr2=0x7f9cd8135420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cd77fe700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd80b5310 0x7f9cd8135420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cd77fe700 1 -- 172.21.15.123:0/3693395833 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ccc0094a0 con 0x7f9cd8140ef0 2023-03-08T15:50:27.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cd6ffd700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd80b5310 0x7f9cd8135420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:27.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cd67fc700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cd80b5790 0x7f9cd806f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:27.469 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cd77fe700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd8140ef0 0x7f9cd806f6c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000cc70 tx=0x7f9cd000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:27.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cbf7fe700 1 -- 172.21.15.123:0/3693395833 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd000ad80 con 0x7f9cd8140ef0 2023-03-08T15:50:27.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cbf7fe700 1 -- 172.21.15.123:0/3693395833 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd000ce70 con 0x7f9cd8140ef0 2023-03-08T15:50:27.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cdd655700 1 -- 172.21.15.123:0/3693395833 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd80b3910 con 0x7f9cd8140ef0 2023-03-08T15:50:27.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cbf7fe700 1 -- 172.21.15.123:0/3693395833 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00072f0 con 0x7f9cd8140ef0 2023-03-08T15:50:27.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.462+0000 7f9cdd655700 1 -- 172.21.15.123:0/3693395833 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd80b8100 con 0x7f9cd8140ef0 2023-03-08T15:50:27.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.463+0000 7f9cdd655700 1 -- 172.21.15.123:0/3693395833 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd81434c0 con 0x7f9cd8140ef0 2023-03-08T15:50:27.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.464+0000 7f9cbf7fe700 1 -- 172.21.15.123:0/3693395833 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f9cd0010070 con 0x7f9cd8140ef0 2023-03-08T15:50:27.470 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.464+0000 7f9cbf7fe700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f9cc40698d0 0x7f9cc406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.464+0000 7f9cbf7fe700 1 -- 172.21.15.123:0/3693395833 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9cd00871b0 con 0x7f9cd8140ef0 2023-03-08T15:50:27.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.464+0000 7f9cd6ffd700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f9cc40698d0 0x7f9cc406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.465+0000 7f9cd6ffd700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f9cc40698d0 0x7f9cc406bd80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009a00 tx=0x7f9cc8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:27.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.468+0000 7f9cbf7fe700 1 -- 172.21.15.123:0/3693395833 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f9cd0052e10 con 0x7f9cd8140ef0 2023-03-08T15:50:27.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.649+0000 7f9cdd655700 1 -- 172.21.15.123:0/3693395833 --> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9cd81414b0 con 0x7f9cc40698d0 2023-03-08T15:50:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.656+0000 7f9cbf7fe700 1 -- 172.21.15.123:0/3693395833 <== mgr.4098 v2:172.21.15.123:6832/142884 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271903 (secure 0 0 0) 0x7f9cd81414b0 con 0x7f9cc40698d0 2023-03-08T15:50:27.660 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:27.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.659+0000 7f9cdd655700 1 -- 172.21.15.123:0/3693395833 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f9cc40698d0 msgr2=0x7f9cc406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.659+0000 7f9cdd655700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f9cc40698d0 0x7f9cc406bd80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009a00 tx=0x7f9cc8008040 comp rx=0 tx=0).stop 2023-03-08T15:50:27.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.659+0000 7f9cdd655700 1 -- 172.21.15.123:0/3693395833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd8140ef0 msgr2=0x7f9cd806f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.659+0000 7f9cdd655700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd8140ef0 0x7f9cd806f6c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000cc70 tx=0x7f9cd000a340 comp rx=0 tx=0).stop 2023-03-08T15:50:27.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.659+0000 7f9cdd655700 1 -- 172.21.15.123:0/3693395833 shutdown_connections 2023-03-08T15:50:27.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.659+0000 7f9cdd655700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9cd8140ef0 0x7f9cd806f6c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.659+0000 7f9cdd655700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd80b5310 0x7f9cd8135420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.659+0000 7f9cdd655700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f9cc40698d0 0x7f9cc406bd80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.659+0000 7f9cdd655700 1 --2- 172.21.15.123:0/3693395833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cd80b5790 0x7f9cd806f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.659+0000 7f9cdd655700 1 -- 172.21.15.123:0/3693395833 >> 172.21.15.123:0/3693395833 conn(0x7f9cd80bc930 msgr2=0x7f9cd80b71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.659+0000 7f9cdd655700 1 -- 172.21.15.123:0/3693395833 shutdown_connections 2023-03-08T15:50:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.659+0000 7f9cdd655700 1 -- 172.21.15.123:0/3693395833 wait complete. 2023-03-08T15:50:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-03-08T15:50:27.672 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-03-08T15:50:25.982253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":67720,"kb_used_data":3784,"kb_used_omap":0,"kb_used_meta":63872,"kb_avail":754907000,"statfs":{"total":773094113280,"available":773024768000,"internally_reserved":0,"allocated":3874816,"data_stored":2222936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65404928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.799505"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:15.278796+0000","last_change":"2023-03-08T15:49:34.914364+0000","last_active":"2023-03-08T15:50:15.278796+0000","last_peered":"2023-03-08T15:50:15.278796+0000","last_clean":"2023-03-08T15:50:15.278796+0000","last_became_active":"2023-03-08T15:49:34.914037+0000","last_became_peered":"2023-03-08T15:49:34.914037+0000","last_unstale":"2023-03-08T15:50:15.278796+0000","last_undegraded":"2023-03-08T15:50:15.278796+0000","last_fullsized":"2023-03-08T15:50:15.278796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:55:29.151326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-08T15:50:15.253707+0000","last_change":"2023-03-08T15:49:34.036801+0000","last_active":"2023-03-08T15:50:15.253707+0000","last_peered":"2023-03-08T15:50:15.253707+0000","last_clean":"2023-03-08T15:50:15.253707+0000","last_became_active":"2023-03-08T15:49:34.036484+0000","last_became_peered":"2023-03-08T15:49:34.036484+0000","last_unstale":"2023-03-08T15:50:15.253707+0000","last_undegraded":"2023-03-08T15:50:15.253707+0000","last_fullsized":"2023-03-08T15:50:15.253707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:16.616688+0000","last_change":"2023-03-08T15:49:34.968598+0000","last_active":"2023-03-08T15:50:16.616688+0000","last_peered":"2023-03-08T15:50:16.616688+0000","last_clean":"2023-03-08T15:50:16.616688+0000","last_became_active":"2023-03-08T15:49:34.968300+0000","last_became_peered":"2023-03-08T15:49:34.968300+0000","last_unstale":"2023-03-08T15:50:16.616688+0000","last_undegraded":"2023-03-08T15:50:16.616688+0000","last_fullsized":"2023-03-08T15:50:16.616688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:39:14.985725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-08T15:50:15.253707+0000","last_change":"2023-03-08T15:49:34.042076+0000","last_active":"2023-03-08T15:50:15.253707+0000","last_peered":"2023-03-08T15:50:15.253707+0000","last_clean":"2023-03-08T15:50:15.253707+0000","last_became_active":"2023-03-08T15:49:34.041670+0000","last_became_peered":"2023-03-08T15:49:34.041670+0000","last_unstale":"2023-03-08T15:50:15.253707+0000","last_undegraded":"2023-03-08T15:50:15.253707+0000","last_fullsized":"2023-03-08T15:50:15.253707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:46:37.870016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:16.726854+0000","last_change":"2023-03-08T15:49:27.814075+0000","last_active":"2023-03-08T15:50:16.726854+0000","last_peered":"2023-03-08T15:50:16.726854+0000","last_clean":"2023-03-08T15:50:16.726854+0000","last_became_active":"2023-03-08T15:49:27.813798+0000","last_became_peered":"2023-03-08T15:49:27.813798+0000","last_unstale":"2023-03-08T15:50:16.726854+0000","last_undegraded":"2023-03-08T15:50:16.726854+0000","last_fullsized":"2023-03-08T15:50:16.726854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_clean_scrub_stamp":"2023-03-08T15:49:26.430262+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:31:30.865216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:16.726974+0000","last_change":"2023-03-08T15:49:34.042085+0000","last_active":"2023-03-08T15:50:16.726974+0000","last_peered":"2023-03-08T15:50:16.726974+0000","last_clean":"2023-03-08T15:50:16.726974+0000","last_became_active":"2023-03-08T15:49:34.041754+0000","last_became_peered":"2023-03-08T15:49:34.041754+0000","last_unstale":"2023-03-08T15:50:16.726974+0000","last_undegraded":"2023-03-08T15:50:16.726974+0000","last_fullsized":"2023-03-08T15:50:16.726974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:16.726904+0000","last_change":"2023-03-08T15:49:34.914757+0000","last_active":"2023-03-08T15:50:16.726904+0000","last_peered":"2023-03-08T15:50:16.726904+0000","last_clean":"2023-03-08T15:50:16.726904+0000","last_became_active":"2023-03-08T15:49:34.914391+0000","last_became_peered":"2023-03-08T15:49:34.914391+0000","last_unstale":"2023-03-08T15:50:16.726904+0000","last_undegraded":"2023-03-08T15:50:16.726904+0000","last_fullsized":"2023-03-08T15:50:16.726904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:09:02.620210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:15.278822+0000","last_change":"2023-03-08T15:49:34.039636+0000","last_active":"2023-03-08T15:50:15.278822+0000","last_peered":"2023-03-08T15:50:15.278822+0000","last_clean":"2023-03-08T15:50:15.278822+0000","last_became_active":"2023-03-08T15:49:34.039383+0000","last_became_peered":"2023-03-08T15:49:34.039383+0000","last_unstale":"2023-03-08T15:50:15.278822+0000","last_undegraded":"2023-03-08T15:50:15.278822+0000","last_fullsized":"2023-03-08T15:50:15.278822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:27:38.358539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:22.182815+0000","last_change":"2023-03-08T15:50:22.182815+0000","last_active":"2023-03-08T15:50:22.182815+0000","last_peered":"2023-03-08T15:50:22.182815+0000","last_clean":"2023-03-08T15:50:22.182815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:22.182815+0000","last_undegraded":"2023-03-08T15:50:22.182815+0000","last_fullsized":"2023-03-08T15:50:22.182815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-08T15:50:21.181070+0000","last_change":"2023-03-08T15:50:21.181070+0000","last_active":"2023-03-08T15:50:21.181070+0000","last_peered":"2023-03-08T15:50:21.181070+0000","last_clean":"2023-03-08T15:50:21.181070+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-08T15:50:21.181070+0000","last_undegraded":"2023-03-08T15:50:21.181070+0000","last_fullsized":"2023-03-08T15:50:21.181070+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-03-08T15:50:16.726403+0000","last_change":"2023-03-08T15:49:34.040711+0000","last_active":"2023-03-08T15:50:16.726403+0000","last_peered":"2023-03-08T15:50:16.726403+0000","last_clean":"2023-03-08T15:50:16.726403+0000","last_became_active":"2023-03-08T15:49:34.040328+0000","last_became_peered":"2023-03-08T15:49:34.040328+0000","last_unstale":"2023-03-08T15:50:16.726403+0000","last_undegraded":"2023-03-08T15:50:16.726403+0000","last_fullsized":"2023-03-08T15:50:16.726403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:34:43.169713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9300,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362540,"statfs":{"total":96636764160,"available":96627240960,"internally_reserved":0,"allocated":929792,"data_stored":720643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8144,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363696,"statfs":{"total":96636764160,"available":96628424704,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8208,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363632,"statfs":{"total":96636764160,"available":96628359168,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9300,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362540,"statfs":{"total":96636764160,"available":96627240960,"internally_reserved":0,"allocated":929792,"data_stored":720643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8080,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363760,"statfs":{"total":96636764160,"available":96628490240,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8272,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363568,"statfs":{"total":96636764160,"available":96628293632,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":8272,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363568,"statfs":{"total":96636764160,"available":96628293632,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8144,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363696,"statfs":{"total":96636764160,"available":96628424704,"internally_reserved":0,"allocated":335872,"data_stored":130275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-08T15:50:27.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-03-08T15:50:27.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-03-08T15:50:27.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-03-08T15:50:27.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-03-08T15:50:27.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-03-08T15:50:27.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-03-08T15:50:27.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-03-08T15:50:27.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-03-08T15:50:27.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-03-08T15:50:27.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-03-08T15:50:27.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-03-08T15:50:27.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-03-08T15:50:27.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-03-08T15:50:27.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-03-08T15:50:27.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-03-08T15:50:27.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-03-08T15:50:27.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-03-08T15:50:27.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-03-08T15:50:27.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-03-08T15:50:27.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-03-08T15:50:27.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-03-08T15:50:27.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-03-08T15:50:27.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-03-08T15:50:27.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-03-08T15:50:27.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-03-08T15:50:27.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-03-08T15:50:27.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-03-08T15:50:27.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-03-08T15:50:27.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-03-08T15:50:27.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-03-08T15:50:27.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-03-08T15:50:27.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-03-08T15:50:27.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-03-08T15:50:27.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-03-08T15:50:27.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-03-08T15:50:27.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-03-08T15:50:27.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-03-08T15:50:27.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-03-08T15:50:27.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-03-08T15:50:27.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-03-08T15:50:27.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-03-08T15:50:27.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-03-08T15:50:27.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-03-08T15:50:27.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-03-08T15:50:27.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-03-08T15:50:27.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-03-08T15:50:27.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-03-08T15:50:27.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-03-08T15:50:27.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-03-08T15:50:27.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-03-08T15:50:27.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-03-08T15:50:27.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-03-08T15:50:27.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-03-08T15:50:27.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-03-08T15:50:27.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-03-08T15:50:27.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-03-08T15:50:27.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-03-08T15:50:27.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-03-08T15:50:27.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-03-08T15:50:27.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-03-08T15:50:27.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-03-08T15:50:27.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-03-08T15:50:27.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-03-08T15:50:27.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-03-08T15:50:27.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-03-08T15:50:27.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-03-08T15:50:27.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-03-08T15:50:27.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-03-08T15:50:27.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-03-08T15:50:27.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-03-08T15:50:27.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-03-08T15:50:27.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-03-08T15:50:27.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-03-08T15:50:27.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-03-08T15:50:27.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-03-08T15:50:27.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-03-08T15:50:27.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-03-08T15:50:27.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-03-08T15:50:27.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-03-08T15:50:27.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-03-08T15:50:27.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-03-08T15:50:27.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-03-08T15:50:27.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-03-08T15:50:27.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-03-08T15:50:27.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-03-08T15:50:27.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-03-08T15:50:27.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-03-08T15:50:27.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-03-08T15:50:27.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-03-08T15:50:27.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-03-08T15:50:27.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-03-08T15:50:27.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-03-08T15:50:27.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-03-08T15:50:27.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-03-08T15:50:27.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-03-08T15:50:27.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:22.182815+0000', 'last_change': '2023-03-08T15:50:22.182815+0000', 'last_active': '2023-03-08T15:50:22.182815+0000', 'last_peered': '2023-03-08T15:50:22.182815+0000', 'last_clean': '2023-03-08T15:50:22.182815+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:22.182815+0000', 'last_undegraded': '2023-03-08T15:50:22.182815+0000', 'last_fullsized': '2023-03-08T15:50:22.182815+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:22.182815+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-03-08T15:50:27.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-03-08T15:50:21.181070+0000', 'last_change': '2023-03-08T15:50:21.181070+0000', 'last_active': '2023-03-08T15:50:21.181070+0000', 'last_peered': '2023-03-08T15:50:21.181070+0000', 'last_clean': '2023-03-08T15:50:21.181070+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-03-08T15:50:21.181070+0000', 'last_undegraded': '2023-03-08T15:50:21.181070+0000', 'last_fullsized': '2023-03-08T15:50:21.181070+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'last_clean_scrub_stamp': '2023-03-08T15:50:21.181070+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-03-08T15:50:27.739 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-03-08T15:50:27.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.856+0000 7fa4f0ae4700 1 Processor -- start 2023-03-08T15:50:27.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.856+0000 7fa4f0ae4700 1 -- start start 2023-03-08T15:50:27.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.857+0000 7fa4f0ae4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa4ec06b530 0x7fa4ec0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.857+0000 7fa4f0ae4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4ec140980 0x7fa4ec140de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.857+0000 7fa4f0ae4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ec071280 con 0x7fa4ec06f8d0 2023-03-08T15:50:27.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.857+0000 7fa4f0ae4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ec071630 con 0x7fa4ec06b530 2023-03-08T15:50:27.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.857+0000 7fa4f0ae4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec14a720 con 0x7fa4ec140980 2023-03-08T15:50:27.860 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.857+0000 7fa4e9d9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa4ec06f8d0 0x7fa4ec14a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56540/0 (socket says 172.21.15.123:56540) 2023-03-08T15:50:27.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.857+0000 7fa4e9d9b700 1 -- 172.21.15.123:0/2932055560 learned_addr learned my addr 172.21.15.123:0/2932055560 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:27.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.858+0000 7fa4ea59c700 1 --2- 172.21.15.123:0/2932055560 >> v2:172.21.15.175:3300/0 conn(0x7fa4ec06b530 0x7fa4ec0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.858+0000 7fa4ead9d700 1 --2- 172.21.15.123:0/2932055560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4ec140980 0x7fa4ec140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.858+0000 7fa4e959a700 1 -- 172.21.15.123:0/2932055560 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166744749 0 0) 0x7fa4ec071280 con 0x7fa4ec06f8d0 2023-03-08T15:50:27.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.858+0000 7fa4e959a700 1 -- 172.21.15.123:0/2932055560 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4d40035b0 con 0x7fa4ec06f8d0 2023-03-08T15:50:27.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.858+0000 7fa4e959a700 1 -- 172.21.15.123:0/2932055560 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3139766743 0 0) 0x7fa4d40035b0 con 0x7fa4ec06f8d0 2023-03-08T15:50:27.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.858+0000 7fa4ea59c700 1 -- 172.21.15.123:0/2932055560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4ec140980 msgr2=0x7fa4ec140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:27.861 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.858+0000 7fa4ea59c700 1 --2- 172.21.15.123:0/2932055560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4ec140980 0x7fa4ec140de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.858+0000 7fa4ea59c700 1 -- 172.21.15.123:0/2932055560 >> v1:172.21.15.123:6789/0 conn(0x7fa4ec06f8d0 legacy=0x7fa4ec14a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.858+0000 7fa4ea59c700 1 -- 172.21.15.123:0/2932055560 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec072020 con 0x7fa4ec06b530 2023-03-08T15:50:27.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.858+0000 7fa4ea59c700 1 --2- 172.21.15.123:0/2932055560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4ec06b530 0x7fa4ec0b3ab0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009840 tx=0x7fa4e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2bdedcebb9a1d50 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:27.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.858+0000 7fa4e959a700 1 -- 172.21.15.123:0/2932055560 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc001670 con 0x7fa4ec06b530 2023-03-08T15:50:27.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.858+0000 7fa4e959a700 1 -- 172.21.15.123:0/2932055560 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e0004030 con 0x7fa4ec06b530 2023-03-08T15:50:27.862 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.858+0000 7fa4e959a700 1 -- 172.21.15.123:0/2932055560 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00043a0 con 0x7fa4ec06b530 2023-03-08T15:50:27.864 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.859+0000 7fa4f0ae4700 1 -- 172.21.15.123:0/2932055560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4ec06b530 msgr2=0x7fa4ec0b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.859+0000 7fa4f0ae4700 1 --2- 172.21.15.123:0/2932055560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4ec06b530 0x7fa4ec0b3ab0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009840 tx=0x7fa4e0009b50 comp rx=0 tx=0).stop 2023-03-08T15:50:27.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.859+0000 7fa4f0ae4700 1 -- 172.21.15.123:0/2932055560 shutdown_connections 2023-03-08T15:50:27.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.859+0000 7fa4f0ae4700 1 --2- 172.21.15.123:0/2932055560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4ec140980 0x7fa4ec140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.859+0000 7fa4f0ae4700 1 --2- 172.21.15.123:0/2932055560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4ec06b530 0x7fa4ec0b3ab0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.859+0000 7fa4f0ae4700 1 -- 172.21.15.123:0/2932055560 >> 172.21.15.123:0/2932055560 conn(0x7fa4ec0ba3c0 msgr2=0x7fa4ec0bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:27.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.859+0000 7fa4f0ae4700 1 -- 172.21.15.123:0/2932055560 shutdown_connections 2023-03-08T15:50:27.865 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.859+0000 7fa4f0ae4700 1 -- 172.21.15.123:0/2932055560 wait complete. 2023-03-08T15:50:27.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.860+0000 7fa4f0ae4700 1 Processor -- start 2023-03-08T15:50:27.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.860+0000 7fa4f0ae4700 1 -- start start 2023-03-08T15:50:27.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4f0ae4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4ec06b530 0x7fa4ec1361b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4f0ae4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ec06f8d0 0x7fa4ec0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4f0ae4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4ec140980 0x7fa4ec0b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4f0ae4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec1366f0 con 0x7fa4ec06f8d0 2023-03-08T15:50:27.866 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4f0ae4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec1dceb0 con 0x7fa4ec06b530 2023-03-08T15:50:27.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4f0ae4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec1dd190 con 0x7fa4ec140980 2023-03-08T15:50:27.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4e9d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ec06f8d0 0x7fa4ec0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4e9d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ec06f8d0 0x7fa4ec0b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35520/0 (socket says 172.21.15.123:35520) 2023-03-08T15:50:27.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4e9d9b700 1 -- 172.21.15.123:0/3904772359 learned_addr learned my addr 172.21.15.123:0/3904772359 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:27.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4ea59c700 1 --2- 172.21.15.123:0/3904772359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4ec06b530 0x7fa4ec1361b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4ead9d700 1 --2- 172.21.15.123:0/3904772359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4ec140980 0x7fa4ec0b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.867 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4e9d9b700 1 -- 172.21.15.123:0/3904772359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4ec140980 msgr2=0x7fa4ec0b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4e9d9b700 1 --2- 172.21.15.123:0/3904772359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4ec140980 0x7fa4ec0b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4e9d9b700 1 -- 172.21.15.123:0/3904772359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4ec06b530 msgr2=0x7fa4ec1361b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4e9d9b700 1 --2- 172.21.15.123:0/3904772359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4ec06b530 0x7fa4ec1361b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4e9d9b700 1 -- 172.21.15.123:0/3904772359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e00094a0 con 0x7fa4ec06f8d0 2023-03-08T15:50:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4e9d9b700 1 --2- 172.21.15.123:0/3904772359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ec06f8d0 0x7fa4ec0b4db0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00e910 tx=0x7fa4dc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4daffd700 1 -- 172.21.15.123:0/3904772359 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc004a80 con 0x7fa4ec06f8d0 2023-03-08T15:50:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4daffd700 1 -- 172.21.15.123:0/3904772359 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc004c00 con 0x7fa4ec06f8d0 2023-03-08T15:50:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.861+0000 7fa4f0ae4700 1 -- 172.21.15.123:0/3904772359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ec071820 con 0x7fa4ec06f8d0 2023-03-08T15:50:27.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.862+0000 7fa4daffd700 1 -- 172.21.15.123:0/3904772359 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc0070d0 con 0x7fa4ec06f8d0 2023-03-08T15:50:27.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.862+0000 7fa4f0ae4700 1 -- 172.21.15.123:0/3904772359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ec06fe60 con 0x7fa4ec06f8d0 2023-03-08T15:50:27.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.862+0000 7fa4f0ae4700 1 -- 172.21.15.123:0/3904772359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ec071b00 con 0x7fa4ec06f8d0 2023-03-08T15:50:27.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.863+0000 7fa4daffd700 1 -- 172.21.15.123:0/3904772359 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fa4dc022070 con 0x7fa4ec06f8d0 2023-03-08T15:50:27.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.863+0000 7fa4daffd700 1 --2- 172.21.15.123:0/3904772359 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4cc0698d0 0x7fa4cc06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:27.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.863+0000 7fa4daffd700 1 -- 172.21.15.123:0/3904772359 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa4dc089ba0 con 0x7fa4ec06f8d0 2023-03-08T15:50:27.869 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.863+0000 7fa4ea59c700 1 --2- 172.21.15.123:0/3904772359 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4cc0698d0 0x7fa4cc06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:27.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.864+0000 7fa4ea59c700 1 --2- 172.21.15.123:0/3904772359 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4cc0698d0 0x7fa4cc06bd80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0000c00 tx=0x7fa4e0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:27.870 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:27.869+0000 7fa4daffd700 1 -- 172.21.15.123:0/3904772359 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fa4dc0558f0 con 0x7fa4ec06f8d0 2023-03-08T15:50:28.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.133+0000 7fa4f0ae4700 1 -- 172.21.15.123:0/3904772359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa4ec1dcff0 con 0x7fa4ec06f8d0 2023-03-08T15:50:28.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.134+0000 7fa4daffd700 1 -- 172.21.15.123:0/3904772359 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2505 (secure 0 0 0) 0x7fa4dc0159e0 con 0x7fa4ec06f8d0 2023-03-08T15:50:28.135 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:28.136 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":74,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1678290565,"num_in_osds":8,"osd_in_since":1678290556,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":69345280,"bytes_avail":773024768000,"bytes_total":773094113280,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4896}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-03-08T15:50:21.981429+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-03-08T15:50:28.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.136+0000 7fa4f0ae4700 1 -- 172.21.15.123:0/3904772359 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4cc0698d0 msgr2=0x7fa4cc06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:28.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.136+0000 7fa4f0ae4700 1 --2- 172.21.15.123:0/3904772359 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4cc0698d0 0x7fa4cc06bd80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0000c00 tx=0x7fa4e0008030 comp rx=0 tx=0).stop 2023-03-08T15:50:28.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.136+0000 7fa4f0ae4700 1 -- 172.21.15.123:0/3904772359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ec06f8d0 msgr2=0x7fa4ec0b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:28.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.136+0000 7fa4f0ae4700 1 --2- 172.21.15.123:0/3904772359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ec06f8d0 0x7fa4ec0b4db0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00e910 tx=0x7fa4dc00ecd0 comp rx=0 tx=0).stop 2023-03-08T15:50:28.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.136+0000 7fa4f0ae4700 1 -- 172.21.15.123:0/3904772359 shutdown_connections 2023-03-08T15:50:28.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.136+0000 7fa4f0ae4700 1 --2- 172.21.15.123:0/3904772359 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fa4cc0698d0 0x7fa4cc06bd80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:28.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.136+0000 7fa4f0ae4700 1 --2- 172.21.15.123:0/3904772359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4ec140980 0x7fa4ec0b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:28.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.136+0000 7fa4f0ae4700 1 --2- 172.21.15.123:0/3904772359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4ec06b530 0x7fa4ec1361b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:28.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.136+0000 7fa4f0ae4700 1 --2- 172.21.15.123:0/3904772359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ec06f8d0 0x7fa4ec0b4db0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:28.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.136+0000 7fa4f0ae4700 1 -- 172.21.15.123:0/3904772359 >> 172.21.15.123:0/3904772359 conn(0x7fa4ec0ba3c0 msgr2=0x7fa4ec13b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:28.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.136+0000 7fa4f0ae4700 1 -- 172.21.15.123:0/3904772359 shutdown_connections 2023-03-08T15:50:28.139 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.136+0000 7fa4f0ae4700 1 -- 172.21.15.123:0/3904772359 wait complete. 2023-03-08T15:50:28.149 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-03-08T15:50:28.149 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-08T15:50:28.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.268+0000 7f11aa715700 1 Processor -- start 2023-03-08T15:50:28.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.268+0000 7f11aa715700 1 -- start start 2023-03-08T15:50:28.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.269+0000 7f11aa715700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f11a406fef0 0x7f11a414ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:28.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.269+0000 7f11aa715700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11a414b250 0x7f11a4155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:28.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.269+0000 7f11aa715700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a414b6f0 con 0x7f11a4147e50 2023-03-08T15:50:28.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.269+0000 7f11aa715700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a406a960 con 0x7f11a406fef0 2023-03-08T15:50:28.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.269+0000 7f11aa715700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a414a810 con 0x7f11a414b250 2023-03-08T15:50:28.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.269+0000 7f11a3fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f11a4147e50 0x7f11a406a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56548/0 (socket says 172.21.15.123:56548) 2023-03-08T15:50:28.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.269+0000 7f11a3fff700 1 -- 172.21.15.123:0/3141968607 learned_addr learned my addr 172.21.15.123:0/3141968607 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:50:28.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.269+0000 7f11a2ffd700 1 -- 172.21.15.123:0/3141968607 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23048253 0 0) 0x7f11a414b6f0 con 0x7f11a4147e50 2023-03-08T15:50:28.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.269+0000 7f11a2ffd700 1 -- 172.21.15.123:0/3141968607 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f118c0035b0 con 0x7f11a4147e50 2023-03-08T15:50:28.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a8cb2700 1 --2- 172.21.15.123:0/3141968607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11a414b250 0x7f11a4155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:28.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 -- 172.21.15.123:0/3141968607 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2890507903 0 0) 0x7f118c0035b0 con 0x7f11a4147e50 2023-03-08T15:50:28.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 -- 172.21.15.123:0/3141968607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11a414b250 msgr2=0x7f11a4155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:28.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 --2- 172.21.15.123:0/3141968607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11a414b250 0x7f11a4155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:28.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 -- 172.21.15.123:0/3141968607 >> v2:172.21.15.175:3300/0 conn(0x7f11a406fef0 msgr2=0x7f11a414ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:28.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 --2- 172.21.15.123:0/3141968607 >> v2:172.21.15.175:3300/0 conn(0x7f11a406fef0 0x7f11a414ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:28.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 -- 172.21.15.123:0/3141968607 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a4071a40 con 0x7f11a4147e50 2023-03-08T15:50:28.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 -- 172.21.15.123:0/3141968607 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f1194001670 con 0x7f11a4147e50 2023-03-08T15:50:28.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a8cb2700 1 --2- 172.21.15.123:0/3141968607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11a414b250 0x7f11a4155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:28.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 -- 172.21.15.123:0/3141968607 >> v1:172.21.15.123:6789/0 conn(0x7f11a4147e50 legacy=0x7f11a406a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:28.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 --2- 172.21.15.123:0/3141968607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f118c003a00 0x7f118c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:28.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 --2- 172.21.15.123:0/3141968607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11a414b250 0x7f118c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:28.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 --2- 172.21.15.123:0/3141968607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f118c004d90 0x7f118c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:28.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 -- 172.21.15.123:0/3141968607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a406a960 con 0x7f118c004d90 2023-03-08T15:50:28.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 -- 172.21.15.123:0/3141968607 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a414a810 con 0x7f118c003a00 2023-03-08T15:50:28.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 -- 172.21.15.123:0/3141968607 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c00bb70 con 0x7f11a414b250 2023-03-08T15:50:28.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a8cb2700 1 --2- 172.21.15.123:0/3141968607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f118c004d90 0x7f118c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:28.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a8cb2700 1 -- 172.21.15.123:0/3141968607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11a414b250 msgr2=0x7f118c004850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-08T15:50:28.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a8cb2700 1 --2- 172.21.15.123:0/3141968607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11a414b250 0x7f118c004850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:28.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a8cb2700 1 -- 172.21.15.123:0/3141968607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f118c003a00 msgr2=0x7f118c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:28.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a8cb2700 1 --2- 172.21.15.123:0/3141968607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f118c003a00 0x7f118c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:28.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a8cb2700 1 -- 172.21.15.123:0/3141968607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c0035b0 con 0x7f118c004d90 2023-03-08T15:50:28.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a8cb2700 1 --2- 172.21.15.123:0/3141968607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f118c004d90 0x7f118c005200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f119c0073e0 tx=0x7f118c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7148b772f51e427 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:28.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 -- 172.21.15.123:0/3141968607 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c007ea0 con 0x7f118c004d90 2023-03-08T15:50:28.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 -- 172.21.15.123:0/3141968607 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c014400 con 0x7f118c004d90 2023-03-08T15:50:28.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.270+0000 7f11a2ffd700 1 -- 172.21.15.123:0/3141968607 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c0147b0 con 0x7f118c004d90 2023-03-08T15:50:28.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.271+0000 7f11aa715700 1 -- 172.21.15.123:0/3141968607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f118c004d90 msgr2=0x7f118c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:28.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.271+0000 7f11aa715700 1 --2- 172.21.15.123:0/3141968607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f118c004d90 0x7f118c005200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f119c0073e0 tx=0x7f118c005880 comp rx=0 tx=0).stop 2023-03-08T15:50:28.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.271+0000 7f11a8cb2700 1 -- 172.21.15.123:0/3141968607 reap_dead start 2023-03-08T15:50:28.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.271+0000 7f11aa715700 1 -- 172.21.15.123:0/3141968607 shutdown_connections 2023-03-08T15:50:28.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.271+0000 7f11aa715700 1 -- 172.21.15.123:0/3141968607 >> 172.21.15.123:0/3141968607 conn(0x7f11a406b360 msgr2=0x7f11a406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:28.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.271+0000 7f11aa715700 1 -- 172.21.15.123:0/3141968607 shutdown_connections 2023-03-08T15:50:28.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.271+0000 7f11aa715700 1 -- 172.21.15.123:0/3141968607 wait complete. 2023-03-08T15:50:28.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.272+0000 7f11aa715700 1 Processor -- start 2023-03-08T15:50:28.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.272+0000 7f11aa715700 1 -- start start 2023-03-08T15:50:28.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11aa715700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11a41d76b0 0x7f11a413c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:28.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11aa715700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11a41e32f0 0x7f11a41dffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:28.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11aa715700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11a413cb20 0x7f11a4142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:28.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11aa715700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a41e3d70 con 0x7f11a413cb20 2023-03-08T15:50:28.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11aa715700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a413d000 con 0x7f11a41e32f0 2023-03-08T15:50:28.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11aa715700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a41df8c0 con 0x7f11a41d76b0 2023-03-08T15:50:28.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11a8cb2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11a413cb20 0x7f11a4142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:28.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11a8cb2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11a413cb20 0x7f11a4142dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35540/0 (socket says 172.21.15.123:35540) 2023-03-08T15:50:28.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11a8cb2700 1 -- 172.21.15.123:0/86844718 learned_addr learned my addr 172.21.15.123:0/86844718 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:28.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11a37fe700 1 --2- 172.21.15.123:0/86844718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11a41e32f0 0x7f11a41dffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:28.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11a3fff700 1 --2- 172.21.15.123:0/86844718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11a41d76b0 0x7f11a413c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:28.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11a8cb2700 1 -- 172.21.15.123:0/86844718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11a41d76b0 msgr2=0x7f11a413c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:28.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11a8cb2700 1 --2- 172.21.15.123:0/86844718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11a41d76b0 0x7f11a413c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:28.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11a8cb2700 1 -- 172.21.15.123:0/86844718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11a41e32f0 msgr2=0x7f11a41dffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:28.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11a8cb2700 1 --2- 172.21.15.123:0/86844718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11a41e32f0 0x7f11a41dffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:28.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11a8cb2700 1 -- 172.21.15.123:0/86844718 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a4072000 con 0x7f11a413cb20 2023-03-08T15:50:28.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11a8cb2700 1 --2- 172.21.15.123:0/86844718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11a413cb20 0x7f11a4142dd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f119c014000 tx=0x7f119c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:28.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11a0ff9700 1 -- 172.21.15.123:0/86844718 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c01e610 con 0x7f11a413cb20 2023-03-08T15:50:28.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.273+0000 7f11a0ff9700 1 -- 172.21.15.123:0/86844718 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c01e790 con 0x7f11a413cb20 2023-03-08T15:50:28.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.274+0000 7f11a0ff9700 1 -- 172.21.15.123:0/86844718 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c01eb40 con 0x7f11a413cb20 2023-03-08T15:50:28.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.274+0000 7f11aa715700 1 -- 172.21.15.123:0/86844718 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a4071d20 con 0x7f11a413cb20 2023-03-08T15:50:28.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.274+0000 7f11aa715700 1 -- 172.21.15.123:0/86844718 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a4148220 con 0x7f11a413cb20 2023-03-08T15:50:28.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.275+0000 7f11aa715700 1 -- 172.21.15.123:0/86844718 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a40b7170 con 0x7f11a413cb20 2023-03-08T15:50:28.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.275+0000 7f11a0ff9700 1 -- 172.21.15.123:0/86844718 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f119c012070 con 0x7f11a413cb20 2023-03-08T15:50:28.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.276+0000 7f11a0ff9700 1 --2- 172.21.15.123:0/86844718 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f1190069900 0x7f119006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:28.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.276+0000 7f11a0ff9700 1 -- 172.21.15.123:0/86844718 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f119c0892d0 con 0x7f11a413cb20 2023-03-08T15:50:28.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.276+0000 7f11a3fff700 1 --2- 172.21.15.123:0/86844718 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f1190069900 0x7f119006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:28.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.276+0000 7f11a3fff700 1 --2- 172.21.15.123:0/86844718 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f1190069900 0x7f119006bdb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1194001eb0 tx=0x7f1194001a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:28.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.279+0000 7f11a0ff9700 1 -- 172.21.15.123:0/86844718 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f119c055180 con 0x7f11a413cb20 2023-03-08T15:50:28.464 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.463+0000 7f11aa715700 1 -- 172.21.15.123:0/86844718 --> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11a40744c0 con 0x7f1190069900 2023-03-08T15:50:28.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.470+0000 7f11a0ff9700 1 -- 172.21.15.123:0/86844718 <== mgr.4098 v2:172.21.15.123:6832/142884 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+292649 (secure 0 0 0) 0x7f11a40744c0 con 0x7f1190069900 2023-03-08T15:50:28.474 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:28.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.473+0000 7f11aa715700 1 -- 172.21.15.123:0/86844718 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f1190069900 msgr2=0x7f119006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:28.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.473+0000 7f11aa715700 1 --2- 172.21.15.123:0/86844718 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f1190069900 0x7f119006bdb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1194001eb0 tx=0x7f1194001a00 comp rx=0 tx=0).stop 2023-03-08T15:50:28.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.473+0000 7f11aa715700 1 -- 172.21.15.123:0/86844718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11a413cb20 msgr2=0x7f11a4142dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:28.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.473+0000 7f11aa715700 1 --2- 172.21.15.123:0/86844718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11a413cb20 0x7f11a4142dd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f119c014000 tx=0x7f119c004b40 comp rx=0 tx=0).stop 2023-03-08T15:50:28.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.473+0000 7f11aa715700 1 -- 172.21.15.123:0/86844718 shutdown_connections 2023-03-08T15:50:28.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.474+0000 7f11aa715700 1 --2- 172.21.15.123:0/86844718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11a413cb20 0x7f11a4142dd0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:28.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.474+0000 7f11aa715700 1 --2- 172.21.15.123:0/86844718 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f1190069900 0x7f119006bdb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:28.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.474+0000 7f11aa715700 1 --2- 172.21.15.123:0/86844718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11a41d76b0 0x7f11a413c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:28.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.474+0000 7f11aa715700 1 --2- 172.21.15.123:0/86844718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11a41e32f0 0x7f11a41dffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:28.477 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.474+0000 7f11aa715700 1 -- 172.21.15.123:0/86844718 >> 172.21.15.123:0/86844718 conn(0x7f11a406b360 msgr2=0x7f11a4149670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:28.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.474+0000 7f11aa715700 1 -- 172.21.15.123:0/86844718 shutdown_connections 2023-03-08T15:50:28.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:28.474+0000 7f11aa715700 1 -- 172.21.15.123:0/86844718 wait complete. 2023-03-08T15:50:28.478 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-03-08T15:50:28.487 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-03-08T15:50:27.982551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69512,"kb_used_data":4232,"kb_used_omap":0,"kb_used_meta":65216,"kb_avail":754905208,"statfs":{"total":773094113280,"available":773022932992,"internally_reserved":0,"allocated":4333568,"data_stored":2440228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66781184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001177"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590238+0000","last_change":"2023-03-08T15:50:22.596656+0000","last_active":"2023-03-08T15:50:23.590238+0000","last_peered":"2023-03-08T15:50:23.590238+0000","last_clean":"2023-03-08T15:50:23.590238+0000","last_became_active":"2023-03-08T15:50:22.596439+0000","last_became_peered":"2023-03-08T15:50:22.596439+0000","last_unstale":"2023-03-08T15:50:23.590238+0000","last_undegraded":"2023-03-08T15:50:23.590238+0000","last_fullsized":"2023-03-08T15:50:23.590238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:27:26.193162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590593+0000","last_change":"2023-03-08T15:50:22.600482+0000","last_active":"2023-03-08T15:50:23.590593+0000","last_peered":"2023-03-08T15:50:23.590593+0000","last_clean":"2023-03-08T15:50:23.590593+0000","last_became_active":"2023-03-08T15:50:22.600245+0000","last_became_peered":"2023-03-08T15:50:22.600245+0000","last_unstale":"2023-03-08T15:50:23.590593+0000","last_undegraded":"2023-03-08T15:50:23.590593+0000","last_fullsized":"2023-03-08T15:50:23.590593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:24:06.766347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739669+0000","last_change":"2023-03-08T15:50:22.605196+0000","last_active":"2023-03-08T15:50:23.739669+0000","last_peered":"2023-03-08T15:50:23.739669+0000","last_clean":"2023-03-08T15:50:23.739669+0000","last_became_active":"2023-03-08T15:50:22.604931+0000","last_became_peered":"2023-03-08T15:50:22.604931+0000","last_unstale":"2023-03-08T15:50:23.739669+0000","last_undegraded":"2023-03-08T15:50:23.739669+0000","last_fullsized":"2023-03-08T15:50:23.739669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:52:57.034947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739905+0000","last_change":"2023-03-08T15:50:22.601325+0000","last_active":"2023-03-08T15:50:23.739905+0000","last_peered":"2023-03-08T15:50:23.739905+0000","last_clean":"2023-03-08T15:50:23.739905+0000","last_became_active":"2023-03-08T15:50:22.600553+0000","last_became_peered":"2023-03-08T15:50:22.600553+0000","last_unstale":"2023-03-08T15:50:23.739905+0000","last_undegraded":"2023-03-08T15:50:23.739905+0000","last_fullsized":"2023-03-08T15:50:23.739905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:33:44.568318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739780+0000","last_change":"2023-03-08T15:50:22.588380+0000","last_active":"2023-03-08T15:50:23.739780+0000","last_peered":"2023-03-08T15:50:23.739780+0000","last_clean":"2023-03-08T15:50:23.739780+0000","last_became_active":"2023-03-08T15:50:22.587956+0000","last_became_peered":"2023-03-08T15:50:22.587956+0000","last_unstale":"2023-03-08T15:50:23.739780+0000","last_undegraded":"2023-03-08T15:50:23.739780+0000","last_fullsized":"2023-03-08T15:50:23.739780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:08:47.539325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588458+0000","last_change":"2023-03-08T15:50:22.603255+0000","last_active":"2023-03-08T15:50:23.588458+0000","last_peered":"2023-03-08T15:50:23.588458+0000","last_clean":"2023-03-08T15:50:23.588458+0000","last_became_active":"2023-03-08T15:50:22.603003+0000","last_became_peered":"2023-03-08T15:50:22.603003+0000","last_unstale":"2023-03-08T15:50:23.588458+0000","last_undegraded":"2023-03-08T15:50:23.588458+0000","last_fullsized":"2023-03-08T15:50:23.588458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:59:11.490643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740117+0000","last_change":"2023-03-08T15:50:22.608831+0000","last_active":"2023-03-08T15:50:23.740117+0000","last_peered":"2023-03-08T15:50:23.740117+0000","last_clean":"2023-03-08T15:50:23.740117+0000","last_became_active":"2023-03-08T15:50:22.608552+0000","last_became_peered":"2023-03-08T15:50:22.608552+0000","last_unstale":"2023-03-08T15:50:23.740117+0000","last_undegraded":"2023-03-08T15:50:23.740117+0000","last_fullsized":"2023-03-08T15:50:23.740117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:11:30.454793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589702+0000","last_change":"2023-03-08T15:50:22.603508+0000","last_active":"2023-03-08T15:50:23.589702+0000","last_peered":"2023-03-08T15:50:23.589702+0000","last_clean":"2023-03-08T15:50:23.589702+0000","last_became_active":"2023-03-08T15:50:22.603239+0000","last_became_peered":"2023-03-08T15:50:22.603239+0000","last_unstale":"2023-03-08T15:50:23.589702+0000","last_undegraded":"2023-03-08T15:50:23.589702+0000","last_fullsized":"2023-03-08T15:50:23.589702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:44:30.324678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740146+0000","last_change":"2023-03-08T15:50:22.604065+0000","last_active":"2023-03-08T15:50:23.740146+0000","last_peered":"2023-03-08T15:50:23.740146+0000","last_clean":"2023-03-08T15:50:23.740146+0000","last_became_active":"2023-03-08T15:50:22.603808+0000","last_became_peered":"2023-03-08T15:50:22.603808+0000","last_unstale":"2023-03-08T15:50:23.740146+0000","last_undegraded":"2023-03-08T15:50:23.740146+0000","last_fullsized":"2023-03-08T15:50:23.740146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:16:07.182975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741187+0000","last_change":"2023-03-08T15:50:22.603814+0000","last_active":"2023-03-08T15:50:23.741187+0000","last_peered":"2023-03-08T15:50:23.741187+0000","last_clean":"2023-03-08T15:50:23.741187+0000","last_became_active":"2023-03-08T15:50:22.603454+0000","last_became_peered":"2023-03-08T15:50:22.603454+0000","last_unstale":"2023-03-08T15:50:23.741187+0000","last_undegraded":"2023-03-08T15:50:23.741187+0000","last_fullsized":"2023-03-08T15:50:23.741187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:42:51.830793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741014+0000","last_change":"2023-03-08T15:50:22.601985+0000","last_active":"2023-03-08T15:50:23.741014+0000","last_peered":"2023-03-08T15:50:23.741014+0000","last_clean":"2023-03-08T15:50:23.741014+0000","last_became_active":"2023-03-08T15:50:22.601742+0000","last_became_peered":"2023-03-08T15:50:22.601742+0000","last_unstale":"2023-03-08T15:50:23.741014+0000","last_undegraded":"2023-03-08T15:50:23.741014+0000","last_fullsized":"2023-03-08T15:50:23.741014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:24:06.766347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739581+0000","last_change":"2023-03-08T15:50:22.599787+0000","last_active":"2023-03-08T15:50:23.739581+0000","last_peered":"2023-03-08T15:50:23.739581+0000","last_clean":"2023-03-08T15:50:23.739581+0000","last_became_active":"2023-03-08T15:50:22.599526+0000","last_became_peered":"2023-03-08T15:50:22.599526+0000","last_unstale":"2023-03-08T15:50:23.739581+0000","last_undegraded":"2023-03-08T15:50:23.739581+0000","last_fullsized":"2023-03-08T15:50:23.739581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:26:12.855862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740573+0000","last_change":"2023-03-08T15:50:22.604976+0000","last_active":"2023-03-08T15:50:23.740573+0000","last_peered":"2023-03-08T15:50:23.740573+0000","last_clean":"2023-03-08T15:50:23.740573+0000","last_became_active":"2023-03-08T15:50:22.604689+0000","last_became_peered":"2023-03-08T15:50:22.604689+0000","last_unstale":"2023-03-08T15:50:23.740573+0000","last_undegraded":"2023-03-08T15:50:23.740573+0000","last_fullsized":"2023-03-08T15:50:23.740573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:55:42.607342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741047+0000","last_change":"2023-03-08T15:50:22.601313+0000","last_active":"2023-03-08T15:50:23.741047+0000","last_peered":"2023-03-08T15:50:23.741047+0000","last_clean":"2023-03-08T15:50:23.741047+0000","last_became_active":"2023-03-08T15:50:22.600497+0000","last_became_peered":"2023-03-08T15:50:22.600497+0000","last_unstale":"2023-03-08T15:50:23.741047+0000","last_undegraded":"2023-03-08T15:50:23.741047+0000","last_fullsized":"2023-03-08T15:50:23.741047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:36:52.143769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740267+0000","last_change":"2023-03-08T15:50:22.601401+0000","last_active":"2023-03-08T15:50:23.740267+0000","last_peered":"2023-03-08T15:50:23.740267+0000","last_clean":"2023-03-08T15:50:23.740267+0000","last_became_active":"2023-03-08T15:50:22.601069+0000","last_became_peered":"2023-03-08T15:50:22.601069+0000","last_unstale":"2023-03-08T15:50:23.740267+0000","last_undegraded":"2023-03-08T15:50:23.740267+0000","last_fullsized":"2023-03-08T15:50:23.740267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:51:16.866114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588921+0000","last_change":"2023-03-08T15:50:22.605255+0000","last_active":"2023-03-08T15:50:23.588921+0000","last_peered":"2023-03-08T15:50:23.588921+0000","last_clean":"2023-03-08T15:50:23.588921+0000","last_became_active":"2023-03-08T15:50:22.604837+0000","last_became_peered":"2023-03-08T15:50:22.604837+0000","last_unstale":"2023-03-08T15:50:23.588921+0000","last_undegraded":"2023-03-08T15:50:23.588921+0000","last_fullsized":"2023-03-08T15:50:23.588921+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:34:21.494818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589500+0000","last_change":"2023-03-08T15:50:22.606733+0000","last_active":"2023-03-08T15:50:23.589500+0000","last_peered":"2023-03-08T15:50:23.589500+0000","last_clean":"2023-03-08T15:50:23.589500+0000","last_became_active":"2023-03-08T15:50:22.606475+0000","last_became_peered":"2023-03-08T15:50:22.606475+0000","last_unstale":"2023-03-08T15:50:23.589500+0000","last_undegraded":"2023-03-08T15:50:23.589500+0000","last_fullsized":"2023-03-08T15:50:23.589500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:33:34.133823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740335+0000","last_change":"2023-03-08T15:50:22.599399+0000","last_active":"2023-03-08T15:50:23.740335+0000","last_peered":"2023-03-08T15:50:23.740335+0000","last_clean":"2023-03-08T15:50:23.740335+0000","last_became_active":"2023-03-08T15:50:22.599099+0000","last_became_peered":"2023-03-08T15:50:22.599099+0000","last_unstale":"2023-03-08T15:50:23.740335+0000","last_undegraded":"2023-03-08T15:50:23.740335+0000","last_fullsized":"2023-03-08T15:50:23.740335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:47:26.227110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740012+0000","last_change":"2023-03-08T15:50:22.602805+0000","last_active":"2023-03-08T15:50:23.740012+0000","last_peered":"2023-03-08T15:50:23.740012+0000","last_clean":"2023-03-08T15:50:23.740012+0000","last_became_active":"2023-03-08T15:50:22.602548+0000","last_became_peered":"2023-03-08T15:50:22.602548+0000","last_unstale":"2023-03-08T15:50:23.740012+0000","last_undegraded":"2023-03-08T15:50:23.740012+0000","last_fullsized":"2023-03-08T15:50:23.740012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:47:26.227110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740582+0000","last_change":"2023-03-08T15:50:22.599369+0000","last_active":"2023-03-08T15:50:23.740582+0000","last_peered":"2023-03-08T15:50:23.740582+0000","last_clean":"2023-03-08T15:50:23.740582+0000","last_became_active":"2023-03-08T15:50:22.599081+0000","last_became_peered":"2023-03-08T15:50:22.599081+0000","last_unstale":"2023-03-08T15:50:23.740582+0000","last_undegraded":"2023-03-08T15:50:23.740582+0000","last_fullsized":"2023-03-08T15:50:23.740582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:16:18.950818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740654+0000","last_change":"2023-03-08T15:50:22.603778+0000","last_active":"2023-03-08T15:50:23.740654+0000","last_peered":"2023-03-08T15:50:23.740654+0000","last_clean":"2023-03-08T15:50:23.740654+0000","last_became_active":"2023-03-08T15:50:22.603353+0000","last_became_peered":"2023-03-08T15:50:22.603353+0000","last_unstale":"2023-03-08T15:50:23.740654+0000","last_undegraded":"2023-03-08T15:50:23.740654+0000","last_fullsized":"2023-03-08T15:50:23.740654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:31:50.246112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740641+0000","last_change":"2023-03-08T15:50:22.601538+0000","last_active":"2023-03-08T15:50:23.740641+0000","last_peered":"2023-03-08T15:50:23.740641+0000","last_clean":"2023-03-08T15:50:23.740641+0000","last_became_active":"2023-03-08T15:50:22.600965+0000","last_became_peered":"2023-03-08T15:50:22.600965+0000","last_unstale":"2023-03-08T15:50:23.740641+0000","last_undegraded":"2023-03-08T15:50:23.740641+0000","last_fullsized":"2023-03-08T15:50:23.740641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:11:30.454793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589042+0000","last_change":"2023-03-08T15:50:22.600860+0000","last_active":"2023-03-08T15:50:23.589042+0000","last_peered":"2023-03-08T15:50:23.589042+0000","last_clean":"2023-03-08T15:50:23.589042+0000","last_became_active":"2023-03-08T15:50:22.600380+0000","last_became_peered":"2023-03-08T15:50:22.600380+0000","last_unstale":"2023-03-08T15:50:23.589042+0000","last_undegraded":"2023-03-08T15:50:23.589042+0000","last_fullsized":"2023-03-08T15:50:23.589042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:16:07.182975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739565+0000","last_change":"2023-03-08T15:50:22.597608+0000","last_active":"2023-03-08T15:50:23.739565+0000","last_peered":"2023-03-08T15:50:23.739565+0000","last_clean":"2023-03-08T15:50:23.739565+0000","last_became_active":"2023-03-08T15:50:22.597322+0000","last_became_peered":"2023-03-08T15:50:22.597322+0000","last_unstale":"2023-03-08T15:50:23.739565+0000","last_undegraded":"2023-03-08T15:50:23.739565+0000","last_fullsized":"2023-03-08T15:50:23.739565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:43:16.313541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740114+0000","last_change":"2023-03-08T15:50:22.596992+0000","last_active":"2023-03-08T15:50:23.740114+0000","last_peered":"2023-03-08T15:50:23.740114+0000","last_clean":"2023-03-08T15:50:23.740114+0000","last_became_active":"2023-03-08T15:50:22.596715+0000","last_became_peered":"2023-03-08T15:50:22.596715+0000","last_unstale":"2023-03-08T15:50:23.740114+0000","last_undegraded":"2023-03-08T15:50:23.740114+0000","last_fullsized":"2023-03-08T15:50:23.740114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:11:49.033770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588746+0000","last_change":"2023-03-08T15:50:22.605289+0000","last_active":"2023-03-08T15:50:23.588746+0000","last_peered":"2023-03-08T15:50:23.588746+0000","last_clean":"2023-03-08T15:50:23.588746+0000","last_became_active":"2023-03-08T15:50:22.604976+0000","last_became_peered":"2023-03-08T15:50:22.604976+0000","last_unstale":"2023-03-08T15:50:23.588746+0000","last_undegraded":"2023-03-08T15:50:23.588746+0000","last_fullsized":"2023-03-08T15:50:23.588746+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:16:07.182975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740119+0000","last_change":"2023-03-08T15:50:22.607437+0000","last_active":"2023-03-08T15:50:23.740119+0000","last_peered":"2023-03-08T15:50:23.740119+0000","last_clean":"2023-03-08T15:50:23.740119+0000","last_became_active":"2023-03-08T15:50:22.599347+0000","last_became_peered":"2023-03-08T15:50:22.599347+0000","last_unstale":"2023-03-08T15:50:23.740119+0000","last_undegraded":"2023-03-08T15:50:23.740119+0000","last_fullsized":"2023-03-08T15:50:23.740119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:43:16.313541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740606+0000","last_change":"2023-03-08T15:50:22.604184+0000","last_active":"2023-03-08T15:50:23.740606+0000","last_peered":"2023-03-08T15:50:23.740606+0000","last_clean":"2023-03-08T15:50:23.740606+0000","last_became_active":"2023-03-08T15:50:22.603370+0000","last_became_peered":"2023-03-08T15:50:22.603370+0000","last_unstale":"2023-03-08T15:50:23.740606+0000","last_undegraded":"2023-03-08T15:50:23.740606+0000","last_fullsized":"2023-03-08T15:50:23.740606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:44:30.324678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740847+0000","last_change":"2023-03-08T15:50:22.598961+0000","last_active":"2023-03-08T15:50:23.740847+0000","last_peered":"2023-03-08T15:50:23.740847+0000","last_clean":"2023-03-08T15:50:23.740847+0000","last_became_active":"2023-03-08T15:50:22.598684+0000","last_became_peered":"2023-03-08T15:50:22.598684+0000","last_unstale":"2023-03-08T15:50:23.740847+0000","last_undegraded":"2023-03-08T15:50:23.740847+0000","last_fullsized":"2023-03-08T15:50:23.740847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:06:10.030266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739801+0000","last_change":"2023-03-08T15:50:22.597623+0000","last_active":"2023-03-08T15:50:23.739801+0000","last_peered":"2023-03-08T15:50:23.739801+0000","last_clean":"2023-03-08T15:50:23.739801+0000","last_became_active":"2023-03-08T15:50:22.597360+0000","last_became_peered":"2023-03-08T15:50:22.597360+0000","last_unstale":"2023-03-08T15:50:23.739801+0000","last_undegraded":"2023-03-08T15:50:23.739801+0000","last_fullsized":"2023-03-08T15:50:23.739801+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:33:44.568318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589017+0000","last_change":"2023-03-08T15:50:22.600655+0000","last_active":"2023-03-08T15:50:23.589017+0000","last_peered":"2023-03-08T15:50:23.589017+0000","last_clean":"2023-03-08T15:50:23.589017+0000","last_became_active":"2023-03-08T15:50:22.600007+0000","last_became_peered":"2023-03-08T15:50:22.600007+0000","last_unstale":"2023-03-08T15:50:23.589017+0000","last_undegraded":"2023-03-08T15:50:23.589017+0000","last_fullsized":"2023-03-08T15:50:23.589017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:16:33.069467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588392+0000","last_change":"2023-03-08T15:50:22.599832+0000","last_active":"2023-03-08T15:50:23.588392+0000","last_peered":"2023-03-08T15:50:23.588392+0000","last_clean":"2023-03-08T15:50:23.588392+0000","last_became_active":"2023-03-08T15:50:22.599453+0000","last_became_peered":"2023-03-08T15:50:22.599453+0000","last_unstale":"2023-03-08T15:50:23.588392+0000","last_undegraded":"2023-03-08T15:50:23.588392+0000","last_fullsized":"2023-03-08T15:50:23.588392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:39:16.250803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589310+0000","last_change":"2023-03-08T15:50:22.605500+0000","last_active":"2023-03-08T15:50:23.589310+0000","last_peered":"2023-03-08T15:50:23.589310+0000","last_clean":"2023-03-08T15:50:23.589310+0000","last_became_active":"2023-03-08T15:50:22.605231+0000","last_became_peered":"2023-03-08T15:50:22.605231+0000","last_unstale":"2023-03-08T15:50:23.589310+0000","last_undegraded":"2023-03-08T15:50:23.589310+0000","last_fullsized":"2023-03-08T15:50:23.589310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:52:57.034947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740216+0000","last_change":"2023-03-08T15:50:22.208854+0000","last_active":"2023-03-08T15:50:23.740216+0000","last_peered":"2023-03-08T15:50:23.740216+0000","last_clean":"2023-03-08T15:50:23.740216+0000","last_became_active":"2023-03-08T15:50:22.208603+0000","last_became_peered":"2023-03-08T15:50:22.208603+0000","last_unstale":"2023-03-08T15:50:23.740216+0000","last_undegraded":"2023-03-08T15:50:23.740216+0000","last_fullsized":"2023-03-08T15:50:23.740216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:47:49.932364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588919+0000","last_change":"2023-03-08T15:50:22.606931+0000","last_active":"2023-03-08T15:50:23.588919+0000","last_peered":"2023-03-08T15:50:23.588919+0000","last_clean":"2023-03-08T15:50:23.588919+0000","last_became_active":"2023-03-08T15:50:22.606473+0000","last_became_peered":"2023-03-08T15:50:22.606473+0000","last_unstale":"2023-03-08T15:50:23.588919+0000","last_undegraded":"2023-03-08T15:50:23.588919+0000","last_fullsized":"2023-03-08T15:50:23.588919+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:48:53.290624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739400+0000","last_change":"2023-03-08T15:50:22.210400+0000","last_active":"2023-03-08T15:50:23.739400+0000","last_peered":"2023-03-08T15:50:23.739400+0000","last_clean":"2023-03-08T15:50:23.739400+0000","last_became_active":"2023-03-08T15:50:22.210138+0000","last_became_peered":"2023-03-08T15:50:22.210138+0000","last_unstale":"2023-03-08T15:50:23.739400+0000","last_undegraded":"2023-03-08T15:50:23.739400+0000","last_fullsized":"2023-03-08T15:50:23.739400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:33:43.566573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740437+0000","last_change":"2023-03-08T15:50:22.601653+0000","last_active":"2023-03-08T15:50:23.740437+0000","last_peered":"2023-03-08T15:50:23.740437+0000","last_clean":"2023-03-08T15:50:23.740437+0000","last_became_active":"2023-03-08T15:50:22.601161+0000","last_became_peered":"2023-03-08T15:50:22.601161+0000","last_unstale":"2023-03-08T15:50:23.740437+0000","last_undegraded":"2023-03-08T15:50:23.740437+0000","last_fullsized":"2023-03-08T15:50:23.740437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:29:55.811304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589009+0000","last_change":"2023-03-08T15:50:22.205795+0000","last_active":"2023-03-08T15:50:23.589009+0000","last_peered":"2023-03-08T15:50:23.589009+0000","last_clean":"2023-03-08T15:50:23.589009+0000","last_became_active":"2023-03-08T15:50:22.205558+0000","last_became_peered":"2023-03-08T15:50:22.205558+0000","last_unstale":"2023-03-08T15:50:23.589009+0000","last_undegraded":"2023-03-08T15:50:23.589009+0000","last_fullsized":"2023-03-08T15:50:23.589009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:06:09.028520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590394+0000","last_change":"2023-03-08T15:50:22.599030+0000","last_active":"2023-03-08T15:50:23.590394+0000","last_peered":"2023-03-08T15:50:23.590394+0000","last_clean":"2023-03-08T15:50:23.590394+0000","last_became_active":"2023-03-08T15:50:22.598794+0000","last_became_peered":"2023-03-08T15:50:22.598794+0000","last_unstale":"2023-03-08T15:50:23.590394+0000","last_undegraded":"2023-03-08T15:50:23.590394+0000","last_fullsized":"2023-03-08T15:50:23.590394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:33:34.133823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741094+0000","last_change":"2023-03-08T15:50:22.207697+0000","last_active":"2023-03-08T15:50:23.741094+0000","last_peered":"2023-03-08T15:50:23.741094+0000","last_clean":"2023-03-08T15:50:23.741094+0000","last_became_active":"2023-03-08T15:50:22.207163+0000","last_became_peered":"2023-03-08T15:50:22.207163+0000","last_unstale":"2023-03-08T15:50:23.741094+0000","last_undegraded":"2023-03-08T15:50:23.741094+0000","last_fullsized":"2023-03-08T15:50:23.741094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:52:56.033202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739213+0000","last_change":"2023-03-08T15:50:22.599003+0000","last_active":"2023-03-08T15:50:23.739213+0000","last_peered":"2023-03-08T15:50:23.739213+0000","last_clean":"2023-03-08T15:50:23.739213+0000","last_became_active":"2023-03-08T15:50:22.598762+0000","last_became_peered":"2023-03-08T15:50:22.598762+0000","last_unstale":"2023-03-08T15:50:23.739213+0000","last_undegraded":"2023-03-08T15:50:23.739213+0000","last_fullsized":"2023-03-08T15:50:23.739213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:31:50.246112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740783+0000","last_change":"2023-03-08T15:50:22.203004+0000","last_active":"2023-03-08T15:50:23.740783+0000","last_peered":"2023-03-08T15:50:23.740783+0000","last_clean":"2023-03-08T15:50:23.740783+0000","last_became_active":"2023-03-08T15:50:22.202733+0000","last_became_peered":"2023-03-08T15:50:22.202733+0000","last_unstale":"2023-03-08T15:50:23.740783+0000","last_undegraded":"2023-03-08T15:50:23.740783+0000","last_fullsized":"2023-03-08T15:50:23.740783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:15:38.744674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741260+0000","last_change":"2023-03-08T15:50:22.604015+0000","last_active":"2023-03-08T15:50:23.741260+0000","last_peered":"2023-03-08T15:50:23.741260+0000","last_clean":"2023-03-08T15:50:23.741260+0000","last_became_active":"2023-03-08T15:50:22.603683+0000","last_became_peered":"2023-03-08T15:50:22.603683+0000","last_unstale":"2023-03-08T15:50:23.741260+0000","last_undegraded":"2023-03-08T15:50:23.741260+0000","last_fullsized":"2023-03-08T15:50:23.741260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:27:26.193162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589088+0000","last_change":"2023-03-08T15:50:22.211679+0000","last_active":"2023-03-08T15:50:23.589088+0000","last_peered":"2023-03-08T15:50:23.589088+0000","last_clean":"2023-03-08T15:50:23.589088+0000","last_became_active":"2023-03-08T15:50:22.211350+0000","last_became_peered":"2023-03-08T15:50:22.211350+0000","last_unstale":"2023-03-08T15:50:23.589088+0000","last_undegraded":"2023-03-08T15:50:23.589088+0000","last_fullsized":"2023-03-08T15:50:23.589088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:16:17.949073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740754+0000","last_change":"2023-03-08T15:50:22.610408+0000","last_active":"2023-03-08T15:50:23.740754+0000","last_peered":"2023-03-08T15:50:23.740754+0000","last_clean":"2023-03-08T15:50:23.740754+0000","last_became_active":"2023-03-08T15:50:22.608488+0000","last_became_peered":"2023-03-08T15:50:22.608488+0000","last_unstale":"2023-03-08T15:50:23.740754+0000","last_undegraded":"2023-03-08T15:50:23.740754+0000","last_fullsized":"2023-03-08T15:50:23.740754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:33:56.188085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588556+0000","last_change":"2023-03-08T15:50:22.208576+0000","last_active":"2023-03-08T15:50:23.588556+0000","last_peered":"2023-03-08T15:50:23.588556+0000","last_clean":"2023-03-08T15:50:23.588556+0000","last_became_active":"2023-03-08T15:50:22.208314+0000","last_became_peered":"2023-03-08T15:50:22.208314+0000","last_unstale":"2023-03-08T15:50:23.588556+0000","last_undegraded":"2023-03-08T15:50:23.588556+0000","last_fullsized":"2023-03-08T15:50:23.588556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:05:46.818700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590018+0000","last_change":"2023-03-08T15:50:22.600580+0000","last_active":"2023-03-08T15:50:23.590018+0000","last_peered":"2023-03-08T15:50:23.590018+0000","last_clean":"2023-03-08T15:50:23.590018+0000","last_became_active":"2023-03-08T15:50:22.599996+0000","last_became_peered":"2023-03-08T15:50:22.599996+0000","last_unstale":"2023-03-08T15:50:23.590018+0000","last_undegraded":"2023-03-08T15:50:23.590018+0000","last_fullsized":"2023-03-08T15:50:23.590018+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:11:30.454793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740196+0000","last_change":"2023-03-08T15:50:22.204919+0000","last_active":"2023-03-08T15:50:23.740196+0000","last_peered":"2023-03-08T15:50:23.740196+0000","last_clean":"2023-03-08T15:50:23.740196+0000","last_became_active":"2023-03-08T15:50:22.204637+0000","last_became_peered":"2023-03-08T15:50:22.204637+0000","last_unstale":"2023-03-08T15:50:23.740196+0000","last_undegraded":"2023-03-08T15:50:23.740196+0000","last_fullsized":"2023-03-08T15:50:23.740196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:16:32.067722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739917+0000","last_change":"2023-03-08T15:50:22.601352+0000","last_active":"2023-03-08T15:50:23.739917+0000","last_peered":"2023-03-08T15:50:23.739917+0000","last_clean":"2023-03-08T15:50:23.739917+0000","last_became_active":"2023-03-08T15:50:22.600871+0000","last_became_peered":"2023-03-08T15:50:22.600871+0000","last_unstale":"2023-03-08T15:50:23.739917+0000","last_undegraded":"2023-03-08T15:50:23.739917+0000","last_fullsized":"2023-03-08T15:50:23.739917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:11:49.033770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590471+0000","last_change":"2023-03-08T15:50:22.208986+0000","last_active":"2023-03-08T15:50:23.590471+0000","last_peered":"2023-03-08T15:50:23.590471+0000","last_clean":"2023-03-08T15:50:23.590471+0000","last_became_active":"2023-03-08T15:50:22.208694+0000","last_became_peered":"2023-03-08T15:50:22.208694+0000","last_unstale":"2023-03-08T15:50:23.590471+0000","last_undegraded":"2023-03-08T15:50:23.590471+0000","last_fullsized":"2023-03-08T15:50:23.590471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:36:30.225779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589379+0000","last_change":"2023-03-08T15:50:22.600631+0000","last_active":"2023-03-08T15:50:23.589379+0000","last_peered":"2023-03-08T15:50:23.589379+0000","last_clean":"2023-03-08T15:50:23.589379+0000","last_became_active":"2023-03-08T15:50:22.600066+0000","last_became_peered":"2023-03-08T15:50:22.600066+0000","last_unstale":"2023-03-08T15:50:23.589379+0000","last_undegraded":"2023-03-08T15:50:23.589379+0000","last_fullsized":"2023-03-08T15:50:23.589379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:31:50.246112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741380+0000","last_change":"2023-03-08T15:50:22.207254+0000","last_active":"2023-03-08T15:50:23.741380+0000","last_peered":"2023-03-08T15:50:23.741380+0000","last_clean":"2023-03-08T15:50:23.741380+0000","last_became_active":"2023-03-08T15:50:22.206987+0000","last_became_peered":"2023-03-08T15:50:22.206987+0000","last_unstale":"2023-03-08T15:50:23.741380+0000","last_undegraded":"2023-03-08T15:50:23.741380+0000","last_fullsized":"2023-03-08T15:50:23.741380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:34:43.108963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739335+0000","last_change":"2023-03-08T15:50:22.600091+0000","last_active":"2023-03-08T15:50:23.739335+0000","last_peered":"2023-03-08T15:50:23.739335+0000","last_clean":"2023-03-08T15:50:23.739335+0000","last_became_active":"2023-03-08T15:50:22.599830+0000","last_became_peered":"2023-03-08T15:50:22.599830+0000","last_unstale":"2023-03-08T15:50:23.739335+0000","last_undegraded":"2023-03-08T15:50:23.739335+0000","last_fullsized":"2023-03-08T15:50:23.739335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:24:06.766347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741006+0000","last_change":"2023-03-08T15:50:22.207518+0000","last_active":"2023-03-08T15:50:23.741006+0000","last_peered":"2023-03-08T15:50:23.741006+0000","last_clean":"2023-03-08T15:50:23.741006+0000","last_became_active":"2023-03-08T15:50:22.207089+0000","last_became_peered":"2023-03-08T15:50:22.207089+0000","last_unstale":"2023-03-08T15:50:23.741006+0000","last_undegraded":"2023-03-08T15:50:23.741006+0000","last_fullsized":"2023-03-08T15:50:23.741006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:11:48.032025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740806+0000","last_change":"2023-03-08T15:50:22.591453+0000","last_active":"2023-03-08T15:50:23.740806+0000","last_peered":"2023-03-08T15:50:23.740806+0000","last_clean":"2023-03-08T15:50:23.740806+0000","last_became_active":"2023-03-08T15:50:22.591104+0000","last_became_peered":"2023-03-08T15:50:22.591104+0000","last_unstale":"2023-03-08T15:50:23.740806+0000","last_undegraded":"2023-03-08T15:50:23.740806+0000","last_fullsized":"2023-03-08T15:50:23.740806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:10:55.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590120+0000","last_change":"2023-03-08T15:50:22.211091+0000","last_active":"2023-03-08T15:50:23.590120+0000","last_peered":"2023-03-08T15:50:23.590120+0000","last_clean":"2023-03-08T15:50:23.590120+0000","last_became_active":"2023-03-08T15:50:22.210820+0000","last_became_peered":"2023-03-08T15:50:22.210820+0000","last_unstale":"2023-03-08T15:50:23.590120+0000","last_undegraded":"2023-03-08T15:50:23.590120+0000","last_fullsized":"2023-03-08T15:50:23.590120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:44:59.090466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739328+0000","last_change":"2023-03-08T15:50:22.603229+0000","last_active":"2023-03-08T15:50:23.739328+0000","last_peered":"2023-03-08T15:50:23.739328+0000","last_clean":"2023-03-08T15:50:23.739328+0000","last_became_active":"2023-03-08T15:50:22.602968+0000","last_became_peered":"2023-03-08T15:50:22.602968+0000","last_unstale":"2023-03-08T15:50:23.739328+0000","last_undegraded":"2023-03-08T15:50:23.739328+0000","last_fullsized":"2023-03-08T15:50:23.739328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:34:21.494818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590105+0000","last_change":"2023-03-08T15:50:22.210488+0000","last_active":"2023-03-08T15:50:23.590105+0000","last_peered":"2023-03-08T15:50:23.590105+0000","last_clean":"2023-03-08T15:50:23.590105+0000","last_became_active":"2023-03-08T15:50:22.210203+0000","last_became_peered":"2023-03-08T15:50:22.210203+0000","last_unstale":"2023-03-08T15:50:23.590105+0000","last_undegraded":"2023-03-08T15:50:23.590105+0000","last_fullsized":"2023-03-08T15:50:23.590105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:15:38.744674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589731+0000","last_change":"2023-03-08T15:50:22.593478+0000","last_active":"2023-03-08T15:50:23.589731+0000","last_peered":"2023-03-08T15:50:23.589731+0000","last_clean":"2023-03-08T15:50:23.589731+0000","last_became_active":"2023-03-08T15:50:22.593209+0000","last_became_peered":"2023-03-08T15:50:22.593209+0000","last_unstale":"2023-03-08T15:50:23.589731+0000","last_undegraded":"2023-03-08T15:50:23.589731+0000","last_fullsized":"2023-03-08T15:50:23.589731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:10:55.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588559+0000","last_change":"2023-03-08T15:50:22.208909+0000","last_active":"2023-03-08T15:50:23.588559+0000","last_peered":"2023-03-08T15:50:23.588559+0000","last_clean":"2023-03-08T15:50:23.588559+0000","last_became_active":"2023-03-08T15:50:22.208712+0000","last_became_peered":"2023-03-08T15:50:22.208712+0000","last_unstale":"2023-03-08T15:50:23.588559+0000","last_undegraded":"2023-03-08T15:50:23.588559+0000","last_fullsized":"2023-03-08T15:50:23.588559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:08:46.537580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589051+0000","last_change":"2023-03-08T15:50:22.603882+0000","last_active":"2023-03-08T15:50:23.589051+0000","last_peered":"2023-03-08T15:50:23.589051+0000","last_clean":"2023-03-08T15:50:23.589051+0000","last_became_active":"2023-03-08T15:50:22.603682+0000","last_became_peered":"2023-03-08T15:50:22.603682+0000","last_unstale":"2023-03-08T15:50:23.589051+0000","last_undegraded":"2023-03-08T15:50:23.589051+0000","last_fullsized":"2023-03-08T15:50:23.589051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:26:12.855862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739697+0000","last_change":"2023-03-08T15:50:22.206153+0000","last_active":"2023-03-08T15:50:23.739697+0000","last_peered":"2023-03-08T15:50:23.739697+0000","last_clean":"2023-03-08T15:50:23.739697+0000","last_became_active":"2023-03-08T15:50:22.205578+0000","last_became_peered":"2023-03-08T15:50:22.205578+0000","last_unstale":"2023-03-08T15:50:23.739697+0000","last_undegraded":"2023-03-08T15:50:23.739697+0000","last_fullsized":"2023-03-08T15:50:23.739697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:48:41.012237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589922+0000","last_change":"2023-03-08T15:50:22.597588+0000","last_active":"2023-03-08T15:50:23.589922+0000","last_peered":"2023-03-08T15:50:23.589922+0000","last_clean":"2023-03-08T15:50:23.589922+0000","last_became_active":"2023-03-08T15:50:22.597335+0000","last_became_peered":"2023-03-08T15:50:22.597335+0000","last_unstale":"2023-03-08T15:50:23.589922+0000","last_undegraded":"2023-03-08T15:50:23.589922+0000","last_fullsized":"2023-03-08T15:50:23.589922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:55:42.607342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589066+0000","last_change":"2023-03-08T15:50:22.211335+0000","last_active":"2023-03-08T15:50:23.589066+0000","last_peered":"2023-03-08T15:50:23.589066+0000","last_clean":"2023-03-08T15:50:23.589066+0000","last_became_active":"2023-03-08T15:50:22.211061+0000","last_became_peered":"2023-03-08T15:50:22.211061+0000","last_unstale":"2023-03-08T15:50:23.589066+0000","last_undegraded":"2023-03-08T15:50:23.589066+0000","last_fullsized":"2023-03-08T15:50:23.589066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:43:15.311796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590139+0000","last_change":"2023-03-08T15:50:22.597782+0000","last_active":"2023-03-08T15:50:23.590139+0000","last_peered":"2023-03-08T15:50:23.590139+0000","last_clean":"2023-03-08T15:50:23.590139+0000","last_became_active":"2023-03-08T15:50:22.597544+0000","last_became_peered":"2023-03-08T15:50:22.597544+0000","last_unstale":"2023-03-08T15:50:23.590139+0000","last_undegraded":"2023-03-08T15:50:23.590139+0000","last_fullsized":"2023-03-08T15:50:23.590139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:31:50.246112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741070+0000","last_change":"2023-03-08T15:50:22.208793+0000","last_active":"2023-03-08T15:50:23.741070+0000","last_peered":"2023-03-08T15:50:23.741070+0000","last_clean":"2023-03-08T15:50:23.741070+0000","last_became_active":"2023-03-08T15:50:22.208560+0000","last_became_peered":"2023-03-08T15:50:22.208560+0000","last_unstale":"2023-03-08T15:50:23.741070+0000","last_undegraded":"2023-03-08T15:50:23.741070+0000","last_fullsized":"2023-03-08T15:50:23.741070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:36:30.225779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740932+0000","last_change":"2023-03-08T15:50:22.604918+0000","last_active":"2023-03-08T15:50:23.740932+0000","last_peered":"2023-03-08T15:50:23.740932+0000","last_clean":"2023-03-08T15:50:23.740932+0000","last_became_active":"2023-03-08T15:50:22.604603+0000","last_became_peered":"2023-03-08T15:50:22.604603+0000","last_unstale":"2023-03-08T15:50:23.740932+0000","last_undegraded":"2023-03-08T15:50:23.740932+0000","last_fullsized":"2023-03-08T15:50:23.740932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:10:55.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740563+0000","last_change":"2023-03-08T15:50:22.202026+0000","last_active":"2023-03-08T15:50:23.740563+0000","last_peered":"2023-03-08T15:50:23.740563+0000","last_clean":"2023-03-08T15:50:23.740563+0000","last_became_active":"2023-03-08T15:50:22.201667+0000","last_became_peered":"2023-03-08T15:50:22.201667+0000","last_unstale":"2023-03-08T15:50:23.740563+0000","last_undegraded":"2023-03-08T15:50:23.740563+0000","last_fullsized":"2023-03-08T15:50:23.740563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:16:06.181230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740471+0000","last_change":"2023-03-08T15:50:22.607089+0000","last_active":"2023-03-08T15:50:23.740471+0000","last_peered":"2023-03-08T15:50:23.740471+0000","last_clean":"2023-03-08T15:50:23.740471+0000","last_became_active":"2023-03-08T15:50:22.606796+0000","last_became_peered":"2023-03-08T15:50:22.606796+0000","last_unstale":"2023-03-08T15:50:23.740471+0000","last_undegraded":"2023-03-08T15:50:23.740471+0000","last_fullsized":"2023-03-08T15:50:23.740471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:42:51.830793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739958+0000","last_change":"2023-03-08T15:50:22.201782+0000","last_active":"2023-03-08T15:50:23.739958+0000","last_peered":"2023-03-08T15:50:23.739958+0000","last_clean":"2023-03-08T15:50:23.739958+0000","last_became_active":"2023-03-08T15:50:22.201513+0000","last_became_peered":"2023-03-08T15:50:22.201513+0000","last_unstale":"2023-03-08T15:50:23.739958+0000","last_undegraded":"2023-03-08T15:50:23.739958+0000","last_fullsized":"2023-03-08T15:50:23.739958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:57:54.877930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739865+0000","last_change":"2023-03-08T15:50:22.591622+0000","last_active":"2023-03-08T15:50:23.739865+0000","last_peered":"2023-03-08T15:50:23.739865+0000","last_clean":"2023-03-08T15:50:23.739865+0000","last_became_active":"2023-03-08T15:50:22.591367+0000","last_became_peered":"2023-03-08T15:50:22.591367+0000","last_unstale":"2023-03-08T15:50:23.739865+0000","last_undegraded":"2023-03-08T15:50:23.739865+0000","last_fullsized":"2023-03-08T15:50:23.739865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:36:31.227524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588755+0000","last_change":"2023-03-08T15:50:22.206328+0000","last_active":"2023-03-08T15:50:23.588755+0000","last_peered":"2023-03-08T15:50:23.588755+0000","last_clean":"2023-03-08T15:50:23.588755+0000","last_became_active":"2023-03-08T15:50:22.205631+0000","last_became_peered":"2023-03-08T15:50:22.205631+0000","last_unstale":"2023-03-08T15:50:23.588755+0000","last_undegraded":"2023-03-08T15:50:23.588755+0000","last_fullsized":"2023-03-08T15:50:23.588755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:16:17.949073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588974+0000","last_change":"2023-03-08T15:50:22.602958+0000","last_active":"2023-03-08T15:50:23.588974+0000","last_peered":"2023-03-08T15:50:23.588974+0000","last_clean":"2023-03-08T15:50:23.588974+0000","last_became_active":"2023-03-08T15:50:22.602704+0000","last_became_peered":"2023-03-08T15:50:22.602704+0000","last_unstale":"2023-03-08T15:50:23.588974+0000","last_undegraded":"2023-03-08T15:50:23.588974+0000","last_fullsized":"2023-03-08T15:50:23.588974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:17:07.676938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739863+0000","last_change":"2023-03-08T15:50:22.207246+0000","last_active":"2023-03-08T15:50:23.739863+0000","last_peered":"2023-03-08T15:50:23.739863+0000","last_clean":"2023-03-08T15:50:23.739863+0000","last_became_active":"2023-03-08T15:50:22.206984+0000","last_became_peered":"2023-03-08T15:50:22.206984+0000","last_unstale":"2023-03-08T15:50:23.739863+0000","last_undegraded":"2023-03-08T15:50:23.739863+0000","last_fullsized":"2023-03-08T15:50:23.739863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:58:29.820026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739337+0000","last_change":"2023-03-08T15:50:22.598901+0000","last_active":"2023-03-08T15:50:23.739337+0000","last_peered":"2023-03-08T15:50:23.739337+0000","last_clean":"2023-03-08T15:50:23.739337+0000","last_became_active":"2023-03-08T15:50:22.598648+0000","last_became_peered":"2023-03-08T15:50:22.598648+0000","last_unstale":"2023-03-08T15:50:23.739337+0000","last_undegraded":"2023-03-08T15:50:23.739337+0000","last_fullsized":"2023-03-08T15:50:23.739337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:16:33.069467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739753+0000","last_change":"2023-03-08T15:50:22.209211+0000","last_active":"2023-03-08T15:50:23.739753+0000","last_peered":"2023-03-08T15:50:23.739753+0000","last_clean":"2023-03-08T15:50:23.739753+0000","last_became_active":"2023-03-08T15:50:22.208958+0000","last_became_peered":"2023-03-08T15:50:22.208958+0000","last_unstale":"2023-03-08T15:50:23.739753+0000","last_undegraded":"2023-03-08T15:50:23.739753+0000","last_fullsized":"2023-03-08T15:50:23.739753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:48:41.012237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740334+0000","last_change":"2023-03-08T15:50:22.602998+0000","last_active":"2023-03-08T15:50:23.740334+0000","last_peered":"2023-03-08T15:50:23.740334+0000","last_clean":"2023-03-08T15:50:23.740334+0000","last_became_active":"2023-03-08T15:50:22.602715+0000","last_became_peered":"2023-03-08T15:50:22.602715+0000","last_unstale":"2023-03-08T15:50:23.740334+0000","last_undegraded":"2023-03-08T15:50:23.740334+0000","last_fullsized":"2023-03-08T15:50:23.740334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:16:07.182975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589158+0000","last_change":"2023-03-08T15:50:22.208057+0000","last_active":"2023-03-08T15:50:23.589158+0000","last_peered":"2023-03-08T15:50:23.589158+0000","last_clean":"2023-03-08T15:50:23.589158+0000","last_became_active":"2023-03-08T15:50:22.207538+0000","last_became_peered":"2023-03-08T15:50:22.207538+0000","last_unstale":"2023-03-08T15:50:23.589158+0000","last_undegraded":"2023-03-08T15:50:23.589158+0000","last_fullsized":"2023-03-08T15:50:23.589158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:08:46.537580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590014+0000","last_change":"2023-03-08T15:50:22.600734+0000","last_active":"2023-03-08T15:50:23.590014+0000","last_peered":"2023-03-08T15:50:23.590014+0000","last_clean":"2023-03-08T15:50:23.590014+0000","last_became_active":"2023-03-08T15:50:22.600332+0000","last_became_peered":"2023-03-08T15:50:22.600332+0000","last_unstale":"2023-03-08T15:50:23.590014+0000","last_undegraded":"2023-03-08T15:50:23.590014+0000","last_fullsized":"2023-03-08T15:50:23.590014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:42:51.830793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739514+0000","last_change":"2023-03-08T15:50:22.207532+0000","last_active":"2023-03-08T15:50:23.739514+0000","last_peered":"2023-03-08T15:50:23.739514+0000","last_clean":"2023-03-08T15:50:23.739514+0000","last_became_active":"2023-03-08T15:50:22.207275+0000","last_became_peered":"2023-03-08T15:50:22.207275+0000","last_unstale":"2023-03-08T15:50:23.739514+0000","last_undegraded":"2023-03-08T15:50:23.739514+0000","last_fullsized":"2023-03-08T15:50:23.739514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:50:47.067582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739219+0000","last_change":"2023-03-08T15:50:22.597592+0000","last_active":"2023-03-08T15:50:23.739219+0000","last_peered":"2023-03-08T15:50:23.739219+0000","last_clean":"2023-03-08T15:50:23.739219+0000","last_became_active":"2023-03-08T15:50:22.597318+0000","last_became_peered":"2023-03-08T15:50:22.597318+0000","last_unstale":"2023-03-08T15:50:23.739219+0000","last_undegraded":"2023-03-08T15:50:23.739219+0000","last_fullsized":"2023-03-08T15:50:23.739219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:51:16.866114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739500+0000","last_change":"2023-03-08T15:50:22.205356+0000","last_active":"2023-03-08T15:50:23.739500+0000","last_peered":"2023-03-08T15:50:23.739500+0000","last_clean":"2023-03-08T15:50:23.739500+0000","last_became_active":"2023-03-08T15:50:22.205099+0000","last_became_peered":"2023-03-08T15:50:22.205099+0000","last_unstale":"2023-03-08T15:50:23.739500+0000","last_undegraded":"2023-03-08T15:50:23.739500+0000","last_fullsized":"2023-03-08T15:50:23.739500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:11:48.032025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.595550+0000","last_change":"2023-03-08T15:49:34.914364+0000","last_active":"2023-03-08T15:50:22.595550+0000","last_peered":"2023-03-08T15:50:22.595550+0000","last_clean":"2023-03-08T15:50:22.595550+0000","last_became_active":"2023-03-08T15:49:34.914037+0000","last_became_peered":"2023-03-08T15:49:34.914037+0000","last_unstale":"2023-03-08T15:50:22.595550+0000","last_undegraded":"2023-03-08T15:50:22.595550+0000","last_fullsized":"2023-03-08T15:50:22.595550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:55:29.151326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590641+0000","last_change":"2023-03-08T15:50:22.601615+0000","last_active":"2023-03-08T15:50:23.590641+0000","last_peered":"2023-03-08T15:50:23.590641+0000","last_clean":"2023-03-08T15:50:23.590641+0000","last_became_active":"2023-03-08T15:50:22.601309+0000","last_became_peered":"2023-03-08T15:50:22.601309+0000","last_unstale":"2023-03-08T15:50:23.590641+0000","last_undegraded":"2023-03-08T15:50:23.590641+0000","last_fullsized":"2023-03-08T15:50:23.590641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:51:16.866114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739742+0000","last_change":"2023-03-08T15:50:22.208214+0000","last_active":"2023-03-08T15:50:23.739742+0000","last_peered":"2023-03-08T15:50:23.739742+0000","last_clean":"2023-03-08T15:50:23.739742+0000","last_became_active":"2023-03-08T15:50:22.207833+0000","last_became_peered":"2023-03-08T15:50:22.207833+0000","last_unstale":"2023-03-08T15:50:23.739742+0000","last_undegraded":"2023-03-08T15:50:23.739742+0000","last_fullsized":"2023-03-08T15:50:23.739742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:47:25.225365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.595091+0000","last_change":"2023-03-08T15:49:34.036801+0000","last_active":"2023-03-08T15:50:22.595091+0000","last_peered":"2023-03-08T15:50:22.595091+0000","last_clean":"2023-03-08T15:50:22.595091+0000","last_became_active":"2023-03-08T15:49:34.036484+0000","last_became_peered":"2023-03-08T15:49:34.036484+0000","last_unstale":"2023-03-08T15:50:22.595091+0000","last_undegraded":"2023-03-08T15:50:22.595091+0000","last_fullsized":"2023-03-08T15:50:22.595091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589374+0000","last_change":"2023-03-08T15:50:22.600798+0000","last_active":"2023-03-08T15:50:23.589374+0000","last_peered":"2023-03-08T15:50:23.589374+0000","last_clean":"2023-03-08T15:50:23.589374+0000","last_became_active":"2023-03-08T15:50:22.600366+0000","last_became_peered":"2023-03-08T15:50:22.600366+0000","last_unstale":"2023-03-08T15:50:23.589374+0000","last_undegraded":"2023-03-08T15:50:23.589374+0000","last_fullsized":"2023-03-08T15:50:23.589374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:24:06.766347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:25.249317+0000","last_change":"2023-03-08T15:50:22.201430+0000","last_active":"2023-03-08T15:50:25.249317+0000","last_peered":"2023-03-08T15:50:25.249317+0000","last_clean":"2023-03-08T15:50:25.249317+0000","last_became_active":"2023-03-08T15:50:22.201144+0000","last_became_peered":"2023-03-08T15:50:22.201144+0000","last_unstale":"2023-03-08T15:50:25.249317+0000","last_undegraded":"2023-03-08T15:50:25.249317+0000","last_fullsized":"2023-03-08T15:50:25.249317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:47:49.932364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.587182+0000","last_change":"2023-03-08T15:49:34.968598+0000","last_active":"2023-03-08T15:50:22.587182+0000","last_peered":"2023-03-08T15:50:22.587182+0000","last_clean":"2023-03-08T15:50:22.587182+0000","last_became_active":"2023-03-08T15:49:34.968300+0000","last_became_peered":"2023-03-08T15:49:34.968300+0000","last_unstale":"2023-03-08T15:50:22.587182+0000","last_undegraded":"2023-03-08T15:50:22.587182+0000","last_fullsized":"2023-03-08T15:50:22.587182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:39:14.985725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740971+0000","last_change":"2023-03-08T15:50:22.604679+0000","last_active":"2023-03-08T15:50:23.740971+0000","last_peered":"2023-03-08T15:50:23.740971+0000","last_clean":"2023-03-08T15:50:23.740971+0000","last_became_active":"2023-03-08T15:50:22.602935+0000","last_became_peered":"2023-03-08T15:50:22.602935+0000","last_unstale":"2023-03-08T15:50:23.740971+0000","last_undegraded":"2023-03-08T15:50:23.740971+0000","last_fullsized":"2023-03-08T15:50:23.740971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:33:34.133823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589360+0000","last_change":"2023-03-08T15:50:22.207122+0000","last_active":"2023-03-08T15:50:23.589360+0000","last_peered":"2023-03-08T15:50:23.589360+0000","last_clean":"2023-03-08T15:50:23.589360+0000","last_became_active":"2023-03-08T15:50:22.206851+0000","last_became_peered":"2023-03-08T15:50:22.206851+0000","last_unstale":"2023-03-08T15:50:23.589360+0000","last_undegraded":"2023-03-08T15:50:23.589360+0000","last_fullsized":"2023-03-08T15:50:23.589360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:47:25.225365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.595099+0000","last_change":"2023-03-08T15:49:34.042076+0000","last_active":"2023-03-08T15:50:22.595099+0000","last_peered":"2023-03-08T15:50:22.595099+0000","last_clean":"2023-03-08T15:50:22.595099+0000","last_became_active":"2023-03-08T15:49:34.041670+0000","last_became_peered":"2023-03-08T15:49:34.041670+0000","last_unstale":"2023-03-08T15:50:22.595099+0000","last_undegraded":"2023-03-08T15:50:22.595099+0000","last_fullsized":"2023-03-08T15:50:22.595099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:46:37.870016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.591908+0000","last_change":"2023-03-08T15:49:27.814075+0000","last_active":"2023-03-08T15:50:22.591908+0000","last_peered":"2023-03-08T15:50:22.591908+0000","last_clean":"2023-03-08T15:50:22.591908+0000","last_became_active":"2023-03-08T15:49:27.813798+0000","last_became_peered":"2023-03-08T15:49:27.813798+0000","last_unstale":"2023-03-08T15:50:22.591908+0000","last_undegraded":"2023-03-08T15:50:22.591908+0000","last_fullsized":"2023-03-08T15:50:22.591908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_clean_scrub_stamp":"2023-03-08T15:49:26.430262+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:31:30.865216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588884+0000","last_change":"2023-03-08T15:50:22.604411+0000","last_active":"2023-03-08T15:50:23.588884+0000","last_peered":"2023-03-08T15:50:23.588884+0000","last_clean":"2023-03-08T15:50:23.588884+0000","last_became_active":"2023-03-08T15:50:22.604150+0000","last_became_peered":"2023-03-08T15:50:22.604150+0000","last_unstale":"2023-03-08T15:50:23.588884+0000","last_undegraded":"2023-03-08T15:50:23.588884+0000","last_fullsized":"2023-03-08T15:50:23.588884+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:17:07.676938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741077+0000","last_change":"2023-03-08T15:50:22.204855+0000","last_active":"2023-03-08T15:50:23.741077+0000","last_peered":"2023-03-08T15:50:23.741077+0000","last_clean":"2023-03-08T15:50:23.741077+0000","last_became_active":"2023-03-08T15:50:22.203711+0000","last_became_peered":"2023-03-08T15:50:22.203711+0000","last_unstale":"2023-03-08T15:50:23.741077+0000","last_undegraded":"2023-03-08T15:50:23.741077+0000","last_fullsized":"2023-03-08T15:50:23.741077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:33:43.566573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.591996+0000","last_change":"2023-03-08T15:49:34.042085+0000","last_active":"2023-03-08T15:50:22.591996+0000","last_peered":"2023-03-08T15:50:22.591996+0000","last_clean":"2023-03-08T15:50:22.591996+0000","last_became_active":"2023-03-08T15:49:34.041754+0000","last_became_peered":"2023-03-08T15:49:34.041754+0000","last_unstale":"2023-03-08T15:50:22.591996+0000","last_undegraded":"2023-03-08T15:50:22.591996+0000","last_fullsized":"2023-03-08T15:50:22.591996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588557+0000","last_change":"2023-03-08T15:50:22.609901+0000","last_active":"2023-03-08T15:50:23.588557+0000","last_peered":"2023-03-08T15:50:23.588557+0000","last_clean":"2023-03-08T15:50:23.588557+0000","last_became_active":"2023-03-08T15:50:22.609457+0000","last_became_peered":"2023-03-08T15:50:22.609457+0000","last_unstale":"2023-03-08T15:50:23.588557+0000","last_undegraded":"2023-03-08T15:50:23.588557+0000","last_fullsized":"2023-03-08T15:50:23.588557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:25:23.301855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739874+0000","last_change":"2023-03-08T15:50:22.206262+0000","last_active":"2023-03-08T15:50:23.739874+0000","last_peered":"2023-03-08T15:50:23.739874+0000","last_clean":"2023-03-08T15:50:23.739874+0000","last_became_active":"2023-03-08T15:50:22.205933+0000","last_became_peered":"2023-03-08T15:50:22.205933+0000","last_unstale":"2023-03-08T15:50:23.739874+0000","last_undegraded":"2023-03-08T15:50:23.739874+0000","last_fullsized":"2023-03-08T15:50:23.739874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:57:54.877930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.596191+0000","last_change":"2023-03-08T15:49:34.914757+0000","last_active":"2023-03-08T15:50:22.596191+0000","last_peered":"2023-03-08T15:50:22.596191+0000","last_clean":"2023-03-08T15:50:22.596191+0000","last_became_active":"2023-03-08T15:49:34.914391+0000","last_became_peered":"2023-03-08T15:49:34.914391+0000","last_unstale":"2023-03-08T15:50:22.596191+0000","last_undegraded":"2023-03-08T15:50:22.596191+0000","last_fullsized":"2023-03-08T15:50:22.596191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:09:02.620210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740868+0000","last_change":"2023-03-08T15:50:22.594793+0000","last_active":"2023-03-08T15:50:23.740868+0000","last_peered":"2023-03-08T15:50:23.740868+0000","last_clean":"2023-03-08T15:50:23.740868+0000","last_became_active":"2023-03-08T15:50:22.594549+0000","last_became_peered":"2023-03-08T15:50:22.594549+0000","last_unstale":"2023-03-08T15:50:23.740868+0000","last_undegraded":"2023-03-08T15:50:23.740868+0000","last_fullsized":"2023-03-08T15:50:23.740868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:35:45.961519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740802+0000","last_change":"2023-03-08T15:50:22.203091+0000","last_active":"2023-03-08T15:50:23.740802+0000","last_peered":"2023-03-08T15:50:23.740802+0000","last_clean":"2023-03-08T15:50:23.740802+0000","last_became_active":"2023-03-08T15:50:22.202820+0000","last_became_peered":"2023-03-08T15:50:22.202820+0000","last_unstale":"2023-03-08T15:50:23.740802+0000","last_undegraded":"2023-03-08T15:50:23.740802+0000","last_fullsized":"2023-03-08T15:50:23.740802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:26:11.854116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.596213+0000","last_change":"2023-03-08T15:49:34.039636+0000","last_active":"2023-03-08T15:50:22.596213+0000","last_peered":"2023-03-08T15:50:22.596213+0000","last_clean":"2023-03-08T15:50:22.596213+0000","last_became_active":"2023-03-08T15:49:34.039383+0000","last_became_peered":"2023-03-08T15:49:34.039383+0000","last_unstale":"2023-03-08T15:50:22.596213+0000","last_undegraded":"2023-03-08T15:50:22.596213+0000","last_fullsized":"2023-03-08T15:50:22.596213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:27:38.358539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589303+0000","last_change":"2023-03-08T15:50:22.599278+0000","last_active":"2023-03-08T15:50:23.589303+0000","last_peered":"2023-03-08T15:50:23.589303+0000","last_clean":"2023-03-08T15:50:23.589303+0000","last_became_active":"2023-03-08T15:50:22.598996+0000","last_became_peered":"2023-03-08T15:50:22.598996+0000","last_unstale":"2023-03-08T15:50:23.589303+0000","last_undegraded":"2023-03-08T15:50:23.589303+0000","last_fullsized":"2023-03-08T15:50:23.589303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:51:16.866114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589741+0000","last_change":"2023-03-08T15:50:22.206439+0000","last_active":"2023-03-08T15:50:23.589741+0000","last_peered":"2023-03-08T15:50:23.589741+0000","last_clean":"2023-03-08T15:50:23.589741+0000","last_became_active":"2023-03-08T15:50:22.206142+0000","last_became_peered":"2023-03-08T15:50:22.206142+0000","last_unstale":"2023-03-08T15:50:23.589741+0000","last_undegraded":"2023-03-08T15:50:23.589741+0000","last_fullsized":"2023-03-08T15:50:23.589741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:34:43.108963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.591176+0000","last_change":"2023-03-08T15:49:34.040711+0000","last_active":"2023-03-08T15:50:22.591176+0000","last_peered":"2023-03-08T15:50:22.591176+0000","last_clean":"2023-03-08T15:50:22.591176+0000","last_became_active":"2023-03-08T15:49:34.040328+0000","last_became_peered":"2023-03-08T15:49:34.040328+0000","last_unstale":"2023-03-08T15:50:22.591176+0000","last_undegraded":"2023-03-08T15:50:22.591176+0000","last_fullsized":"2023-03-08T15:50:22.591176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:34:43.169713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9556,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362284,"statfs":{"total":96636764160,"available":96626978816,"internally_reserved":0,"allocated":995328,"data_stored":748840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8324,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363516,"statfs":{"total":96636764160,"available":96628240384,"internally_reserved":0,"allocated":389120,"data_stored":157420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.439}]},{"osd":1,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56699999999999995}]},{"osd":2,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.54300000000000004}]},{"osd":3,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.626}]},{"osd":5,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66100000000000003}]},{"osd":7,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":389120,"data_stored":156944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9480,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362360,"statfs":{"total":96636764160,"available":96627056640,"internally_reserved":0,"allocated":983040,"data_stored":747256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":12.048,"5min":12.048,"15min":12.048},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.33100000000000002}]},{"osd":2,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":19.98,"5min":19.98,"15min":19.98},"last":0.38600000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":12.157,"5min":12.157,"15min":12.157},"last":0.37}]},{"osd":3,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":12.013999999999999,"5min":12.013999999999999,"15min":12.013999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":9.1579999999999995,"5min":9.1579999999999995,"15min":9.1579999999999995},"last":0.437}]},{"osd":4,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":12.132,"5min":12.132,"15min":12.132},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":11.964,"5min":11.964,"15min":11.964},"last":0.45800000000000002}]},{"osd":5,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":11.929,"5min":11.929,"15min":11.929},"last":0.50600000000000001},{"interface":"front","average":{"1min":1.752,"5min":1.752,"15min":1.752},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":19.923999999999999,"5min":19.923999999999999,"15min":19.923999999999999},"last":0.48799999999999999}]},{"osd":6,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":19.957000000000001,"5min":19.957000000000001,"15min":19.957000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":12.082000000000001,"5min":12.082000000000001,"15min":12.082000000000001},"last":0.47799999999999998}]},{"osd":7,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":12.106,"5min":12.106,"15min":12.106},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":11.99,"5min":11.99,"15min":11.99},"last":0.55900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8324,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363516,"statfs":{"total":96636764160,"available":96628240384,"internally_reserved":0,"allocated":389120,"data_stored":156924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8464,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363376,"statfs":{"total":96636764160,"available":96628097024,"internally_reserved":0,"allocated":401408,"data_stored":158436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.215}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8520,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363320,"statfs":{"total":96636764160,"available":96628039680,"internally_reserved":0,"allocated":393216,"data_stored":157442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8392,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363448,"statfs":{"total":96636764160,"available":96628170752,"internally_reserved":0,"allocated":393216,"data_stored":156966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-08T15:50:31.494 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-08T15:50:31.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.630+0000 7fee6fe6e700 1 Processor -- start 2023-03-08T15:50:31.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.630+0000 7fee6fe6e700 1 -- start start 2023-03-08T15:50:31.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6fe6e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee680bb350 0x7fee681446b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:31.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6fe6e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fee68144bf0 0x7fee680bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:31.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6fe6e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680be1f0 0x7fee6814e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:31.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6fe6e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6814dc00 con 0x7fee680bb350 2023-03-08T15:50:31.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6fe6e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6806bb70 con 0x7fee68144bf0 2023-03-08T15:50:31.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6fe6e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee680b9fc0 con 0x7fee680be1f0 2023-03-08T15:50:31.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6dc0a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee680bb350 0x7fee681446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:31.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6dc0a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee680bb350 0x7fee681446b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35544/0 (socket says 172.21.15.123:35544) 2023-03-08T15:50:31.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6dc0a700 1 -- 172.21.15.123:0/699156604 learned_addr learned my addr 172.21.15.123:0/699156604 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:31.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6e40b700 1 --2- 172.21.15.123:0/699156604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680be1f0 0x7fee6814e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:31.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6dc0a700 1 -- 172.21.15.123:0/699156604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680be1f0 msgr2=0x7fee6814e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:31.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6dc0a700 1 --2- 172.21.15.123:0/699156604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680be1f0 0x7fee6814e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:31.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6dc0a700 1 -- 172.21.15.123:0/699156604 >> v2:172.21.15.175:3300/0 conn(0x7fee68144bf0 msgr2=0x7fee680bdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:31.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6dc0a700 1 --2- 172.21.15.123:0/699156604 >> v2:172.21.15.175:3300/0 conn(0x7fee68144bf0 0x7fee680bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:31.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6dc0a700 1 -- 172.21.15.123:0/699156604 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee680ba2a0 con 0x7fee680bb350 2023-03-08T15:50:31.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6e40b700 1 --2- 172.21.15.123:0/699156604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680be1f0 0x7fee6814e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:31.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6dc0a700 1 --2- 172.21.15.123:0/699156604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee680bb350 0x7fee681446b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fee680bbfc0 tx=0x7fee64009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75940d52bf9f13d8 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:31.636 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6cc08700 1 -- 172.21.15.123:0/699156604 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6400b870 con 0x7fee680bb350 2023-03-08T15:50:31.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6cc08700 1 -- 172.21.15.123:0/699156604 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6400b9d0 con 0x7fee680bb350 2023-03-08T15:50:31.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.631+0000 7fee6cc08700 1 -- 172.21.15.123:0/699156604 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6400bd60 con 0x7fee680bb350 2023-03-08T15:50:31.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.632+0000 7fee6fe6e700 1 -- 172.21.15.123:0/699156604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee680bb350 msgr2=0x7fee681446b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:31.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.632+0000 7fee6fe6e700 1 --2- 172.21.15.123:0/699156604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee680bb350 0x7fee681446b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fee680bbfc0 tx=0x7fee64009bd0 comp rx=0 tx=0).stop 2023-03-08T15:50:31.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.632+0000 7fee6fe6e700 1 -- 172.21.15.123:0/699156604 shutdown_connections 2023-03-08T15:50:31.637 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.632+0000 7fee6fe6e700 1 --2- 172.21.15.123:0/699156604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680be1f0 0x7fee6814e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:31.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.632+0000 7fee6fe6e700 1 --2- 172.21.15.123:0/699156604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee680bb350 0x7fee681446b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:31.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.632+0000 7fee6fe6e700 1 --2- 172.21.15.123:0/699156604 >> v2:172.21.15.175:3300/0 conn(0x7fee68144bf0 0x7fee680bdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:31.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.632+0000 7fee6fe6e700 1 -- 172.21.15.123:0/699156604 >> 172.21.15.123:0/699156604 conn(0x7fee6806a250 msgr2=0x7fee6806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:31.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.632+0000 7fee6fe6e700 1 -- 172.21.15.123:0/699156604 shutdown_connections 2023-03-08T15:50:31.638 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.632+0000 7fee6fe6e700 1 -- 172.21.15.123:0/699156604 wait complete. 2023-03-08T15:50:31.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.633+0000 7fee6fe6e700 1 Processor -- start 2023-03-08T15:50:31.640 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.633+0000 7fee6fe6e700 1 -- start start 2023-03-08T15:50:31.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6fe6e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee680bb350 0x7fee681e0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:31.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6fe6e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680be1f0 0x7fee681d4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:31.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6fe6e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee68144bf0 0x7fee68136ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:31.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6fe6e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee681d4570 con 0x7fee68144bf0 2023-03-08T15:50:31.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6fe6e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68142b60 con 0x7fee680bb350 2023-03-08T15:50:31.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6fe6e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee68136ff0 con 0x7fee680be1f0 2023-03-08T15:50:31.641 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6e40b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee68144bf0 0x7fee68136ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:31.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6e40b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee68144bf0 0x7fee68136ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35558/0 (socket says 172.21.15.123:35558) 2023-03-08T15:50:31.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6e40b700 1 -- 172.21.15.123:0/1018233750 learned_addr learned my addr 172.21.15.123:0/1018233750 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:31.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6dc0a700 1 --2- 172.21.15.123:0/1018233750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee680bb350 0x7fee681e0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:31.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6d409700 1 --2- 172.21.15.123:0/1018233750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680be1f0 0x7fee681d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:31.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6e40b700 1 -- 172.21.15.123:0/1018233750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680be1f0 msgr2=0x7fee681d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:31.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6e40b700 1 --2- 172.21.15.123:0/1018233750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680be1f0 0x7fee681d4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:31.642 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6e40b700 1 -- 172.21.15.123:0/1018233750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee680bb350 msgr2=0x7fee681e0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:31.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6e40b700 1 --2- 172.21.15.123:0/1018233750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee680bb350 0x7fee681e0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:31.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6e40b700 1 -- 172.21.15.123:0/1018233750 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee64009550 con 0x7fee68144bf0 2023-03-08T15:50:31.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6e40b700 1 --2- 172.21.15.123:0/1018233750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee68144bf0 0x7fee68136ab0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fee6000cf20 tx=0x7fee6000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:31.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee5e7fc700 1 -- 172.21.15.123:0/1018233750 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000ae10 con 0x7fee68144bf0 2023-03-08T15:50:31.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee5e7fc700 1 -- 172.21.15.123:0/1018233750 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee60015440 con 0x7fee68144bf0 2023-03-08T15:50:31.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee6fe6e700 1 -- 172.21.15.123:0/1018233750 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee680bb720 con 0x7fee68144bf0 2023-03-08T15:50:31.643 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.634+0000 7fee5e7fc700 1 -- 172.21.15.123:0/1018233750 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600157f0 con 0x7fee68144bf0 2023-03-08T15:50:31.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.635+0000 7fee6fe6e700 1 -- 172.21.15.123:0/1018233750 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee680ba580 con 0x7fee68144bf0 2023-03-08T15:50:31.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.635+0000 7fee6fe6e700 1 -- 172.21.15.123:0/1018233750 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6814e5d0 con 0x7fee68144bf0 2023-03-08T15:50:31.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.636+0000 7fee5e7fc700 1 -- 172.21.15.123:0/1018233750 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fee6001c030 con 0x7fee68144bf0 2023-03-08T15:50:31.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.636+0000 7fee5e7fc700 1 --2- 172.21.15.123:0/1018233750 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee4c0698d0 0x7fee4c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:31.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.636+0000 7fee5e7fc700 1 -- 172.21.15.123:0/1018233750 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee60087a40 con 0x7fee68144bf0 2023-03-08T15:50:31.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.636+0000 7fee6dc0a700 1 --2- 172.21.15.123:0/1018233750 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee4c0698d0 0x7fee4c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:31.644 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.637+0000 7fee6dc0a700 1 --2- 172.21.15.123:0/1018233750 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee4c0698d0 0x7fee4c06bd80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fee64000c00 tx=0x7fee64008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:31.645 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.641+0000 7fee5e7fc700 1 -- 172.21.15.123:0/1018233750 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fee60053810 con 0x7fee68144bf0 2023-03-08T15:50:31.824 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.823+0000 7fee6fe6e700 1 -- 172.21.15.123:0/1018233750 --> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fee681367d0 con 0x7fee4c0698d0 2023-03-08T15:50:31.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.830+0000 7fee5e7fc700 1 -- 172.21.15.123:0/1018233750 <== mgr.4098 v2:172.21.15.123:6832/142884 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+292649 (secure 0 0 0) 0x7fee681367d0 con 0x7fee4c0698d0 2023-03-08T15:50:31.834 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:31.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.833+0000 7fee6fe6e700 1 -- 172.21.15.123:0/1018233750 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee4c0698d0 msgr2=0x7fee4c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:31.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.833+0000 7fee6fe6e700 1 --2- 172.21.15.123:0/1018233750 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee4c0698d0 0x7fee4c06bd80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fee64000c00 tx=0x7fee64008030 comp rx=0 tx=0).stop 2023-03-08T15:50:31.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.833+0000 7fee6fe6e700 1 -- 172.21.15.123:0/1018233750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee68144bf0 msgr2=0x7fee68136ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:31.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.833+0000 7fee6fe6e700 1 --2- 172.21.15.123:0/1018233750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee68144bf0 0x7fee68136ab0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fee6000cf20 tx=0x7fee6000cf50 comp rx=0 tx=0).stop 2023-03-08T15:50:31.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.833+0000 7fee6fe6e700 1 -- 172.21.15.123:0/1018233750 shutdown_connections 2023-03-08T15:50:31.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.833+0000 7fee6fe6e700 1 --2- 172.21.15.123:0/1018233750 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee68144bf0 0x7fee68136ab0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:31.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.833+0000 7fee6fe6e700 1 --2- 172.21.15.123:0/1018233750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee680bb350 0x7fee681e0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:31.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.833+0000 7fee6fe6e700 1 --2- 172.21.15.123:0/1018233750 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fee4c0698d0 0x7fee4c06bd80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:31.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.833+0000 7fee6fe6e700 1 --2- 172.21.15.123:0/1018233750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680be1f0 0x7fee681d4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:31.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.833+0000 7fee6fe6e700 1 -- 172.21.15.123:0/1018233750 >> 172.21.15.123:0/1018233750 conn(0x7fee6806a250 msgr2=0x7fee680bcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:31.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.833+0000 7fee6fe6e700 1 -- 172.21.15.123:0/1018233750 shutdown_connections 2023-03-08T15:50:31.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:31.833+0000 7fee6fe6e700 1 -- 172.21.15.123:0/1018233750 wait complete. 2023-03-08T15:50:31.838 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2023-03-08T15:50:31.847 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-03-08T15:50:29.983071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69512,"kb_used_data":4232,"kb_used_omap":0,"kb_used_meta":65216,"kb_avail":754905208,"statfs":{"total":773094113280,"available":773022932992,"internally_reserved":0,"allocated":4333568,"data_stored":2440228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66781184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.792537"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590238+0000","last_change":"2023-03-08T15:50:22.596656+0000","last_active":"2023-03-08T15:50:23.590238+0000","last_peered":"2023-03-08T15:50:23.590238+0000","last_clean":"2023-03-08T15:50:23.590238+0000","last_became_active":"2023-03-08T15:50:22.596439+0000","last_became_peered":"2023-03-08T15:50:22.596439+0000","last_unstale":"2023-03-08T15:50:23.590238+0000","last_undegraded":"2023-03-08T15:50:23.590238+0000","last_fullsized":"2023-03-08T15:50:23.590238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:27:26.193162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590593+0000","last_change":"2023-03-08T15:50:22.600482+0000","last_active":"2023-03-08T15:50:23.590593+0000","last_peered":"2023-03-08T15:50:23.590593+0000","last_clean":"2023-03-08T15:50:23.590593+0000","last_became_active":"2023-03-08T15:50:22.600245+0000","last_became_peered":"2023-03-08T15:50:22.600245+0000","last_unstale":"2023-03-08T15:50:23.590593+0000","last_undegraded":"2023-03-08T15:50:23.590593+0000","last_fullsized":"2023-03-08T15:50:23.590593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:24:06.766347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739669+0000","last_change":"2023-03-08T15:50:22.605196+0000","last_active":"2023-03-08T15:50:23.739669+0000","last_peered":"2023-03-08T15:50:23.739669+0000","last_clean":"2023-03-08T15:50:23.739669+0000","last_became_active":"2023-03-08T15:50:22.604931+0000","last_became_peered":"2023-03-08T15:50:22.604931+0000","last_unstale":"2023-03-08T15:50:23.739669+0000","last_undegraded":"2023-03-08T15:50:23.739669+0000","last_fullsized":"2023-03-08T15:50:23.739669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:52:57.034947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739905+0000","last_change":"2023-03-08T15:50:22.601325+0000","last_active":"2023-03-08T15:50:23.739905+0000","last_peered":"2023-03-08T15:50:23.739905+0000","last_clean":"2023-03-08T15:50:23.739905+0000","last_became_active":"2023-03-08T15:50:22.600553+0000","last_became_peered":"2023-03-08T15:50:22.600553+0000","last_unstale":"2023-03-08T15:50:23.739905+0000","last_undegraded":"2023-03-08T15:50:23.739905+0000","last_fullsized":"2023-03-08T15:50:23.739905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:33:44.568318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739780+0000","last_change":"2023-03-08T15:50:22.588380+0000","last_active":"2023-03-08T15:50:23.739780+0000","last_peered":"2023-03-08T15:50:23.739780+0000","last_clean":"2023-03-08T15:50:23.739780+0000","last_became_active":"2023-03-08T15:50:22.587956+0000","last_became_peered":"2023-03-08T15:50:22.587956+0000","last_unstale":"2023-03-08T15:50:23.739780+0000","last_undegraded":"2023-03-08T15:50:23.739780+0000","last_fullsized":"2023-03-08T15:50:23.739780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:08:47.539325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588458+0000","last_change":"2023-03-08T15:50:22.603255+0000","last_active":"2023-03-08T15:50:23.588458+0000","last_peered":"2023-03-08T15:50:23.588458+0000","last_clean":"2023-03-08T15:50:23.588458+0000","last_became_active":"2023-03-08T15:50:22.603003+0000","last_became_peered":"2023-03-08T15:50:22.603003+0000","last_unstale":"2023-03-08T15:50:23.588458+0000","last_undegraded":"2023-03-08T15:50:23.588458+0000","last_fullsized":"2023-03-08T15:50:23.588458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:59:11.490643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740117+0000","last_change":"2023-03-08T15:50:22.608831+0000","last_active":"2023-03-08T15:50:23.740117+0000","last_peered":"2023-03-08T15:50:23.740117+0000","last_clean":"2023-03-08T15:50:23.740117+0000","last_became_active":"2023-03-08T15:50:22.608552+0000","last_became_peered":"2023-03-08T15:50:22.608552+0000","last_unstale":"2023-03-08T15:50:23.740117+0000","last_undegraded":"2023-03-08T15:50:23.740117+0000","last_fullsized":"2023-03-08T15:50:23.740117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:11:30.454793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589702+0000","last_change":"2023-03-08T15:50:22.603508+0000","last_active":"2023-03-08T15:50:23.589702+0000","last_peered":"2023-03-08T15:50:23.589702+0000","last_clean":"2023-03-08T15:50:23.589702+0000","last_became_active":"2023-03-08T15:50:22.603239+0000","last_became_peered":"2023-03-08T15:50:22.603239+0000","last_unstale":"2023-03-08T15:50:23.589702+0000","last_undegraded":"2023-03-08T15:50:23.589702+0000","last_fullsized":"2023-03-08T15:50:23.589702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:44:30.324678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740146+0000","last_change":"2023-03-08T15:50:22.604065+0000","last_active":"2023-03-08T15:50:23.740146+0000","last_peered":"2023-03-08T15:50:23.740146+0000","last_clean":"2023-03-08T15:50:23.740146+0000","last_became_active":"2023-03-08T15:50:22.603808+0000","last_became_peered":"2023-03-08T15:50:22.603808+0000","last_unstale":"2023-03-08T15:50:23.740146+0000","last_undegraded":"2023-03-08T15:50:23.740146+0000","last_fullsized":"2023-03-08T15:50:23.740146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:16:07.182975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741187+0000","last_change":"2023-03-08T15:50:22.603814+0000","last_active":"2023-03-08T15:50:23.741187+0000","last_peered":"2023-03-08T15:50:23.741187+0000","last_clean":"2023-03-08T15:50:23.741187+0000","last_became_active":"2023-03-08T15:50:22.603454+0000","last_became_peered":"2023-03-08T15:50:22.603454+0000","last_unstale":"2023-03-08T15:50:23.741187+0000","last_undegraded":"2023-03-08T15:50:23.741187+0000","last_fullsized":"2023-03-08T15:50:23.741187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:42:51.830793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741014+0000","last_change":"2023-03-08T15:50:22.601985+0000","last_active":"2023-03-08T15:50:23.741014+0000","last_peered":"2023-03-08T15:50:23.741014+0000","last_clean":"2023-03-08T15:50:23.741014+0000","last_became_active":"2023-03-08T15:50:22.601742+0000","last_became_peered":"2023-03-08T15:50:22.601742+0000","last_unstale":"2023-03-08T15:50:23.741014+0000","last_undegraded":"2023-03-08T15:50:23.741014+0000","last_fullsized":"2023-03-08T15:50:23.741014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:24:06.766347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739581+0000","last_change":"2023-03-08T15:50:22.599787+0000","last_active":"2023-03-08T15:50:23.739581+0000","last_peered":"2023-03-08T15:50:23.739581+0000","last_clean":"2023-03-08T15:50:23.739581+0000","last_became_active":"2023-03-08T15:50:22.599526+0000","last_became_peered":"2023-03-08T15:50:22.599526+0000","last_unstale":"2023-03-08T15:50:23.739581+0000","last_undegraded":"2023-03-08T15:50:23.739581+0000","last_fullsized":"2023-03-08T15:50:23.739581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:26:12.855862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740573+0000","last_change":"2023-03-08T15:50:22.604976+0000","last_active":"2023-03-08T15:50:23.740573+0000","last_peered":"2023-03-08T15:50:23.740573+0000","last_clean":"2023-03-08T15:50:23.740573+0000","last_became_active":"2023-03-08T15:50:22.604689+0000","last_became_peered":"2023-03-08T15:50:22.604689+0000","last_unstale":"2023-03-08T15:50:23.740573+0000","last_undegraded":"2023-03-08T15:50:23.740573+0000","last_fullsized":"2023-03-08T15:50:23.740573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:55:42.607342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741047+0000","last_change":"2023-03-08T15:50:22.601313+0000","last_active":"2023-03-08T15:50:23.741047+0000","last_peered":"2023-03-08T15:50:23.741047+0000","last_clean":"2023-03-08T15:50:23.741047+0000","last_became_active":"2023-03-08T15:50:22.600497+0000","last_became_peered":"2023-03-08T15:50:22.600497+0000","last_unstale":"2023-03-08T15:50:23.741047+0000","last_undegraded":"2023-03-08T15:50:23.741047+0000","last_fullsized":"2023-03-08T15:50:23.741047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:36:52.143769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740267+0000","last_change":"2023-03-08T15:50:22.601401+0000","last_active":"2023-03-08T15:50:23.740267+0000","last_peered":"2023-03-08T15:50:23.740267+0000","last_clean":"2023-03-08T15:50:23.740267+0000","last_became_active":"2023-03-08T15:50:22.601069+0000","last_became_peered":"2023-03-08T15:50:22.601069+0000","last_unstale":"2023-03-08T15:50:23.740267+0000","last_undegraded":"2023-03-08T15:50:23.740267+0000","last_fullsized":"2023-03-08T15:50:23.740267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:51:16.866114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588921+0000","last_change":"2023-03-08T15:50:22.605255+0000","last_active":"2023-03-08T15:50:23.588921+0000","last_peered":"2023-03-08T15:50:23.588921+0000","last_clean":"2023-03-08T15:50:23.588921+0000","last_became_active":"2023-03-08T15:50:22.604837+0000","last_became_peered":"2023-03-08T15:50:22.604837+0000","last_unstale":"2023-03-08T15:50:23.588921+0000","last_undegraded":"2023-03-08T15:50:23.588921+0000","last_fullsized":"2023-03-08T15:50:23.588921+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:34:21.494818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589500+0000","last_change":"2023-03-08T15:50:22.606733+0000","last_active":"2023-03-08T15:50:23.589500+0000","last_peered":"2023-03-08T15:50:23.589500+0000","last_clean":"2023-03-08T15:50:23.589500+0000","last_became_active":"2023-03-08T15:50:22.606475+0000","last_became_peered":"2023-03-08T15:50:22.606475+0000","last_unstale":"2023-03-08T15:50:23.589500+0000","last_undegraded":"2023-03-08T15:50:23.589500+0000","last_fullsized":"2023-03-08T15:50:23.589500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:33:34.133823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740335+0000","last_change":"2023-03-08T15:50:22.599399+0000","last_active":"2023-03-08T15:50:23.740335+0000","last_peered":"2023-03-08T15:50:23.740335+0000","last_clean":"2023-03-08T15:50:23.740335+0000","last_became_active":"2023-03-08T15:50:22.599099+0000","last_became_peered":"2023-03-08T15:50:22.599099+0000","last_unstale":"2023-03-08T15:50:23.740335+0000","last_undegraded":"2023-03-08T15:50:23.740335+0000","last_fullsized":"2023-03-08T15:50:23.740335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:47:26.227110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740012+0000","last_change":"2023-03-08T15:50:22.602805+0000","last_active":"2023-03-08T15:50:23.740012+0000","last_peered":"2023-03-08T15:50:23.740012+0000","last_clean":"2023-03-08T15:50:23.740012+0000","last_became_active":"2023-03-08T15:50:22.602548+0000","last_became_peered":"2023-03-08T15:50:22.602548+0000","last_unstale":"2023-03-08T15:50:23.740012+0000","last_undegraded":"2023-03-08T15:50:23.740012+0000","last_fullsized":"2023-03-08T15:50:23.740012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:47:26.227110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740582+0000","last_change":"2023-03-08T15:50:22.599369+0000","last_active":"2023-03-08T15:50:23.740582+0000","last_peered":"2023-03-08T15:50:23.740582+0000","last_clean":"2023-03-08T15:50:23.740582+0000","last_became_active":"2023-03-08T15:50:22.599081+0000","last_became_peered":"2023-03-08T15:50:22.599081+0000","last_unstale":"2023-03-08T15:50:23.740582+0000","last_undegraded":"2023-03-08T15:50:23.740582+0000","last_fullsized":"2023-03-08T15:50:23.740582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:16:18.950818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740654+0000","last_change":"2023-03-08T15:50:22.603778+0000","last_active":"2023-03-08T15:50:23.740654+0000","last_peered":"2023-03-08T15:50:23.740654+0000","last_clean":"2023-03-08T15:50:23.740654+0000","last_became_active":"2023-03-08T15:50:22.603353+0000","last_became_peered":"2023-03-08T15:50:22.603353+0000","last_unstale":"2023-03-08T15:50:23.740654+0000","last_undegraded":"2023-03-08T15:50:23.740654+0000","last_fullsized":"2023-03-08T15:50:23.740654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:31:50.246112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740641+0000","last_change":"2023-03-08T15:50:22.601538+0000","last_active":"2023-03-08T15:50:23.740641+0000","last_peered":"2023-03-08T15:50:23.740641+0000","last_clean":"2023-03-08T15:50:23.740641+0000","last_became_active":"2023-03-08T15:50:22.600965+0000","last_became_peered":"2023-03-08T15:50:22.600965+0000","last_unstale":"2023-03-08T15:50:23.740641+0000","last_undegraded":"2023-03-08T15:50:23.740641+0000","last_fullsized":"2023-03-08T15:50:23.740641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:11:30.454793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589042+0000","last_change":"2023-03-08T15:50:22.600860+0000","last_active":"2023-03-08T15:50:23.589042+0000","last_peered":"2023-03-08T15:50:23.589042+0000","last_clean":"2023-03-08T15:50:23.589042+0000","last_became_active":"2023-03-08T15:50:22.600380+0000","last_became_peered":"2023-03-08T15:50:22.600380+0000","last_unstale":"2023-03-08T15:50:23.589042+0000","last_undegraded":"2023-03-08T15:50:23.589042+0000","last_fullsized":"2023-03-08T15:50:23.589042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:16:07.182975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739565+0000","last_change":"2023-03-08T15:50:22.597608+0000","last_active":"2023-03-08T15:50:23.739565+0000","last_peered":"2023-03-08T15:50:23.739565+0000","last_clean":"2023-03-08T15:50:23.739565+0000","last_became_active":"2023-03-08T15:50:22.597322+0000","last_became_peered":"2023-03-08T15:50:22.597322+0000","last_unstale":"2023-03-08T15:50:23.739565+0000","last_undegraded":"2023-03-08T15:50:23.739565+0000","last_fullsized":"2023-03-08T15:50:23.739565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:43:16.313541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740114+0000","last_change":"2023-03-08T15:50:22.596992+0000","last_active":"2023-03-08T15:50:23.740114+0000","last_peered":"2023-03-08T15:50:23.740114+0000","last_clean":"2023-03-08T15:50:23.740114+0000","last_became_active":"2023-03-08T15:50:22.596715+0000","last_became_peered":"2023-03-08T15:50:22.596715+0000","last_unstale":"2023-03-08T15:50:23.740114+0000","last_undegraded":"2023-03-08T15:50:23.740114+0000","last_fullsized":"2023-03-08T15:50:23.740114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:11:49.033770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588746+0000","last_change":"2023-03-08T15:50:22.605289+0000","last_active":"2023-03-08T15:50:23.588746+0000","last_peered":"2023-03-08T15:50:23.588746+0000","last_clean":"2023-03-08T15:50:23.588746+0000","last_became_active":"2023-03-08T15:50:22.604976+0000","last_became_peered":"2023-03-08T15:50:22.604976+0000","last_unstale":"2023-03-08T15:50:23.588746+0000","last_undegraded":"2023-03-08T15:50:23.588746+0000","last_fullsized":"2023-03-08T15:50:23.588746+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:16:07.182975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740119+0000","last_change":"2023-03-08T15:50:22.607437+0000","last_active":"2023-03-08T15:50:23.740119+0000","last_peered":"2023-03-08T15:50:23.740119+0000","last_clean":"2023-03-08T15:50:23.740119+0000","last_became_active":"2023-03-08T15:50:22.599347+0000","last_became_peered":"2023-03-08T15:50:22.599347+0000","last_unstale":"2023-03-08T15:50:23.740119+0000","last_undegraded":"2023-03-08T15:50:23.740119+0000","last_fullsized":"2023-03-08T15:50:23.740119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:43:16.313541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740606+0000","last_change":"2023-03-08T15:50:22.604184+0000","last_active":"2023-03-08T15:50:23.740606+0000","last_peered":"2023-03-08T15:50:23.740606+0000","last_clean":"2023-03-08T15:50:23.740606+0000","last_became_active":"2023-03-08T15:50:22.603370+0000","last_became_peered":"2023-03-08T15:50:22.603370+0000","last_unstale":"2023-03-08T15:50:23.740606+0000","last_undegraded":"2023-03-08T15:50:23.740606+0000","last_fullsized":"2023-03-08T15:50:23.740606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:44:30.324678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740847+0000","last_change":"2023-03-08T15:50:22.598961+0000","last_active":"2023-03-08T15:50:23.740847+0000","last_peered":"2023-03-08T15:50:23.740847+0000","last_clean":"2023-03-08T15:50:23.740847+0000","last_became_active":"2023-03-08T15:50:22.598684+0000","last_became_peered":"2023-03-08T15:50:22.598684+0000","last_unstale":"2023-03-08T15:50:23.740847+0000","last_undegraded":"2023-03-08T15:50:23.740847+0000","last_fullsized":"2023-03-08T15:50:23.740847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:06:10.030266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739801+0000","last_change":"2023-03-08T15:50:22.597623+0000","last_active":"2023-03-08T15:50:23.739801+0000","last_peered":"2023-03-08T15:50:23.739801+0000","last_clean":"2023-03-08T15:50:23.739801+0000","last_became_active":"2023-03-08T15:50:22.597360+0000","last_became_peered":"2023-03-08T15:50:22.597360+0000","last_unstale":"2023-03-08T15:50:23.739801+0000","last_undegraded":"2023-03-08T15:50:23.739801+0000","last_fullsized":"2023-03-08T15:50:23.739801+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:33:44.568318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589017+0000","last_change":"2023-03-08T15:50:22.600655+0000","last_active":"2023-03-08T15:50:23.589017+0000","last_peered":"2023-03-08T15:50:23.589017+0000","last_clean":"2023-03-08T15:50:23.589017+0000","last_became_active":"2023-03-08T15:50:22.600007+0000","last_became_peered":"2023-03-08T15:50:22.600007+0000","last_unstale":"2023-03-08T15:50:23.589017+0000","last_undegraded":"2023-03-08T15:50:23.589017+0000","last_fullsized":"2023-03-08T15:50:23.589017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:16:33.069467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588392+0000","last_change":"2023-03-08T15:50:22.599832+0000","last_active":"2023-03-08T15:50:23.588392+0000","last_peered":"2023-03-08T15:50:23.588392+0000","last_clean":"2023-03-08T15:50:23.588392+0000","last_became_active":"2023-03-08T15:50:22.599453+0000","last_became_peered":"2023-03-08T15:50:22.599453+0000","last_unstale":"2023-03-08T15:50:23.588392+0000","last_undegraded":"2023-03-08T15:50:23.588392+0000","last_fullsized":"2023-03-08T15:50:23.588392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:39:16.250803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589310+0000","last_change":"2023-03-08T15:50:22.605500+0000","last_active":"2023-03-08T15:50:23.589310+0000","last_peered":"2023-03-08T15:50:23.589310+0000","last_clean":"2023-03-08T15:50:23.589310+0000","last_became_active":"2023-03-08T15:50:22.605231+0000","last_became_peered":"2023-03-08T15:50:22.605231+0000","last_unstale":"2023-03-08T15:50:23.589310+0000","last_undegraded":"2023-03-08T15:50:23.589310+0000","last_fullsized":"2023-03-08T15:50:23.589310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:52:57.034947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740216+0000","last_change":"2023-03-08T15:50:22.208854+0000","last_active":"2023-03-08T15:50:23.740216+0000","last_peered":"2023-03-08T15:50:23.740216+0000","last_clean":"2023-03-08T15:50:23.740216+0000","last_became_active":"2023-03-08T15:50:22.208603+0000","last_became_peered":"2023-03-08T15:50:22.208603+0000","last_unstale":"2023-03-08T15:50:23.740216+0000","last_undegraded":"2023-03-08T15:50:23.740216+0000","last_fullsized":"2023-03-08T15:50:23.740216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:47:49.932364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588919+0000","last_change":"2023-03-08T15:50:22.606931+0000","last_active":"2023-03-08T15:50:23.588919+0000","last_peered":"2023-03-08T15:50:23.588919+0000","last_clean":"2023-03-08T15:50:23.588919+0000","last_became_active":"2023-03-08T15:50:22.606473+0000","last_became_peered":"2023-03-08T15:50:22.606473+0000","last_unstale":"2023-03-08T15:50:23.588919+0000","last_undegraded":"2023-03-08T15:50:23.588919+0000","last_fullsized":"2023-03-08T15:50:23.588919+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:48:53.290624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739400+0000","last_change":"2023-03-08T15:50:22.210400+0000","last_active":"2023-03-08T15:50:23.739400+0000","last_peered":"2023-03-08T15:50:23.739400+0000","last_clean":"2023-03-08T15:50:23.739400+0000","last_became_active":"2023-03-08T15:50:22.210138+0000","last_became_peered":"2023-03-08T15:50:22.210138+0000","last_unstale":"2023-03-08T15:50:23.739400+0000","last_undegraded":"2023-03-08T15:50:23.739400+0000","last_fullsized":"2023-03-08T15:50:23.739400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:33:43.566573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740437+0000","last_change":"2023-03-08T15:50:22.601653+0000","last_active":"2023-03-08T15:50:23.740437+0000","last_peered":"2023-03-08T15:50:23.740437+0000","last_clean":"2023-03-08T15:50:23.740437+0000","last_became_active":"2023-03-08T15:50:22.601161+0000","last_became_peered":"2023-03-08T15:50:22.601161+0000","last_unstale":"2023-03-08T15:50:23.740437+0000","last_undegraded":"2023-03-08T15:50:23.740437+0000","last_fullsized":"2023-03-08T15:50:23.740437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:29:55.811304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589009+0000","last_change":"2023-03-08T15:50:22.205795+0000","last_active":"2023-03-08T15:50:23.589009+0000","last_peered":"2023-03-08T15:50:23.589009+0000","last_clean":"2023-03-08T15:50:23.589009+0000","last_became_active":"2023-03-08T15:50:22.205558+0000","last_became_peered":"2023-03-08T15:50:22.205558+0000","last_unstale":"2023-03-08T15:50:23.589009+0000","last_undegraded":"2023-03-08T15:50:23.589009+0000","last_fullsized":"2023-03-08T15:50:23.589009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:06:09.028520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590394+0000","last_change":"2023-03-08T15:50:22.599030+0000","last_active":"2023-03-08T15:50:23.590394+0000","last_peered":"2023-03-08T15:50:23.590394+0000","last_clean":"2023-03-08T15:50:23.590394+0000","last_became_active":"2023-03-08T15:50:22.598794+0000","last_became_peered":"2023-03-08T15:50:22.598794+0000","last_unstale":"2023-03-08T15:50:23.590394+0000","last_undegraded":"2023-03-08T15:50:23.590394+0000","last_fullsized":"2023-03-08T15:50:23.590394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:33:34.133823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741094+0000","last_change":"2023-03-08T15:50:22.207697+0000","last_active":"2023-03-08T15:50:23.741094+0000","last_peered":"2023-03-08T15:50:23.741094+0000","last_clean":"2023-03-08T15:50:23.741094+0000","last_became_active":"2023-03-08T15:50:22.207163+0000","last_became_peered":"2023-03-08T15:50:22.207163+0000","last_unstale":"2023-03-08T15:50:23.741094+0000","last_undegraded":"2023-03-08T15:50:23.741094+0000","last_fullsized":"2023-03-08T15:50:23.741094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:52:56.033202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739213+0000","last_change":"2023-03-08T15:50:22.599003+0000","last_active":"2023-03-08T15:50:23.739213+0000","last_peered":"2023-03-08T15:50:23.739213+0000","last_clean":"2023-03-08T15:50:23.739213+0000","last_became_active":"2023-03-08T15:50:22.598762+0000","last_became_peered":"2023-03-08T15:50:22.598762+0000","last_unstale":"2023-03-08T15:50:23.739213+0000","last_undegraded":"2023-03-08T15:50:23.739213+0000","last_fullsized":"2023-03-08T15:50:23.739213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:31:50.246112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740783+0000","last_change":"2023-03-08T15:50:22.203004+0000","last_active":"2023-03-08T15:50:23.740783+0000","last_peered":"2023-03-08T15:50:23.740783+0000","last_clean":"2023-03-08T15:50:23.740783+0000","last_became_active":"2023-03-08T15:50:22.202733+0000","last_became_peered":"2023-03-08T15:50:22.202733+0000","last_unstale":"2023-03-08T15:50:23.740783+0000","last_undegraded":"2023-03-08T15:50:23.740783+0000","last_fullsized":"2023-03-08T15:50:23.740783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:15:38.744674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741260+0000","last_change":"2023-03-08T15:50:22.604015+0000","last_active":"2023-03-08T15:50:23.741260+0000","last_peered":"2023-03-08T15:50:23.741260+0000","last_clean":"2023-03-08T15:50:23.741260+0000","last_became_active":"2023-03-08T15:50:22.603683+0000","last_became_peered":"2023-03-08T15:50:22.603683+0000","last_unstale":"2023-03-08T15:50:23.741260+0000","last_undegraded":"2023-03-08T15:50:23.741260+0000","last_fullsized":"2023-03-08T15:50:23.741260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:27:26.193162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589088+0000","last_change":"2023-03-08T15:50:22.211679+0000","last_active":"2023-03-08T15:50:23.589088+0000","last_peered":"2023-03-08T15:50:23.589088+0000","last_clean":"2023-03-08T15:50:23.589088+0000","last_became_active":"2023-03-08T15:50:22.211350+0000","last_became_peered":"2023-03-08T15:50:22.211350+0000","last_unstale":"2023-03-08T15:50:23.589088+0000","last_undegraded":"2023-03-08T15:50:23.589088+0000","last_fullsized":"2023-03-08T15:50:23.589088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:16:17.949073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740754+0000","last_change":"2023-03-08T15:50:22.610408+0000","last_active":"2023-03-08T15:50:23.740754+0000","last_peered":"2023-03-08T15:50:23.740754+0000","last_clean":"2023-03-08T15:50:23.740754+0000","last_became_active":"2023-03-08T15:50:22.608488+0000","last_became_peered":"2023-03-08T15:50:22.608488+0000","last_unstale":"2023-03-08T15:50:23.740754+0000","last_undegraded":"2023-03-08T15:50:23.740754+0000","last_fullsized":"2023-03-08T15:50:23.740754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:33:56.188085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588556+0000","last_change":"2023-03-08T15:50:22.208576+0000","last_active":"2023-03-08T15:50:23.588556+0000","last_peered":"2023-03-08T15:50:23.588556+0000","last_clean":"2023-03-08T15:50:23.588556+0000","last_became_active":"2023-03-08T15:50:22.208314+0000","last_became_peered":"2023-03-08T15:50:22.208314+0000","last_unstale":"2023-03-08T15:50:23.588556+0000","last_undegraded":"2023-03-08T15:50:23.588556+0000","last_fullsized":"2023-03-08T15:50:23.588556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:05:46.818700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590018+0000","last_change":"2023-03-08T15:50:22.600580+0000","last_active":"2023-03-08T15:50:23.590018+0000","last_peered":"2023-03-08T15:50:23.590018+0000","last_clean":"2023-03-08T15:50:23.590018+0000","last_became_active":"2023-03-08T15:50:22.599996+0000","last_became_peered":"2023-03-08T15:50:22.599996+0000","last_unstale":"2023-03-08T15:50:23.590018+0000","last_undegraded":"2023-03-08T15:50:23.590018+0000","last_fullsized":"2023-03-08T15:50:23.590018+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:11:30.454793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740196+0000","last_change":"2023-03-08T15:50:22.204919+0000","last_active":"2023-03-08T15:50:23.740196+0000","last_peered":"2023-03-08T15:50:23.740196+0000","last_clean":"2023-03-08T15:50:23.740196+0000","last_became_active":"2023-03-08T15:50:22.204637+0000","last_became_peered":"2023-03-08T15:50:22.204637+0000","last_unstale":"2023-03-08T15:50:23.740196+0000","last_undegraded":"2023-03-08T15:50:23.740196+0000","last_fullsized":"2023-03-08T15:50:23.740196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:16:32.067722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739917+0000","last_change":"2023-03-08T15:50:22.601352+0000","last_active":"2023-03-08T15:50:23.739917+0000","last_peered":"2023-03-08T15:50:23.739917+0000","last_clean":"2023-03-08T15:50:23.739917+0000","last_became_active":"2023-03-08T15:50:22.600871+0000","last_became_peered":"2023-03-08T15:50:22.600871+0000","last_unstale":"2023-03-08T15:50:23.739917+0000","last_undegraded":"2023-03-08T15:50:23.739917+0000","last_fullsized":"2023-03-08T15:50:23.739917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:11:49.033770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590471+0000","last_change":"2023-03-08T15:50:22.208986+0000","last_active":"2023-03-08T15:50:23.590471+0000","last_peered":"2023-03-08T15:50:23.590471+0000","last_clean":"2023-03-08T15:50:23.590471+0000","last_became_active":"2023-03-08T15:50:22.208694+0000","last_became_peered":"2023-03-08T15:50:22.208694+0000","last_unstale":"2023-03-08T15:50:23.590471+0000","last_undegraded":"2023-03-08T15:50:23.590471+0000","last_fullsized":"2023-03-08T15:50:23.590471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:36:30.225779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589379+0000","last_change":"2023-03-08T15:50:22.600631+0000","last_active":"2023-03-08T15:50:23.589379+0000","last_peered":"2023-03-08T15:50:23.589379+0000","last_clean":"2023-03-08T15:50:23.589379+0000","last_became_active":"2023-03-08T15:50:22.600066+0000","last_became_peered":"2023-03-08T15:50:22.600066+0000","last_unstale":"2023-03-08T15:50:23.589379+0000","last_undegraded":"2023-03-08T15:50:23.589379+0000","last_fullsized":"2023-03-08T15:50:23.589379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:31:50.246112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741380+0000","last_change":"2023-03-08T15:50:22.207254+0000","last_active":"2023-03-08T15:50:23.741380+0000","last_peered":"2023-03-08T15:50:23.741380+0000","last_clean":"2023-03-08T15:50:23.741380+0000","last_became_active":"2023-03-08T15:50:22.206987+0000","last_became_peered":"2023-03-08T15:50:22.206987+0000","last_unstale":"2023-03-08T15:50:23.741380+0000","last_undegraded":"2023-03-08T15:50:23.741380+0000","last_fullsized":"2023-03-08T15:50:23.741380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:34:43.108963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739335+0000","last_change":"2023-03-08T15:50:22.600091+0000","last_active":"2023-03-08T15:50:23.739335+0000","last_peered":"2023-03-08T15:50:23.739335+0000","last_clean":"2023-03-08T15:50:23.739335+0000","last_became_active":"2023-03-08T15:50:22.599830+0000","last_became_peered":"2023-03-08T15:50:22.599830+0000","last_unstale":"2023-03-08T15:50:23.739335+0000","last_undegraded":"2023-03-08T15:50:23.739335+0000","last_fullsized":"2023-03-08T15:50:23.739335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:24:06.766347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741006+0000","last_change":"2023-03-08T15:50:22.207518+0000","last_active":"2023-03-08T15:50:23.741006+0000","last_peered":"2023-03-08T15:50:23.741006+0000","last_clean":"2023-03-08T15:50:23.741006+0000","last_became_active":"2023-03-08T15:50:22.207089+0000","last_became_peered":"2023-03-08T15:50:22.207089+0000","last_unstale":"2023-03-08T15:50:23.741006+0000","last_undegraded":"2023-03-08T15:50:23.741006+0000","last_fullsized":"2023-03-08T15:50:23.741006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:11:48.032025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740806+0000","last_change":"2023-03-08T15:50:22.591453+0000","last_active":"2023-03-08T15:50:23.740806+0000","last_peered":"2023-03-08T15:50:23.740806+0000","last_clean":"2023-03-08T15:50:23.740806+0000","last_became_active":"2023-03-08T15:50:22.591104+0000","last_became_peered":"2023-03-08T15:50:22.591104+0000","last_unstale":"2023-03-08T15:50:23.740806+0000","last_undegraded":"2023-03-08T15:50:23.740806+0000","last_fullsized":"2023-03-08T15:50:23.740806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:10:55.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590120+0000","last_change":"2023-03-08T15:50:22.211091+0000","last_active":"2023-03-08T15:50:23.590120+0000","last_peered":"2023-03-08T15:50:23.590120+0000","last_clean":"2023-03-08T15:50:23.590120+0000","last_became_active":"2023-03-08T15:50:22.210820+0000","last_became_peered":"2023-03-08T15:50:22.210820+0000","last_unstale":"2023-03-08T15:50:23.590120+0000","last_undegraded":"2023-03-08T15:50:23.590120+0000","last_fullsized":"2023-03-08T15:50:23.590120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:44:59.090466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739328+0000","last_change":"2023-03-08T15:50:22.603229+0000","last_active":"2023-03-08T15:50:23.739328+0000","last_peered":"2023-03-08T15:50:23.739328+0000","last_clean":"2023-03-08T15:50:23.739328+0000","last_became_active":"2023-03-08T15:50:22.602968+0000","last_became_peered":"2023-03-08T15:50:22.602968+0000","last_unstale":"2023-03-08T15:50:23.739328+0000","last_undegraded":"2023-03-08T15:50:23.739328+0000","last_fullsized":"2023-03-08T15:50:23.739328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:34:21.494818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590105+0000","last_change":"2023-03-08T15:50:22.210488+0000","last_active":"2023-03-08T15:50:23.590105+0000","last_peered":"2023-03-08T15:50:23.590105+0000","last_clean":"2023-03-08T15:50:23.590105+0000","last_became_active":"2023-03-08T15:50:22.210203+0000","last_became_peered":"2023-03-08T15:50:22.210203+0000","last_unstale":"2023-03-08T15:50:23.590105+0000","last_undegraded":"2023-03-08T15:50:23.590105+0000","last_fullsized":"2023-03-08T15:50:23.590105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:15:38.744674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589731+0000","last_change":"2023-03-08T15:50:22.593478+0000","last_active":"2023-03-08T15:50:23.589731+0000","last_peered":"2023-03-08T15:50:23.589731+0000","last_clean":"2023-03-08T15:50:23.589731+0000","last_became_active":"2023-03-08T15:50:22.593209+0000","last_became_peered":"2023-03-08T15:50:22.593209+0000","last_unstale":"2023-03-08T15:50:23.589731+0000","last_undegraded":"2023-03-08T15:50:23.589731+0000","last_fullsized":"2023-03-08T15:50:23.589731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:10:55.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588559+0000","last_change":"2023-03-08T15:50:22.208909+0000","last_active":"2023-03-08T15:50:23.588559+0000","last_peered":"2023-03-08T15:50:23.588559+0000","last_clean":"2023-03-08T15:50:23.588559+0000","last_became_active":"2023-03-08T15:50:22.208712+0000","last_became_peered":"2023-03-08T15:50:22.208712+0000","last_unstale":"2023-03-08T15:50:23.588559+0000","last_undegraded":"2023-03-08T15:50:23.588559+0000","last_fullsized":"2023-03-08T15:50:23.588559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:08:46.537580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589051+0000","last_change":"2023-03-08T15:50:22.603882+0000","last_active":"2023-03-08T15:50:23.589051+0000","last_peered":"2023-03-08T15:50:23.589051+0000","last_clean":"2023-03-08T15:50:23.589051+0000","last_became_active":"2023-03-08T15:50:22.603682+0000","last_became_peered":"2023-03-08T15:50:22.603682+0000","last_unstale":"2023-03-08T15:50:23.589051+0000","last_undegraded":"2023-03-08T15:50:23.589051+0000","last_fullsized":"2023-03-08T15:50:23.589051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:26:12.855862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739697+0000","last_change":"2023-03-08T15:50:22.206153+0000","last_active":"2023-03-08T15:50:23.739697+0000","last_peered":"2023-03-08T15:50:23.739697+0000","last_clean":"2023-03-08T15:50:23.739697+0000","last_became_active":"2023-03-08T15:50:22.205578+0000","last_became_peered":"2023-03-08T15:50:22.205578+0000","last_unstale":"2023-03-08T15:50:23.739697+0000","last_undegraded":"2023-03-08T15:50:23.739697+0000","last_fullsized":"2023-03-08T15:50:23.739697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:48:41.012237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589922+0000","last_change":"2023-03-08T15:50:22.597588+0000","last_active":"2023-03-08T15:50:23.589922+0000","last_peered":"2023-03-08T15:50:23.589922+0000","last_clean":"2023-03-08T15:50:23.589922+0000","last_became_active":"2023-03-08T15:50:22.597335+0000","last_became_peered":"2023-03-08T15:50:22.597335+0000","last_unstale":"2023-03-08T15:50:23.589922+0000","last_undegraded":"2023-03-08T15:50:23.589922+0000","last_fullsized":"2023-03-08T15:50:23.589922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:55:42.607342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589066+0000","last_change":"2023-03-08T15:50:22.211335+0000","last_active":"2023-03-08T15:50:23.589066+0000","last_peered":"2023-03-08T15:50:23.589066+0000","last_clean":"2023-03-08T15:50:23.589066+0000","last_became_active":"2023-03-08T15:50:22.211061+0000","last_became_peered":"2023-03-08T15:50:22.211061+0000","last_unstale":"2023-03-08T15:50:23.589066+0000","last_undegraded":"2023-03-08T15:50:23.589066+0000","last_fullsized":"2023-03-08T15:50:23.589066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:43:15.311796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590139+0000","last_change":"2023-03-08T15:50:22.597782+0000","last_active":"2023-03-08T15:50:23.590139+0000","last_peered":"2023-03-08T15:50:23.590139+0000","last_clean":"2023-03-08T15:50:23.590139+0000","last_became_active":"2023-03-08T15:50:22.597544+0000","last_became_peered":"2023-03-08T15:50:22.597544+0000","last_unstale":"2023-03-08T15:50:23.590139+0000","last_undegraded":"2023-03-08T15:50:23.590139+0000","last_fullsized":"2023-03-08T15:50:23.590139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T00:31:50.246112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741070+0000","last_change":"2023-03-08T15:50:22.208793+0000","last_active":"2023-03-08T15:50:23.741070+0000","last_peered":"2023-03-08T15:50:23.741070+0000","last_clean":"2023-03-08T15:50:23.741070+0000","last_became_active":"2023-03-08T15:50:22.208560+0000","last_became_peered":"2023-03-08T15:50:22.208560+0000","last_unstale":"2023-03-08T15:50:23.741070+0000","last_undegraded":"2023-03-08T15:50:23.741070+0000","last_fullsized":"2023-03-08T15:50:23.741070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:36:30.225779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740932+0000","last_change":"2023-03-08T15:50:22.604918+0000","last_active":"2023-03-08T15:50:23.740932+0000","last_peered":"2023-03-08T15:50:23.740932+0000","last_clean":"2023-03-08T15:50:23.740932+0000","last_became_active":"2023-03-08T15:50:22.604603+0000","last_became_peered":"2023-03-08T15:50:22.604603+0000","last_unstale":"2023-03-08T15:50:23.740932+0000","last_undegraded":"2023-03-08T15:50:23.740932+0000","last_fullsized":"2023-03-08T15:50:23.740932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:10:55.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740563+0000","last_change":"2023-03-08T15:50:22.202026+0000","last_active":"2023-03-08T15:50:23.740563+0000","last_peered":"2023-03-08T15:50:23.740563+0000","last_clean":"2023-03-08T15:50:23.740563+0000","last_became_active":"2023-03-08T15:50:22.201667+0000","last_became_peered":"2023-03-08T15:50:22.201667+0000","last_unstale":"2023-03-08T15:50:23.740563+0000","last_undegraded":"2023-03-08T15:50:23.740563+0000","last_fullsized":"2023-03-08T15:50:23.740563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:16:06.181230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740471+0000","last_change":"2023-03-08T15:50:22.607089+0000","last_active":"2023-03-08T15:50:23.740471+0000","last_peered":"2023-03-08T15:50:23.740471+0000","last_clean":"2023-03-08T15:50:23.740471+0000","last_became_active":"2023-03-08T15:50:22.606796+0000","last_became_peered":"2023-03-08T15:50:22.606796+0000","last_unstale":"2023-03-08T15:50:23.740471+0000","last_undegraded":"2023-03-08T15:50:23.740471+0000","last_fullsized":"2023-03-08T15:50:23.740471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:42:51.830793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739958+0000","last_change":"2023-03-08T15:50:22.201782+0000","last_active":"2023-03-08T15:50:23.739958+0000","last_peered":"2023-03-08T15:50:23.739958+0000","last_clean":"2023-03-08T15:50:23.739958+0000","last_became_active":"2023-03-08T15:50:22.201513+0000","last_became_peered":"2023-03-08T15:50:22.201513+0000","last_unstale":"2023-03-08T15:50:23.739958+0000","last_undegraded":"2023-03-08T15:50:23.739958+0000","last_fullsized":"2023-03-08T15:50:23.739958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:57:54.877930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739865+0000","last_change":"2023-03-08T15:50:22.591622+0000","last_active":"2023-03-08T15:50:23.739865+0000","last_peered":"2023-03-08T15:50:23.739865+0000","last_clean":"2023-03-08T15:50:23.739865+0000","last_became_active":"2023-03-08T15:50:22.591367+0000","last_became_peered":"2023-03-08T15:50:22.591367+0000","last_unstale":"2023-03-08T15:50:23.739865+0000","last_undegraded":"2023-03-08T15:50:23.739865+0000","last_fullsized":"2023-03-08T15:50:23.739865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:36:31.227524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588755+0000","last_change":"2023-03-08T15:50:22.206328+0000","last_active":"2023-03-08T15:50:23.588755+0000","last_peered":"2023-03-08T15:50:23.588755+0000","last_clean":"2023-03-08T15:50:23.588755+0000","last_became_active":"2023-03-08T15:50:22.205631+0000","last_became_peered":"2023-03-08T15:50:22.205631+0000","last_unstale":"2023-03-08T15:50:23.588755+0000","last_undegraded":"2023-03-08T15:50:23.588755+0000","last_fullsized":"2023-03-08T15:50:23.588755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:16:17.949073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588974+0000","last_change":"2023-03-08T15:50:22.602958+0000","last_active":"2023-03-08T15:50:23.588974+0000","last_peered":"2023-03-08T15:50:23.588974+0000","last_clean":"2023-03-08T15:50:23.588974+0000","last_became_active":"2023-03-08T15:50:22.602704+0000","last_became_peered":"2023-03-08T15:50:22.602704+0000","last_unstale":"2023-03-08T15:50:23.588974+0000","last_undegraded":"2023-03-08T15:50:23.588974+0000","last_fullsized":"2023-03-08T15:50:23.588974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:17:07.676938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739863+0000","last_change":"2023-03-08T15:50:22.207246+0000","last_active":"2023-03-08T15:50:23.739863+0000","last_peered":"2023-03-08T15:50:23.739863+0000","last_clean":"2023-03-08T15:50:23.739863+0000","last_became_active":"2023-03-08T15:50:22.206984+0000","last_became_peered":"2023-03-08T15:50:22.206984+0000","last_unstale":"2023-03-08T15:50:23.739863+0000","last_undegraded":"2023-03-08T15:50:23.739863+0000","last_fullsized":"2023-03-08T15:50:23.739863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:58:29.820026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739337+0000","last_change":"2023-03-08T15:50:22.598901+0000","last_active":"2023-03-08T15:50:23.739337+0000","last_peered":"2023-03-08T15:50:23.739337+0000","last_clean":"2023-03-08T15:50:23.739337+0000","last_became_active":"2023-03-08T15:50:22.598648+0000","last_became_peered":"2023-03-08T15:50:22.598648+0000","last_unstale":"2023-03-08T15:50:23.739337+0000","last_undegraded":"2023-03-08T15:50:23.739337+0000","last_fullsized":"2023-03-08T15:50:23.739337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:16:33.069467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739753+0000","last_change":"2023-03-08T15:50:22.209211+0000","last_active":"2023-03-08T15:50:23.739753+0000","last_peered":"2023-03-08T15:50:23.739753+0000","last_clean":"2023-03-08T15:50:23.739753+0000","last_became_active":"2023-03-08T15:50:22.208958+0000","last_became_peered":"2023-03-08T15:50:22.208958+0000","last_unstale":"2023-03-08T15:50:23.739753+0000","last_undegraded":"2023-03-08T15:50:23.739753+0000","last_fullsized":"2023-03-08T15:50:23.739753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:48:41.012237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740334+0000","last_change":"2023-03-08T15:50:22.602998+0000","last_active":"2023-03-08T15:50:23.740334+0000","last_peered":"2023-03-08T15:50:23.740334+0000","last_clean":"2023-03-08T15:50:23.740334+0000","last_became_active":"2023-03-08T15:50:22.602715+0000","last_became_peered":"2023-03-08T15:50:22.602715+0000","last_unstale":"2023-03-08T15:50:23.740334+0000","last_undegraded":"2023-03-08T15:50:23.740334+0000","last_fullsized":"2023-03-08T15:50:23.740334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T22:16:07.182975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589158+0000","last_change":"2023-03-08T15:50:22.208057+0000","last_active":"2023-03-08T15:50:23.589158+0000","last_peered":"2023-03-08T15:50:23.589158+0000","last_clean":"2023-03-08T15:50:23.589158+0000","last_became_active":"2023-03-08T15:50:22.207538+0000","last_became_peered":"2023-03-08T15:50:22.207538+0000","last_unstale":"2023-03-08T15:50:23.589158+0000","last_undegraded":"2023-03-08T15:50:23.589158+0000","last_fullsized":"2023-03-08T15:50:23.589158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:08:46.537580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590014+0000","last_change":"2023-03-08T15:50:22.600734+0000","last_active":"2023-03-08T15:50:23.590014+0000","last_peered":"2023-03-08T15:50:23.590014+0000","last_clean":"2023-03-08T15:50:23.590014+0000","last_became_active":"2023-03-08T15:50:22.600332+0000","last_became_peered":"2023-03-08T15:50:22.600332+0000","last_unstale":"2023-03-08T15:50:23.590014+0000","last_undegraded":"2023-03-08T15:50:23.590014+0000","last_fullsized":"2023-03-08T15:50:23.590014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:42:51.830793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739514+0000","last_change":"2023-03-08T15:50:22.207532+0000","last_active":"2023-03-08T15:50:23.739514+0000","last_peered":"2023-03-08T15:50:23.739514+0000","last_clean":"2023-03-08T15:50:23.739514+0000","last_became_active":"2023-03-08T15:50:22.207275+0000","last_became_peered":"2023-03-08T15:50:22.207275+0000","last_unstale":"2023-03-08T15:50:23.739514+0000","last_undegraded":"2023-03-08T15:50:23.739514+0000","last_fullsized":"2023-03-08T15:50:23.739514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:50:47.067582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739219+0000","last_change":"2023-03-08T15:50:22.597592+0000","last_active":"2023-03-08T15:50:23.739219+0000","last_peered":"2023-03-08T15:50:23.739219+0000","last_clean":"2023-03-08T15:50:23.739219+0000","last_became_active":"2023-03-08T15:50:22.597318+0000","last_became_peered":"2023-03-08T15:50:22.597318+0000","last_unstale":"2023-03-08T15:50:23.739219+0000","last_undegraded":"2023-03-08T15:50:23.739219+0000","last_fullsized":"2023-03-08T15:50:23.739219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:51:16.866114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739500+0000","last_change":"2023-03-08T15:50:22.205356+0000","last_active":"2023-03-08T15:50:23.739500+0000","last_peered":"2023-03-08T15:50:23.739500+0000","last_clean":"2023-03-08T15:50:23.739500+0000","last_became_active":"2023-03-08T15:50:22.205099+0000","last_became_peered":"2023-03-08T15:50:22.205099+0000","last_unstale":"2023-03-08T15:50:23.739500+0000","last_undegraded":"2023-03-08T15:50:23.739500+0000","last_fullsized":"2023-03-08T15:50:23.739500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T23:11:48.032025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.595550+0000","last_change":"2023-03-08T15:49:34.914364+0000","last_active":"2023-03-08T15:50:22.595550+0000","last_peered":"2023-03-08T15:50:22.595550+0000","last_clean":"2023-03-08T15:50:22.595550+0000","last_became_active":"2023-03-08T15:49:34.914037+0000","last_became_peered":"2023-03-08T15:49:34.914037+0000","last_unstale":"2023-03-08T15:50:22.595550+0000","last_undegraded":"2023-03-08T15:50:22.595550+0000","last_fullsized":"2023-03-08T15:50:22.595550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:55:29.151326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.590641+0000","last_change":"2023-03-08T15:50:22.601615+0000","last_active":"2023-03-08T15:50:23.590641+0000","last_peered":"2023-03-08T15:50:23.590641+0000","last_clean":"2023-03-08T15:50:23.590641+0000","last_became_active":"2023-03-08T15:50:22.601309+0000","last_became_peered":"2023-03-08T15:50:22.601309+0000","last_unstale":"2023-03-08T15:50:23.590641+0000","last_undegraded":"2023-03-08T15:50:23.590641+0000","last_fullsized":"2023-03-08T15:50:23.590641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:51:16.866114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739742+0000","last_change":"2023-03-08T15:50:22.208214+0000","last_active":"2023-03-08T15:50:23.739742+0000","last_peered":"2023-03-08T15:50:23.739742+0000","last_clean":"2023-03-08T15:50:23.739742+0000","last_became_active":"2023-03-08T15:50:22.207833+0000","last_became_peered":"2023-03-08T15:50:22.207833+0000","last_unstale":"2023-03-08T15:50:23.739742+0000","last_undegraded":"2023-03-08T15:50:23.739742+0000","last_fullsized":"2023-03-08T15:50:23.739742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:47:25.225365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.595091+0000","last_change":"2023-03-08T15:49:34.036801+0000","last_active":"2023-03-08T15:50:22.595091+0000","last_peered":"2023-03-08T15:50:22.595091+0000","last_clean":"2023-03-08T15:50:22.595091+0000","last_became_active":"2023-03-08T15:49:34.036484+0000","last_became_peered":"2023-03-08T15:49:34.036484+0000","last_unstale":"2023-03-08T15:50:22.595091+0000","last_undegraded":"2023-03-08T15:50:22.595091+0000","last_fullsized":"2023-03-08T15:50:22.595091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589374+0000","last_change":"2023-03-08T15:50:22.600798+0000","last_active":"2023-03-08T15:50:23.589374+0000","last_peered":"2023-03-08T15:50:23.589374+0000","last_clean":"2023-03-08T15:50:23.589374+0000","last_became_active":"2023-03-08T15:50:22.600366+0000","last_became_peered":"2023-03-08T15:50:22.600366+0000","last_unstale":"2023-03-08T15:50:23.589374+0000","last_undegraded":"2023-03-08T15:50:23.589374+0000","last_fullsized":"2023-03-08T15:50:23.589374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:24:06.766347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:25.249317+0000","last_change":"2023-03-08T15:50:22.201430+0000","last_active":"2023-03-08T15:50:25.249317+0000","last_peered":"2023-03-08T15:50:25.249317+0000","last_clean":"2023-03-08T15:50:25.249317+0000","last_became_active":"2023-03-08T15:50:22.201144+0000","last_became_peered":"2023-03-08T15:50:22.201144+0000","last_unstale":"2023-03-08T15:50:25.249317+0000","last_undegraded":"2023-03-08T15:50:25.249317+0000","last_fullsized":"2023-03-08T15:50:25.249317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:47:49.932364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.587182+0000","last_change":"2023-03-08T15:49:34.968598+0000","last_active":"2023-03-08T15:50:22.587182+0000","last_peered":"2023-03-08T15:50:22.587182+0000","last_clean":"2023-03-08T15:50:22.587182+0000","last_became_active":"2023-03-08T15:49:34.968300+0000","last_became_peered":"2023-03-08T15:49:34.968300+0000","last_unstale":"2023-03-08T15:50:22.587182+0000","last_undegraded":"2023-03-08T15:50:22.587182+0000","last_fullsized":"2023-03-08T15:50:22.587182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:39:14.985725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740971+0000","last_change":"2023-03-08T15:50:22.604679+0000","last_active":"2023-03-08T15:50:23.740971+0000","last_peered":"2023-03-08T15:50:23.740971+0000","last_clean":"2023-03-08T15:50:23.740971+0000","last_became_active":"2023-03-08T15:50:22.602935+0000","last_became_peered":"2023-03-08T15:50:22.602935+0000","last_unstale":"2023-03-08T15:50:23.740971+0000","last_undegraded":"2023-03-08T15:50:23.740971+0000","last_fullsized":"2023-03-08T15:50:23.740971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T17:33:34.133823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589360+0000","last_change":"2023-03-08T15:50:22.207122+0000","last_active":"2023-03-08T15:50:23.589360+0000","last_peered":"2023-03-08T15:50:23.589360+0000","last_clean":"2023-03-08T15:50:23.589360+0000","last_became_active":"2023-03-08T15:50:22.206851+0000","last_became_peered":"2023-03-08T15:50:22.206851+0000","last_unstale":"2023-03-08T15:50:23.589360+0000","last_undegraded":"2023-03-08T15:50:23.589360+0000","last_fullsized":"2023-03-08T15:50:23.589360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T21:47:25.225365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.595099+0000","last_change":"2023-03-08T15:49:34.042076+0000","last_active":"2023-03-08T15:50:22.595099+0000","last_peered":"2023-03-08T15:50:22.595099+0000","last_clean":"2023-03-08T15:50:22.595099+0000","last_became_active":"2023-03-08T15:49:34.041670+0000","last_became_peered":"2023-03-08T15:49:34.041670+0000","last_unstale":"2023-03-08T15:50:22.595099+0000","last_undegraded":"2023-03-08T15:50:22.595099+0000","last_fullsized":"2023-03-08T15:50:22.595099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:46:37.870016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.591908+0000","last_change":"2023-03-08T15:49:27.814075+0000","last_active":"2023-03-08T15:50:22.591908+0000","last_peered":"2023-03-08T15:50:22.591908+0000","last_clean":"2023-03-08T15:50:22.591908+0000","last_became_active":"2023-03-08T15:49:27.813798+0000","last_became_peered":"2023-03-08T15:49:27.813798+0000","last_unstale":"2023-03-08T15:50:22.591908+0000","last_undegraded":"2023-03-08T15:50:22.591908+0000","last_fullsized":"2023-03-08T15:50:22.591908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:26.430262+0000","last_clean_scrub_stamp":"2023-03-08T15:49:26.430262+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:31:30.865216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588884+0000","last_change":"2023-03-08T15:50:22.604411+0000","last_active":"2023-03-08T15:50:23.588884+0000","last_peered":"2023-03-08T15:50:23.588884+0000","last_clean":"2023-03-08T15:50:23.588884+0000","last_became_active":"2023-03-08T15:50:22.604150+0000","last_became_peered":"2023-03-08T15:50:22.604150+0000","last_unstale":"2023-03-08T15:50:23.588884+0000","last_undegraded":"2023-03-08T15:50:23.588884+0000","last_fullsized":"2023-03-08T15:50:23.588884+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:17:07.676938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.741077+0000","last_change":"2023-03-08T15:50:22.204855+0000","last_active":"2023-03-08T15:50:23.741077+0000","last_peered":"2023-03-08T15:50:23.741077+0000","last_clean":"2023-03-08T15:50:23.741077+0000","last_became_active":"2023-03-08T15:50:22.203711+0000","last_became_peered":"2023-03-08T15:50:22.203711+0000","last_unstale":"2023-03-08T15:50:23.741077+0000","last_undegraded":"2023-03-08T15:50:23.741077+0000","last_fullsized":"2023-03-08T15:50:23.741077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:33:43.566573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.591996+0000","last_change":"2023-03-08T15:49:34.042085+0000","last_active":"2023-03-08T15:50:22.591996+0000","last_peered":"2023-03-08T15:50:22.591996+0000","last_clean":"2023-03-08T15:50:22.591996+0000","last_became_active":"2023-03-08T15:49:34.041754+0000","last_became_peered":"2023-03-08T15:49:34.041754+0000","last_unstale":"2023-03-08T15:50:22.591996+0000","last_undegraded":"2023-03-08T15:50:22.591996+0000","last_fullsized":"2023-03-08T15:50:22.591996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T03:35:55.187805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.588557+0000","last_change":"2023-03-08T15:50:22.609901+0000","last_active":"2023-03-08T15:50:23.588557+0000","last_peered":"2023-03-08T15:50:23.588557+0000","last_clean":"2023-03-08T15:50:23.588557+0000","last_became_active":"2023-03-08T15:50:22.609457+0000","last_became_peered":"2023-03-08T15:50:22.609457+0000","last_unstale":"2023-03-08T15:50:23.588557+0000","last_undegraded":"2023-03-08T15:50:23.588557+0000","last_fullsized":"2023-03-08T15:50:23.588557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:25:23.301855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.739874+0000","last_change":"2023-03-08T15:50:22.206262+0000","last_active":"2023-03-08T15:50:23.739874+0000","last_peered":"2023-03-08T15:50:23.739874+0000","last_clean":"2023-03-08T15:50:23.739874+0000","last_became_active":"2023-03-08T15:50:22.205933+0000","last_became_peered":"2023-03-08T15:50:22.205933+0000","last_unstale":"2023-03-08T15:50:23.739874+0000","last_undegraded":"2023-03-08T15:50:23.739874+0000","last_fullsized":"2023-03-08T15:50:23.739874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:57:54.877930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.596191+0000","last_change":"2023-03-08T15:49:34.914757+0000","last_active":"2023-03-08T15:50:22.596191+0000","last_peered":"2023-03-08T15:50:22.596191+0000","last_clean":"2023-03-08T15:50:22.596191+0000","last_became_active":"2023-03-08T15:49:34.914391+0000","last_became_peered":"2023-03-08T15:49:34.914391+0000","last_unstale":"2023-03-08T15:50:22.596191+0000","last_undegraded":"2023-03-08T15:50:22.596191+0000","last_fullsized":"2023-03-08T15:50:22.596191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T20:09:02.620210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740868+0000","last_change":"2023-03-08T15:50:22.594793+0000","last_active":"2023-03-08T15:50:23.740868+0000","last_peered":"2023-03-08T15:50:23.740868+0000","last_clean":"2023-03-08T15:50:23.740868+0000","last_became_active":"2023-03-08T15:50:22.594549+0000","last_became_peered":"2023-03-08T15:50:22.594549+0000","last_unstale":"2023-03-08T15:50:23.740868+0000","last_undegraded":"2023-03-08T15:50:23.740868+0000","last_fullsized":"2023-03-08T15:50:23.740868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T01:35:45.961519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.740802+0000","last_change":"2023-03-08T15:50:22.203091+0000","last_active":"2023-03-08T15:50:23.740802+0000","last_peered":"2023-03-08T15:50:23.740802+0000","last_clean":"2023-03-08T15:50:23.740802+0000","last_became_active":"2023-03-08T15:50:22.202820+0000","last_became_peered":"2023-03-08T15:50:22.202820+0000","last_unstale":"2023-03-08T15:50:23.740802+0000","last_undegraded":"2023-03-08T15:50:23.740802+0000","last_fullsized":"2023-03-08T15:50:23.740802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T16:26:11.854116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.596213+0000","last_change":"2023-03-08T15:49:34.039636+0000","last_active":"2023-03-08T15:50:22.596213+0000","last_peered":"2023-03-08T15:50:22.596213+0000","last_clean":"2023-03-08T15:50:22.596213+0000","last_became_active":"2023-03-08T15:49:34.039383+0000","last_became_peered":"2023-03-08T15:49:34.039383+0000","last_unstale":"2023-03-08T15:50:22.596213+0000","last_undegraded":"2023-03-08T15:50:22.596213+0000","last_fullsized":"2023-03-08T15:50:22.596213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:27:38.358539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589303+0000","last_change":"2023-03-08T15:50:22.599278+0000","last_active":"2023-03-08T15:50:23.589303+0000","last_peered":"2023-03-08T15:50:23.589303+0000","last_clean":"2023-03-08T15:50:23.589303+0000","last_became_active":"2023-03-08T15:50:22.598996+0000","last_became_peered":"2023-03-08T15:50:22.598996+0000","last_unstale":"2023-03-08T15:50:23.589303+0000","last_undegraded":"2023-03-08T15:50:23.589303+0000","last_fullsized":"2023-03-08T15:50:23.589303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:22.182815+0000","last_clean_scrub_stamp":"2023-03-08T15:50:22.182815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-10T02:51:16.866114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-03-08T15:50:23.589741+0000","last_change":"2023-03-08T15:50:22.206439+0000","last_active":"2023-03-08T15:50:23.589741+0000","last_peered":"2023-03-08T15:50:23.589741+0000","last_clean":"2023-03-08T15:50:23.589741+0000","last_became_active":"2023-03-08T15:50:22.206142+0000","last_became_peered":"2023-03-08T15:50:22.206142+0000","last_unstale":"2023-03-08T15:50:23.589741+0000","last_undegraded":"2023-03-08T15:50:23.589741+0000","last_fullsized":"2023-03-08T15:50:23.589741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:50:21.181070+0000","last_clean_scrub_stamp":"2023-03-08T15:50:21.181070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T19:34:43.108963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-03-08T15:50:22.591176+0000","last_change":"2023-03-08T15:49:34.040711+0000","last_active":"2023-03-08T15:50:22.591176+0000","last_peered":"2023-03-08T15:50:22.591176+0000","last_clean":"2023-03-08T15:50:22.591176+0000","last_became_active":"2023-03-08T15:49:34.040328+0000","last_became_peered":"2023-03-08T15:49:34.040328+0000","last_unstale":"2023-03-08T15:50:22.591176+0000","last_undegraded":"2023-03-08T15:50:22.591176+0000","last_fullsized":"2023-03-08T15:50:22.591176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-08T15:49:33.023140+0000","last_clean_scrub_stamp":"2023-03-08T15:49:33.023140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-09T18:34:43.169713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9556,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362284,"statfs":{"total":96636764160,"available":96626978816,"internally_reserved":0,"allocated":995328,"data_stored":748840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8324,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363516,"statfs":{"total":96636764160,"available":96628240384,"internally_reserved":0,"allocated":389120,"data_stored":157420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.439}]},{"osd":1,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56699999999999995}]},{"osd":2,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.54300000000000004}]},{"osd":3,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.626}]},{"osd":5,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66100000000000003}]},{"osd":7,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":389120,"data_stored":156944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9480,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362360,"statfs":{"total":96636764160,"available":96627056640,"internally_reserved":0,"allocated":983040,"data_stored":747256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":12.048,"5min":12.048,"15min":12.048},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.33100000000000002}]},{"osd":2,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":19.98,"5min":19.98,"15min":19.98},"last":0.38600000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":12.157,"5min":12.157,"15min":12.157},"last":0.37}]},{"osd":3,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":12.013999999999999,"5min":12.013999999999999,"15min":12.013999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":9.1579999999999995,"5min":9.1579999999999995,"15min":9.1579999999999995},"last":0.437}]},{"osd":4,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":12.132,"5min":12.132,"15min":12.132},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":11.964,"5min":11.964,"15min":11.964},"last":0.45800000000000002}]},{"osd":5,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":11.929,"5min":11.929,"15min":11.929},"last":0.50600000000000001},{"interface":"front","average":{"1min":1.752,"5min":1.752,"15min":1.752},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":19.923999999999999,"5min":19.923999999999999,"15min":19.923999999999999},"last":0.48799999999999999}]},{"osd":6,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":19.957000000000001,"5min":19.957000000000001,"15min":19.957000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":12.082000000000001,"5min":12.082000000000001,"15min":12.082000000000001},"last":0.47799999999999998}]},{"osd":7,"last update":"Wed Mar 8 15:50:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":12.106,"5min":12.106,"15min":12.106},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":11.99,"5min":11.99,"15min":11.99},"last":0.55900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8324,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363516,"statfs":{"total":96636764160,"available":96628240384,"internally_reserved":0,"allocated":389120,"data_stored":156924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8464,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363376,"statfs":{"total":96636764160,"available":96628097024,"internally_reserved":0,"allocated":401408,"data_stored":158436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.215}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8520,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363320,"statfs":{"total":96636764160,"available":96628039680,"internally_reserved":0,"allocated":393216,"data_stored":157442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8392,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363448,"statfs":{"total":96636764160,"available":96628170752,"internally_reserved":0,"allocated":393216,"data_stored":156966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-08T15:50:31.853 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-08T15:50:31.854 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-03-08T15:50:32.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.012+0000 7fc196597700 1 Processor -- start 2023-03-08T15:50:32.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.012+0000 7fc196597700 1 -- start start 2023-03-08T15:50:32.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.013+0000 7fc196597700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc1901427e0 0x7fc1900b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:32.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.013+0000 7fc196597700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc190070b00 0x7fc190148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:32.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.013+0000 7fc196597700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1900a0f70 0x7fc19006d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:32.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.013+0000 7fc196597700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1901484d0 con 0x7fc190070b00 2023-03-08T15:50:32.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.013+0000 7fc196597700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc190148a30 con 0x7fc1901427e0 2023-03-08T15:50:32.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.013+0000 7fc196597700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc190072970 con 0x7fc1900a0f70 2023-03-08T15:50:32.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.013+0000 7fc18f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc190070b00 0x7fc190148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:32.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.013+0000 7fc18f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc190070b00 0x7fc190148ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35564/0 (socket says 172.21.15.123:35564) 2023-03-08T15:50:32.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.013+0000 7fc18f7fe700 1 -- 172.21.15.123:0/272057940 learned_addr learned my addr 172.21.15.123:0/272057940 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:32.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.013+0000 7fc18ffff700 1 --2- 172.21.15.123:0/272057940 >> v2:172.21.15.175:3300/0 conn(0x7fc1901427e0 0x7fc1900b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:32.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.013+0000 7fc18f7fe700 1 -- 172.21.15.123:0/272057940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1900a0f70 msgr2=0x7fc19006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:32.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.013+0000 7fc18f7fe700 1 --2- 172.21.15.123:0/272057940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1900a0f70 0x7fc19006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.013+0000 7fc18f7fe700 1 -- 172.21.15.123:0/272057940 >> v2:172.21.15.175:3300/0 conn(0x7fc1901427e0 msgr2=0x7fc1900b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:32.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.013+0000 7fc18f7fe700 1 --2- 172.21.15.123:0/272057940 >> v2:172.21.15.175:3300/0 conn(0x7fc1901427e0 0x7fc1900b3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.013+0000 7fc18f7fe700 1 -- 172.21.15.123:0/272057940 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc190149400 con 0x7fc190070b00 2023-03-08T15:50:32.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.014+0000 7fc18f7fe700 1 --2- 172.21.15.123:0/272057940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc190070b00 0x7fc190148ec0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc1900bf290 tx=0x7fc180009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8248bc40615d7bae server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:32.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.014+0000 7fc18effd700 1 -- 172.21.15.123:0/272057940 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18000b870 con 0x7fc190070b00 2023-03-08T15:50:32.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.014+0000 7fc18effd700 1 -- 172.21.15.123:0/272057940 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18000b9d0 con 0x7fc190070b00 2023-03-08T15:50:32.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.014+0000 7fc18effd700 1 -- 172.21.15.123:0/272057940 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18000bd60 con 0x7fc190070b00 2023-03-08T15:50:32.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.014+0000 7fc196597700 1 -- 172.21.15.123:0/272057940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc190070b00 msgr2=0x7fc190148ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:32.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.014+0000 7fc196597700 1 --2- 172.21.15.123:0/272057940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc190070b00 0x7fc190148ec0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc1900bf290 tx=0x7fc180009bd0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.014+0000 7fc196597700 1 -- 172.21.15.123:0/272057940 shutdown_connections 2023-03-08T15:50:32.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.014+0000 7fc196597700 1 --2- 172.21.15.123:0/272057940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1900a0f70 0x7fc19006d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.014+0000 7fc196597700 1 --2- 172.21.15.123:0/272057940 >> v2:172.21.15.175:3300/0 conn(0x7fc1901427e0 0x7fc1900b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.014+0000 7fc196597700 1 --2- 172.21.15.123:0/272057940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc190070b00 0x7fc190148ec0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.014+0000 7fc196597700 1 -- 172.21.15.123:0/272057940 >> 172.21.15.123:0/272057940 conn(0x7fc1900be6f0 msgr2=0x7fc1900beac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:32.019 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.014+0000 7fc196597700 1 -- 172.21.15.123:0/272057940 shutdown_connections 2023-03-08T15:50:32.020 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.014+0000 7fc196597700 1 -- 172.21.15.123:0/272057940 wait complete. 2023-03-08T15:50:32.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.015+0000 7fc196597700 1 Processor -- start 2023-03-08T15:50:32.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.015+0000 7fc196597700 1 -- start start 2023-03-08T15:50:32.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc196597700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc190070b00 0x7fc19006b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:32.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc196597700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1900a0f70 0x7fc19009e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:32.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc196597700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1901427e0 0x7fc1901e05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:32.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc196597700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19009ed20 con 0x7fc1900a0f70 2023-03-08T15:50:32.022 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc196597700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19009e5f0 con 0x7fc1901427e0 2023-03-08T15:50:32.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc196597700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1901e0170 con 0x7fc190070b00 2023-03-08T15:50:32.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc18f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1900a0f70 0x7fc19009e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:32.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc18f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1900a0f70 0x7fc19009e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35566/0 (socket says 172.21.15.123:35566) 2023-03-08T15:50:32.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc18f7fe700 1 -- 172.21.15.123:0/4076367162 learned_addr learned my addr 172.21.15.123:0/4076367162 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:32.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc18ffff700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc190070b00 0x7fc19006b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:32.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc194b34700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1901427e0 0x7fc1901e05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:32.023 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc18f7fe700 1 -- 172.21.15.123:0/4076367162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc190070b00 msgr2=0x7fc19006b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:32.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc18f7fe700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc190070b00 0x7fc19006b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc18f7fe700 1 -- 172.21.15.123:0/4076367162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1901427e0 msgr2=0x7fc1901e05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:32.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc18f7fe700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1901427e0 0x7fc1901e05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc18f7fe700 1 -- 172.21.15.123:0/4076367162 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc180009550 con 0x7fc1900a0f70 2023-03-08T15:50:32.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc18ffff700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc190070b00 0x7fc19006b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:32.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.016+0000 7fc194b34700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1901427e0 0x7fc1901e05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:32.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.017+0000 7fc18f7fe700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1900a0f70 0x7fc19009e0b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc180014040 tx=0x7fc180004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:32.024 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.017+0000 7fc18cff9700 1 -- 172.21.15.123:0/4076367162 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc180004500 con 0x7fc1900a0f70 2023-03-08T15:50:32.025 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.017+0000 7fc18cff9700 1 -- 172.21.15.123:0/4076367162 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1800036a0 con 0x7fc1900a0f70 2023-03-08T15:50:32.025 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.017+0000 7fc196597700 1 -- 172.21.15.123:0/4076367162 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1900718a0 con 0x7fc1900a0f70 2023-03-08T15:50:32.025 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.017+0000 7fc18cff9700 1 -- 172.21.15.123:0/4076367162 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc180003a30 con 0x7fc1900a0f70 2023-03-08T15:50:32.025 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.017+0000 7fc196597700 1 -- 172.21.15.123:0/4076367162 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1900715d0 con 0x7fc1900a0f70 2023-03-08T15:50:32.025 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.018+0000 7fc196597700 1 -- 172.21.15.123:0/4076367162 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1901486c0 con 0x7fc1900a0f70 2023-03-08T15:50:32.025 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.018+0000 7fc18cff9700 1 -- 172.21.15.123:0/4076367162 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fc18000f050 con 0x7fc1900a0f70 2023-03-08T15:50:32.025 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.018+0000 7fc18cff9700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc17c0698d0 0x7fc17c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:32.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.018+0000 7fc18cff9700 1 -- 172.21.15.123:0/4076367162 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc180088b20 con 0x7fc1900a0f70 2023-03-08T15:50:32.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.018+0000 7fc18ffff700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc17c0698d0 0x7fc17c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:32.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.019+0000 7fc18ffff700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc17c0698d0 0x7fc17c06bd80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc18400aa50 tx=0x7fc184008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:32.026 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.023+0000 7fc18cff9700 1 -- 172.21.15.123:0/4076367162 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fc1800548f0 con 0x7fc1900a0f70 2023-03-08T15:50:32.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.285+0000 7fc196597700 1 -- 172.21.15.123:0/4076367162 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc19006c950 con 0x7fc1900a0f70 2023-03-08T15:50:32.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.289+0000 7fc18cff9700 1 -- 172.21.15.123:0/4076367162 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc1800150e0 con 0x7fc1900a0f70 2023-03-08T15:50:32.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.291+0000 7fc196597700 1 -- 172.21.15.123:0/4076367162 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc17c0698d0 msgr2=0x7fc17c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:32.292 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.291+0000 7fc196597700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc17c0698d0 0x7fc17c06bd80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc18400aa50 tx=0x7fc184008040 comp rx=0 tx=0).stop 2023-03-08T15:50:32.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.291+0000 7fc196597700 1 -- 172.21.15.123:0/4076367162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1900a0f70 msgr2=0x7fc19009e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:32.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.291+0000 7fc196597700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1900a0f70 0x7fc19009e0b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc180014040 tx=0x7fc180004750 comp rx=0 tx=0).stop 2023-03-08T15:50:32.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.291+0000 7fc196597700 1 -- 172.21.15.123:0/4076367162 shutdown_connections 2023-03-08T15:50:32.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.291+0000 7fc196597700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1901427e0 0x7fc1901e05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.291+0000 7fc196597700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fc17c0698d0 0x7fc17c06bd80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.291+0000 7fc196597700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc190070b00 0x7fc19006b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.293 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.291+0000 7fc196597700 1 --2- 172.21.15.123:0/4076367162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1900a0f70 0x7fc19009e0b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.291+0000 7fc196597700 1 -- 172.21.15.123:0/4076367162 >> 172.21.15.123:0/4076367162 conn(0x7fc1900be6f0 msgr2=0x7fc1900b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:32.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.291+0000 7fc196597700 1 -- 172.21.15.123:0/4076367162 shutdown_connections 2023-03-08T15:50:32.294 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.291+0000 7fc196597700 1 -- 172.21.15.123:0/4076367162 wait complete. 2023-03-08T15:50:32.294 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2023-03-08T15:50:32.304 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-08T15:50:32.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.422+0000 7fe38c67d700 1 Processor -- start 2023-03-08T15:50:32.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.422+0000 7fe38c67d700 1 -- start start 2023-03-08T15:50:32.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.423+0000 7fe38c67d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe384147e50 0x7fe38406a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:32.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.423+0000 7fe38c67d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38414b420 0x7fe384155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:32.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.423+0000 7fe38c67d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38414a810 con 0x7fe38406fef0 2023-03-08T15:50:32.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.423+0000 7fe38c67d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe384071a40 con 0x7fe384147e50 2023-03-08T15:50:32.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.423+0000 7fe38c67d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe384071d20 con 0x7fe38414b420 2023-03-08T15:50:32.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.423+0000 7fe38a419700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe384147e50 0x7fe38406a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:32.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.423+0000 7fe38a419700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe384147e50 0x7fe38406a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35582/0 (socket says 172.21.15.123:35582) 2023-03-08T15:50:32.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.423+0000 7fe38a419700 1 -- 172.21.15.123:0/1944535893 learned_addr learned my addr 172.21.15.123:0/1944535893 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:32.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.423+0000 7fe38ac1a700 1 --2- 172.21.15.123:0/1944535893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38414b420 0x7fe384155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:32.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.423+0000 7fe38a419700 1 -- 172.21.15.123:0/1944535893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38414b420 msgr2=0x7fe384155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:32.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.423+0000 7fe38a419700 1 --2- 172.21.15.123:0/1944535893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38414b420 0x7fe384155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.423+0000 7fe38a419700 1 -- 172.21.15.123:0/1944535893 >> v1:172.21.15.175:6789/0 conn(0x7fe38406fef0 legacy=0x7fe38414ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:32.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.423+0000 7fe38a419700 1 -- 172.21.15.123:0/1944535893 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe384072000 con 0x7fe384147e50 2023-03-08T15:50:32.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.424+0000 7fe38a419700 1 --2- 172.21.15.123:0/1944535893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe384147e50 0x7fe38406a250 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe3740098f0 tx=0x7fe374009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8081f46325a19cfa server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:32.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.424+0000 7fe389417700 1 -- 172.21.15.123:0/1944535893 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe374011830 con 0x7fe384147e50 2023-03-08T15:50:32.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.424+0000 7fe389417700 1 -- 172.21.15.123:0/1944535893 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe374011990 con 0x7fe384147e50 2023-03-08T15:50:32.428 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.424+0000 7fe389417700 1 -- 172.21.15.123:0/1944535893 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe374011d20 con 0x7fe384147e50 2023-03-08T15:50:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.424+0000 7fe38c67d700 1 -- 172.21.15.123:0/1944535893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe384147e50 msgr2=0x7fe38406a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.424+0000 7fe38c67d700 1 --2- 172.21.15.123:0/1944535893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe384147e50 0x7fe38406a250 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe3740098f0 tx=0x7fe374009c00 comp rx=0 tx=0).stop 2023-03-08T15:50:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.424+0000 7fe38c67d700 1 -- 172.21.15.123:0/1944535893 shutdown_connections 2023-03-08T15:50:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.424+0000 7fe38c67d700 1 --2- 172.21.15.123:0/1944535893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38414b420 0x7fe384155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.424+0000 7fe38c67d700 1 --2- 172.21.15.123:0/1944535893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe384147e50 0x7fe38406a250 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.424+0000 7fe38c67d700 1 -- 172.21.15.123:0/1944535893 >> 172.21.15.123:0/1944535893 conn(0x7fe38406b360 msgr2=0x7fe38406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.424+0000 7fe38c67d700 1 -- 172.21.15.123:0/1944535893 shutdown_connections 2023-03-08T15:50:32.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.424+0000 7fe38c67d700 1 -- 172.21.15.123:0/1944535893 wait complete. 2023-03-08T15:50:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.426+0000 7fe38c67d700 1 Processor -- start 2023-03-08T15:50:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.426+0000 7fe38c67d700 1 -- start start 2023-03-08T15:50:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.426+0000 7fe38c67d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe38406fef0 0x7fe3841d1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.426+0000 7fe38c67d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe384147e50 0x7fe3840b76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.426+0000 7fe38c67d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38414b420 0x7fe384142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:32.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.426+0000 7fe38c67d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3840b7c30 con 0x7fe38406fef0 2023-03-08T15:50:32.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.426+0000 7fe38c67d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe384148e70 con 0x7fe384147e50 2023-03-08T15:50:32.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.426+0000 7fe38c67d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3840b3d50 con 0x7fe38414b420 2023-03-08T15:50:32.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.426+0000 7fe38a419700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe38406fef0 0x7fe3841d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:32.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.426+0000 7fe38a419700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe38406fef0 0x7fe3841d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35586/0 (socket says 172.21.15.123:35586) 2023-03-08T15:50:32.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.426+0000 7fe38a419700 1 -- 172.21.15.123:0/3470316023 learned_addr learned my addr 172.21.15.123:0/3470316023 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:32.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.426+0000 7fe389c18700 1 --2- 172.21.15.123:0/3470316023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe384147e50 0x7fe3840b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:32.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.426+0000 7fe38ac1a700 1 --2- 172.21.15.123:0/3470316023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38414b420 0x7fe384142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:32.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.427+0000 7fe38a419700 1 -- 172.21.15.123:0/3470316023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38414b420 msgr2=0x7fe384142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:32.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.427+0000 7fe38a419700 1 --2- 172.21.15.123:0/3470316023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38414b420 0x7fe384142db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.427+0000 7fe38a419700 1 -- 172.21.15.123:0/3470316023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe384147e50 msgr2=0x7fe3840b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:32.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.427+0000 7fe38a419700 1 --2- 172.21.15.123:0/3470316023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe384147e50 0x7fe3840b76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.427+0000 7fe38a419700 1 -- 172.21.15.123:0/3470316023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe374009550 con 0x7fe38406fef0 2023-03-08T15:50:32.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.427+0000 7fe38a419700 1 --2- 172.21.15.123:0/3470316023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe38406fef0 0x7fe3841d1010 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe374000c00 tx=0x7fe374004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:32.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.427+0000 7fe37affd700 1 -- 172.21.15.123:0/3470316023 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe374004400 con 0x7fe38406fef0 2023-03-08T15:50:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.427+0000 7fe37affd700 1 -- 172.21.15.123:0/3470316023 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37401f070 con 0x7fe38406fef0 2023-03-08T15:50:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.427+0000 7fe38c67d700 1 -- 172.21.15.123:0/3470316023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3840728f0 con 0x7fe38406fef0 2023-03-08T15:50:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.427+0000 7fe37affd700 1 -- 172.21.15.123:0/3470316023 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3740038e0 con 0x7fe38406fef0 2023-03-08T15:50:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.427+0000 7fe38c67d700 1 -- 172.21.15.123:0/3470316023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe384148220 con 0x7fe38406fef0 2023-03-08T15:50:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.428+0000 7fe38c67d700 1 -- 172.21.15.123:0/3470316023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3840b45f0 con 0x7fe38406fef0 2023-03-08T15:50:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.428+0000 7fe37affd700 1 -- 172.21.15.123:0/3470316023 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fe37402a020 con 0x7fe38406fef0 2023-03-08T15:50:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.429+0000 7fe37affd700 1 --2- 172.21.15.123:0/3470316023 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe3680698d0 0x7fe36806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:32.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.429+0000 7fe37affd700 1 -- 172.21.15.123:0/3470316023 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe374088bb0 con 0x7fe38406fef0 2023-03-08T15:50:32.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.429+0000 7fe389c18700 1 --2- 172.21.15.123:0/3470316023 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe3680698d0 0x7fe36806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:32.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.429+0000 7fe389c18700 1 --2- 172.21.15.123:0/3470316023 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe3680698d0 0x7fe36806bd80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe384149370 tx=0x7fe380009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:32.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.433+0000 7fe37affd700 1 -- 172.21.15.123:0/3470316023 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fe37408f080 con 0x7fe38406fef0 2023-03-08T15:50:32.661 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.660+0000 7fe38c67d700 1 -- 172.21.15.123:0/3470316023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3840744c0 con 0x7fe38406fef0 2023-03-08T15:50:32.662 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.660+0000 7fe37affd700 1 -- 172.21.15.123:0/3470316023 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3920 (secure 0 0 0) 0x7fe374015090 con 0x7fe38406fef0 2023-03-08T15:50:32.662 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:50:32.662 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/583987808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":583987808},{"type":"v1","addr":"172.21.15.175:6833","nonce":583987808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4822,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/1923847563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":1923847563},{"type":"v1","addr":"172.21.15.123:6837","nonce":1923847563}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-08T15:50:22.580766+0000","modified":"2023-03-08T15:50:25.857523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4896},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4896":{"gid":4896,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/2780487159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2780487159},{"type":"v1","addr":"172.21.15.123:6836","nonce":2780487159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-08T15:50:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.662+0000 7fe38c67d700 1 -- 172.21.15.123:0/3470316023 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe3680698d0 msgr2=0x7fe36806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.662+0000 7fe38c67d700 1 --2- 172.21.15.123:0/3470316023 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe3680698d0 0x7fe36806bd80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe384149370 tx=0x7fe380009040 comp rx=0 tx=0).stop 2023-03-08T15:50:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.662+0000 7fe38c67d700 1 -- 172.21.15.123:0/3470316023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe38406fef0 msgr2=0x7fe3841d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.662+0000 7fe38c67d700 1 --2- 172.21.15.123:0/3470316023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe38406fef0 0x7fe3841d1010 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe374000c00 tx=0x7fe374004750 comp rx=0 tx=0).stop 2023-03-08T15:50:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.662+0000 7fe38c67d700 1 -- 172.21.15.123:0/3470316023 shutdown_connections 2023-03-08T15:50:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.662+0000 7fe38c67d700 1 --2- 172.21.15.123:0/3470316023 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe3680698d0 0x7fe36806bd80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.662+0000 7fe38c67d700 1 --2- 172.21.15.123:0/3470316023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe38414b420 0x7fe384142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.662+0000 7fe38c67d700 1 --2- 172.21.15.123:0/3470316023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe38406fef0 0x7fe3841d1010 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.662+0000 7fe38c67d700 1 --2- 172.21.15.123:0/3470316023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe384147e50 0x7fe3840b76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.662+0000 7fe38c67d700 1 -- 172.21.15.123:0/3470316023 >> 172.21.15.123:0/3470316023 conn(0x7fe38406b360 msgr2=0x7fe3841d4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.662+0000 7fe38c67d700 1 -- 172.21.15.123:0/3470316023 shutdown_connections 2023-03-08T15:50:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:32.662+0000 7fe38c67d700 1 -- 172.21.15.123:0/3470316023 wait complete. 2023-03-08T15:50:32.666 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 16 2023-03-08T15:50:32.977 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-08T15:50:22.580766+0000', 'modified': '2023-03-08T15:50:25.857523+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4896}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4896': {'gid': 4896, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6836/2780487159', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 2780487159}, {'type': 'v1', 'addr': '172.21.15.123:6836', 'nonce': 2780487159}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-08T15:50:32.977 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-08T15:50:32.978 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-03-08T15:50:33.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.099+0000 7f335ca66700 1 Processor -- start 2023-03-08T15:50:33.100 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.099+0000 7f335ca66700 1 -- start start 2023-03-08T15:50:33.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.099+0000 7f335ca66700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33580b3c50 0x7f3358148970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.099+0000 7f335ca66700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3358148eb0 0x7f3358152d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.099+0000 7f335ca66700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33580bd420 con 0x7f33580b6a00 2023-03-08T15:50:33.102 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.099+0000 7f335ca66700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3358142cc0 con 0x7f33580b3c50 2023-03-08T15:50:33.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.099+0000 7f335ca66700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3358148520 con 0x7f3358148eb0 2023-03-08T15:50:33.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.100+0000 7f3355d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33580b3c50 0x7f3358148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.100+0000 7f3355d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33580b3c50 0x7f3358148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35600/0 (socket says 172.21.15.123:35600) 2023-03-08T15:50:33.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.100+0000 7f3355d9b700 1 -- 172.21.15.123:0/1933208947 learned_addr learned my addr 172.21.15.123:0/1933208947 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:33.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.100+0000 7f3355d9b700 1 -- 172.21.15.123:0/1933208947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3358148eb0 msgr2=0x7f3358152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:33.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.100+0000 7f3355d9b700 1 --2- 172.21.15.123:0/1933208947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3358148eb0 0x7f3358152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.103 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.100+0000 7f3355d9b700 1 -- 172.21.15.123:0/1933208947 >> v1:172.21.15.175:6789/0 conn(0x7f33580b6a00 legacy=0x7f335806b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:33.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.100+0000 7f3355d9b700 1 -- 172.21.15.123:0/1933208947 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3358071cd0 con 0x7f33580b3c50 2023-03-08T15:50:33.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.100+0000 7f3355d9b700 1 --2- 172.21.15.123:0/1933208947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33580b3c50 0x7f3358148970 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f334c0098f0 tx=0x7f334c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a077b1bda2b53b server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:33.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.100+0000 7f335559a700 1 -- 172.21.15.123:0/1933208947 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c004230 con 0x7f33580b3c50 2023-03-08T15:50:33.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.100+0000 7f335559a700 1 -- 172.21.15.123:0/1933208947 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c004390 con 0x7f33580b3c50 2023-03-08T15:50:33.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.100+0000 7f335559a700 1 -- 172.21.15.123:0/1933208947 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c0036a0 con 0x7f33580b3c50 2023-03-08T15:50:33.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.101+0000 7f335ca66700 1 -- 172.21.15.123:0/1933208947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33580b3c50 msgr2=0x7f3358148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:33.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.101+0000 7f335ca66700 1 --2- 172.21.15.123:0/1933208947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33580b3c50 0x7f3358148970 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f334c0098f0 tx=0x7f334c009c00 comp rx=0 tx=0).stop 2023-03-08T15:50:33.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.101+0000 7f335ca66700 1 -- 172.21.15.123:0/1933208947 shutdown_connections 2023-03-08T15:50:33.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.101+0000 7f335ca66700 1 --2- 172.21.15.123:0/1933208947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3358148eb0 0x7f3358152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.101+0000 7f335ca66700 1 --2- 172.21.15.123:0/1933208947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33580b3c50 0x7f3358148970 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.101+0000 7f335ca66700 1 -- 172.21.15.123:0/1933208947 >> 172.21.15.123:0/1933208947 conn(0x7f33580ba3c0 msgr2=0x7f33580bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:33.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.101+0000 7f335ca66700 1 -- 172.21.15.123:0/1933208947 shutdown_connections 2023-03-08T15:50:33.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.101+0000 7f335ca66700 1 -- 172.21.15.123:0/1933208947 wait complete. 2023-03-08T15:50:33.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.102+0000 7f335ca66700 1 Processor -- start 2023-03-08T15:50:33.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.102+0000 7f335ca66700 1 -- start start 2023-03-08T15:50:33.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.102+0000 7f335ca66700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33580b3c50 0x7f335806a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f335ca66700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33580b6a00 0x7f33580709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f335ca66700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358148eb0 0x7f335813b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f335ca66700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335806aa00 con 0x7f3358148eb0 2023-03-08T15:50:33.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f335ca66700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33581410b0 con 0x7f33580b6a00 2023-03-08T15:50:33.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f335ca66700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335806b0d0 con 0x7f33580b3c50 2023-03-08T15:50:33.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f3356d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358148eb0 0x7f335813b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f3356d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358148eb0 0x7f335813b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35604/0 (socket says 172.21.15.123:35604) 2023-03-08T15:50:33.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f3356d9d700 1 -- 172.21.15.123:0/3725076635 learned_addr learned my addr 172.21.15.123:0/3725076635 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:33.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f335659c700 1 --2- 172.21.15.123:0/3725076635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33580b3c50 0x7f335806a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f3355d9b700 1 --2- 172.21.15.123:0/3725076635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33580b6a00 0x7f33580709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f3356d9d700 1 -- 172.21.15.123:0/3725076635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33580b3c50 msgr2=0x7f335806a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:33.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f3356d9d700 1 --2- 172.21.15.123:0/3725076635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33580b3c50 0x7f335806a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f3356d9d700 1 -- 172.21.15.123:0/3725076635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33580b6a00 msgr2=0x7f33580709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:33.109 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f3356d9d700 1 --2- 172.21.15.123:0/3725076635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33580b6a00 0x7f33580709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f3356d9d700 1 -- 172.21.15.123:0/3725076635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c009550 con 0x7f3358148eb0 2023-03-08T15:50:33.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f3356d9d700 1 --2- 172.21.15.123:0/3725076635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358148eb0 0x7f335813b230 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f335000b9a0 tx=0x7f335000bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:33.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f3346ffd700 1 -- 172.21.15.123:0/3725076635 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335000c930 con 0x7f3358148eb0 2023-03-08T15:50:33.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f3346ffd700 1 -- 172.21.15.123:0/3725076635 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335000cab0 con 0x7f3358148eb0 2023-03-08T15:50:33.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f335ca66700 1 -- 172.21.15.123:0/3725076635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33581492f0 con 0x7f3358148eb0 2023-03-08T15:50:33.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f3346ffd700 1 -- 172.21.15.123:0/3725076635 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335000ce60 con 0x7f3358148eb0 2023-03-08T15:50:33.110 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.103+0000 7f335ca66700 1 -- 172.21.15.123:0/3725076635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335806b970 con 0x7f3358148eb0 2023-03-08T15:50:33.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.105+0000 7f3346ffd700 1 -- 172.21.15.123:0/3725076635 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f335001b030 con 0x7f3358148eb0 2023-03-08T15:50:33.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.105+0000 7f3346ffd700 1 --2- 172.21.15.123:0/3725076635 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f33380698d0 0x7f333806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.105+0000 7f335659c700 1 --2- 172.21.15.123:0/3725076635 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f33380698d0 0x7f333806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.105+0000 7f3346ffd700 1 -- 172.21.15.123:0/3725076635 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3350087260 con 0x7f3358148eb0 2023-03-08T15:50:33.111 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.105+0000 7f335659c700 1 --2- 172.21.15.123:0/3725076635 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f33380698d0 0x7f333806bd80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3348007fd0 tx=0x7f3348007ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:33.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.107+0000 7f3368bffb80 1 Processor -- start 2023-03-08T15:50:33.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.107+0000 7f3368bffb80 1 -- start start 2023-03-08T15:50:33.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.107+0000 7f3368bffb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f18610 0x564d69f4bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.107+0000 7f3368bffb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f13dc0 0x564d69f14850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.107+0000 7f3368bffb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f417b0 0x564d69f41c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.107+0000 7f3368bffb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d69e83c70 con 0x564d69f13dc0 2023-03-08T15:50:33.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.107+0000 7f3368bffb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d69e02c90 con 0x564d69f417b0 2023-03-08T15:50:33.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.107+0000 7f3368bffb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d69e71e50 con 0x564d69f18610 2023-03-08T15:50:33.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.108+0000 7f3355d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f13dc0 0x564d69f14850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.108+0000 7f3355d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f13dc0 0x564d69f14850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35608/0 (socket says 172.21.15.123:35608) 2023-03-08T15:50:33.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.108+0000 7f3355d9b700 1 -- 172.21.15.123:0/232799128 learned_addr learned my addr 172.21.15.123:0/232799128 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:33.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.108+0000 7f3356d9d700 1 --2- 172.21.15.123:0/232799128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f417b0 0x564d69f41c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.108+0000 7f335659c700 1 --2- 172.21.15.123:0/232799128 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f18610 0x564d69f4bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.108+0000 7f3355d9b700 1 -- 172.21.15.123:0/232799128 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f18610 msgr2=0x564d69f4bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:33.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.108+0000 7f3355d9b700 1 --2- 172.21.15.123:0/232799128 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f18610 0x564d69f4bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.108+0000 7f3355d9b700 1 -- 172.21.15.123:0/232799128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f417b0 msgr2=0x564d69f41c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:33.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.108+0000 7f3355d9b700 1 --2- 172.21.15.123:0/232799128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f417b0 0x564d69f41c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.108+0000 7f3355d9b700 1 -- 172.21.15.123:0/232799128 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d69c5f540 con 0x564d69f13dc0 2023-03-08T15:50:33.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.108+0000 7f3355d9b700 1 --2- 172.21.15.123:0/232799128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f13dc0 0x564d69f14850 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f334c00b0e0 tx=0x7f334c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b27e61be450329 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:33.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.108+0000 7f3337fff700 1 -- 172.21.15.123:0/232799128 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c0036a0 con 0x564d69f13dc0 2023-03-08T15:50:33.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.108+0000 7f3337fff700 1 -- 172.21.15.123:0/232799128 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c003820 con 0x564d69f13dc0 2023-03-08T15:50:33.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.108+0000 7f3337fff700 1 -- 172.21.15.123:0/232799128 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c003bd0 con 0x564d69f13dc0 2023-03-08T15:50:33.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.109+0000 7f3368bffb80 1 -- 172.21.15.123:0/232799128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f13dc0 msgr2=0x564d69f14850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:33.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.109+0000 7f3368bffb80 1 --2- 172.21.15.123:0/232799128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f13dc0 0x564d69f14850 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f334c00b0e0 tx=0x7f334c010000 comp rx=0 tx=0).stop 2023-03-08T15:50:33.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.109+0000 7f3368bffb80 1 -- 172.21.15.123:0/232799128 shutdown_connections 2023-03-08T15:50:33.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.109+0000 7f3368bffb80 1 --2- 172.21.15.123:0/232799128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f417b0 0x564d69f41c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.109+0000 7f3368bffb80 1 --2- 172.21.15.123:0/232799128 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f18610 0x564d69f4bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.109+0000 7f3368bffb80 1 --2- 172.21.15.123:0/232799128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f13dc0 0x564d69f14850 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.109+0000 7f3368bffb80 1 -- 172.21.15.123:0/232799128 >> 172.21.15.123:0/232799128 conn(0x564d69f0e290 msgr2=0x564d69f17d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:33.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.109+0000 7f3368bffb80 1 -- 172.21.15.123:0/232799128 shutdown_connections 2023-03-08T15:50:33.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.109+0000 7f3368bffb80 1 -- 172.21.15.123:0/232799128 wait complete. 2023-03-08T15:50:33.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.109+0000 7f3368bffb80 1 -- start start 2023-03-08T15:50:33.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.109+0000 7f3368bffb80 1 Processor -- start 2023-03-08T15:50:33.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.110+0000 7f3368bffb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f13dc0 0x564d69f3ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.110+0000 7f3368bffb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f18610 0x564d69f3f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.110+0000 7f3368bffb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f417b0 0x564d69f5b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.110+0000 7f3368bffb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d69e6b1c0 con 0x564d69f417b0 2023-03-08T15:50:33.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.110+0000 7f3368bffb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d69c60140 con 0x564d69f18610 2023-03-08T15:50:33.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.110+0000 7f3368bffb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d69f49840 con 0x564d69f13dc0 2023-03-08T15:50:33.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.110+0000 7f3368bffb80 10 client.0 _ll_register_callbacks cb 0x564d69e112a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-08T15:50:33.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.110+0000 7f3356d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f417b0 0x564d69f5b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.110+0000 7f3356d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f417b0 0x564d69f5b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35622/0 (socket says 172.21.15.123:35622) 2023-03-08T15:50:33.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.110+0000 7f3356d9d700 1 -- 172.21.15.123:0/3403294336 learned_addr learned my addr 172.21.15.123:0/3403294336 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:33.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.110+0000 7f335659c700 1 --2- 172.21.15.123:0/3403294336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f13dc0 0x564d69f3ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.110+0000 7f3355d9b700 1 --2- 172.21.15.123:0/3403294336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f18610 0x564d69f3f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3356d9d700 1 -- 172.21.15.123:0/3403294336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f13dc0 msgr2=0x564d69f3ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:33.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3356d9d700 1 --2- 172.21.15.123:0/3403294336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f13dc0 0x564d69f3ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3356d9d700 1 -- 172.21.15.123:0/3403294336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f18610 msgr2=0x564d69f3f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:33.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3356d9d700 1 --2- 172.21.15.123:0/3403294336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f18610 0x564d69f3f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3356d9d700 1 -- 172.21.15.123:0/3403294336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3358071cd0 con 0x564d69f417b0 2023-03-08T15:50:33.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f335659c700 1 --2- 172.21.15.123:0/3403294336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f13dc0 0x564d69f3ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:33.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3355d9b700 1 --2- 172.21.15.123:0/3403294336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f18610 0x564d69f3f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:33.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3356d9d700 1 --2- 172.21.15.123:0/3403294336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f417b0 0x564d69f5b200 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3350053120 tx=0x7f3350056440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573e23a48434db23 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:33.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f33357fa700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2023-03-08T15:50:33.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f33357fa700 1 -- 172.21.15.123:0/3403294336 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3350052b20 con 0x564d69f417b0 2023-03-08T15:50:33.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f33357fa700 1 -- 172.21.15.123:0/3403294336 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3350052c80 con 0x564d69f417b0 2023-03-08T15:50:33.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3368bffb80 1 -- 172.21.15.123:0/3403294336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d69f0b8a0 con 0x564d69f417b0 2023-03-08T15:50:33.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f33357fa700 1 -- 172.21.15.123:0/3403294336 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3350055bd0 con 0x564d69f417b0 2023-03-08T15:50:33.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3368bffb80 10 client.5115 fetch_fsmap learned FSMap version 16 2023-03-08T15:50:33.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3368bffb80 1 -- 172.21.15.123:0/3403294336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564d69c99b10 con 0x564d69f417b0 2023-03-08T15:50:33.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f33357fa700 1 -- 172.21.15.123:0/3403294336 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d69f0b8a0 con 0x564d69f417b0 2023-03-08T15:50:33.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f33357fa700 1 -- 172.21.15.123:0/3403294336 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 16) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f3350055d30 con 0x564d69f417b0 2023-03-08T15:50:33.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3368bffb80 10 client.5115 fetch_fsmap finished waiting for FSMap version 16 2023-03-08T15:50:33.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3368bffb80 10 client.5115 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-08T15:50:33.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3368bffb80 20 client.5115 populate_metadata read hostname 'smithi123' 2023-03-08T15:50:33.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3368bffb80 1 --2- 172.21.15.123:0/3403294336 >> [v2:172.21.15.123:6834/2780487159,v1:172.21.15.123:6836/2780487159] conn(0x564d69f5e740 0x564d69f5b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3368bffb80 4 client.5115 mds_command: new command op to 4896 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-08T15:50:33.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f3368bffb80 1 -- 172.21.15.123:0/3403294336 --> [v2:172.21.15.123:6834/2780487159,v1:172.21.15.123:6836/2780487159] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d69e64300 con 0x564d69f5e740 2023-03-08T15:50:33.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.111+0000 7f335659c700 1 --2- 172.21.15.123:0/3403294336 >> [v2:172.21.15.123:6834/2780487159,v1:172.21.15.123:6836/2780487159] conn(0x564d69f5e740 0x564d69f5b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.112+0000 7f33357fa700 10 client.5115 ms_handle_connect on v2:172.21.15.123:6834/2780487159 2023-03-08T15:50:33.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.112+0000 7f335659c700 1 --2- 172.21.15.123:0/3403294336 >> [v2:172.21.15.123:6834/2780487159,v1:172.21.15.123:6836/2780487159] conn(0x564d69f5e740 0x564d69f5b740 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf8a4b3342787cc3 server_cookie=d73304c75034e566 in_seq=0 out_seq=0 2023-03-08T15:50:33.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.112+0000 7f33357fa700 1 -- 172.21.15.123:0/3403294336 <== mds.0 v2:172.21.15.123:6834/2780487159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x564d69e64300 con 0x564d69f5e740 2023-03-08T15:50:33.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.112+0000 7f33357fa700 10 client.5115 handle_command_reply: tid=0 2023-03-08T15:50:33.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.112+0000 7f3368bffb80 1 client.5115 shutdown 2023-03-08T15:50:33.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.112+0000 7f3368bffb80 1 -- 172.21.15.123:0/3403294336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f417b0 msgr2=0x564d69f5b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.112+0000 7f3368bffb80 1 --2- 172.21.15.123:0/3403294336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f417b0 0x564d69f5b200 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3350053120 tx=0x7f3350056440 comp rx=0 tx=0).stop 2023-03-08T15:50:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.112+0000 7f3368bffb80 1 -- 172.21.15.123:0/3403294336 shutdown_connections 2023-03-08T15:50:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.112+0000 7f3368bffb80 1 --2- 172.21.15.123:0/3403294336 >> [v2:172.21.15.123:6834/2780487159,v1:172.21.15.123:6836/2780487159] conn(0x564d69f5e740 0x564d69f5b740 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.112+0000 7f3368bffb80 1 --2- 172.21.15.123:0/3403294336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f417b0 0x564d69f5b200 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.112+0000 7f3368bffb80 1 --2- 172.21.15.123:0/3403294336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f13dc0 0x564d69f3ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.112+0000 7f3368bffb80 1 --2- 172.21.15.123:0/3403294336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f18610 0x564d69f3f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.112+0000 7f33357fa700 0 client.5115 ms_handle_reset on v2:172.21.15.123:6834/2780487159 2023-03-08T15:50:33.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.112+0000 7f3368bffb80 1 -- 172.21.15.123:0/3403294336 >> 172.21.15.123:0/3403294336 conn(0x564d69f0e290 msgr2=0x564d69f14770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:33.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.113+0000 7f3368bffb80 1 -- 172.21.15.123:0/3403294336 shutdown_connections 2023-03-08T15:50:33.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.113+0000 7f3368bffb80 1 -- 172.21.15.123:0/3403294336 wait complete. 2023-03-08T15:50:33.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.113+0000 7f3368bffb80 20 client.5115 trim_cache size 0 max 16384 2023-03-08T15:50:33.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.130+0000 7f3368bffb80 1 Processor -- start 2023-03-08T15:50:33.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.130+0000 7f3368bffb80 1 -- start start 2023-03-08T15:50:33.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.130+0000 7f3368bffb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f13dc0 0x564d69f42360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.130+0000 7f3368bffb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f18610 0x564d69f12520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.130+0000 7f3368bffb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f417b0 0x564d69f4bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.130+0000 7f3368bffb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d69f5e600 con 0x564d69f417b0 2023-03-08T15:50:33.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.130+0000 7f3368bffb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d69f5ef00 con 0x564d69f13dc0 2023-03-08T15:50:33.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.130+0000 7f3368bffb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d69f443e0 con 0x564d69f18610 2023-03-08T15:50:33.134 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.130+0000 7f3356d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f417b0 0x564d69f4bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.130+0000 7f3356d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f417b0 0x564d69f4bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35630/0 (socket says 172.21.15.123:35630) 2023-03-08T15:50:33.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.130+0000 7f3356d9d700 1 -- 172.21.15.123:0/2551482263 learned_addr learned my addr 172.21.15.123:0/2551482263 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:33.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.131+0000 7f335659c700 1 --2- 172.21.15.123:0/2551482263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f13dc0 0x564d69f42360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.131+0000 7f3355d9b700 1 --2- 172.21.15.123:0/2551482263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f18610 0x564d69f12520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.131+0000 7f3356d9d700 1 -- 172.21.15.123:0/2551482263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f18610 msgr2=0x564d69f12520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:33.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.131+0000 7f3356d9d700 1 --2- 172.21.15.123:0/2551482263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f18610 0x564d69f12520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.135 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.131+0000 7f3356d9d700 1 -- 172.21.15.123:0/2551482263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f13dc0 msgr2=0x564d69f42360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:33.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.131+0000 7f3356d9d700 1 --2- 172.21.15.123:0/2551482263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f13dc0 0x564d69f42360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.131+0000 7f3356d9d700 1 -- 172.21.15.123:0/2551482263 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d69e32230 con 0x564d69f417b0 2023-03-08T15:50:33.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.131+0000 7f335659c700 1 --2- 172.21.15.123:0/2551482263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f13dc0 0x564d69f42360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:33.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.131+0000 7f3355d9b700 1 --2- 172.21.15.123:0/2551482263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f18610 0x564d69f12520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-08T15:50:33.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.131+0000 7f3356d9d700 1 --2- 172.21.15.123:0/2551482263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f417b0 0x564d69f4bcd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3350087590 tx=0x7f3350059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd12959c49f175ef server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:33.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.131+0000 7f3344ff9700 1 -- 172.21.15.123:0/2551482263 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33500098b0 con 0x564d69f417b0 2023-03-08T15:50:33.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.131+0000 7f3344ff9700 1 -- 172.21.15.123:0/2551482263 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3350055010 con 0x564d69f417b0 2023-03-08T15:50:33.136 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.131+0000 7f3344ff9700 1 -- 172.21.15.123:0/2551482263 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3350052d20 con 0x564d69f417b0 2023-03-08T15:50:33.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.131+0000 7f3368bffb80 1 -- 172.21.15.123:0/2551482263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f417b0 msgr2=0x564d69f4bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:33.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.131+0000 7f3368bffb80 1 --2- 172.21.15.123:0/2551482263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f417b0 0x564d69f4bcd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3350087590 tx=0x7f3350059000 comp rx=0 tx=0).stop 2023-03-08T15:50:33.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.132+0000 7f3368bffb80 1 -- 172.21.15.123:0/2551482263 shutdown_connections 2023-03-08T15:50:33.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.132+0000 7f3368bffb80 1 --2- 172.21.15.123:0/2551482263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f417b0 0x564d69f4bcd0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.132+0000 7f3368bffb80 1 --2- 172.21.15.123:0/2551482263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f13dc0 0x564d69f42360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.132+0000 7f3368bffb80 1 --2- 172.21.15.123:0/2551482263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f18610 0x564d69f12520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.137 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.132+0000 7f3368bffb80 1 -- 172.21.15.123:0/2551482263 >> 172.21.15.123:0/2551482263 conn(0x564d69f0e290 msgr2=0x564d69f133a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:33.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.132+0000 7f3368bffb80 1 -- 172.21.15.123:0/2551482263 shutdown_connections 2023-03-08T15:50:33.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.132+0000 7f3368bffb80 1 -- 172.21.15.123:0/2551482263 wait complete. 2023-03-08T15:50:33.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.132+0000 7f3368bffb80 1 -- start start 2023-03-08T15:50:33.138 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.132+0000 7f3368bffb80 1 Processor -- start 2023-03-08T15:50:33.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3368bffb80 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f13dc0 0x564d69fb2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3368bffb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f18610 0x564d69f5c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3368bffb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f417b0 0x564d69f5cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3368bffb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d69fb3960 con 0x564d69f18610 2023-03-08T15:50:33.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3368bffb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d69f0b560 con 0x564d69f417b0 2023-03-08T15:50:33.141 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3368bffb80 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d69f3f870 con 0x564d69f13dc0 2023-03-08T15:50:33.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3368bffb80 10 client.0 _ll_register_callbacks cb 0x564d69e112a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-08T15:50:33.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3355d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f18610 0x564d69f5c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3355d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f18610 0x564d69f5c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35632/0 (socket says 172.21.15.123:35632) 2023-03-08T15:50:33.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3355d9b700 1 -- 172.21.15.123:0/305396956 learned_addr learned my addr 172.21.15.123:0/305396956 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:33.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f335659c700 1 --2- 172.21.15.123:0/305396956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f13dc0 0x564d69fb2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3356d9d700 1 --2- 172.21.15.123:0/305396956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f417b0 0x564d69f5cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.142 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3355d9b700 1 -- 172.21.15.123:0/305396956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f13dc0 msgr2=0x564d69fb2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3355d9b700 1 --2- 172.21.15.123:0/305396956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f13dc0 0x564d69fb2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3355d9b700 1 -- 172.21.15.123:0/305396956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f417b0 msgr2=0x564d69f5cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3355d9b700 1 --2- 172.21.15.123:0/305396956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f417b0 0x564d69f5cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3355d9b700 1 -- 172.21.15.123:0/305396956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d69c99b10 con 0x564d69f18610 2023-03-08T15:50:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f3355d9b700 1 --2- 172.21.15.123:0/305396956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f18610 0x564d69f5c9f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f334c009c40 tx=0x7f334c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4558bdee74d9402c server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.133+0000 7f33357fa700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2023-03-08T15:50:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f33357fa700 1 -- 172.21.15.123:0/305396956 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c02b070 con 0x564d69f18610 2023-03-08T15:50:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f33357fa700 1 -- 172.21.15.123:0/305396956 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f334c003990 con 0x564d69f18610 2023-03-08T15:50:33.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f3368bffb80 1 -- 172.21.15.123:0/305396956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f334c003820 con 0x564d69f18610 2023-03-08T15:50:33.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f33357fa700 1 -- 172.21.15.123:0/305396956 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f334c003b50 con 0x564d69f18610 2023-03-08T15:50:33.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f3368bffb80 10 client.5121 fetch_fsmap learned FSMap version 16 2023-03-08T15:50:33.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f3368bffb80 1 -- 172.21.15.123:0/305396956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564d69c82990 con 0x564d69f18610 2023-03-08T15:50:33.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f33357fa700 1 -- 172.21.15.123:0/305396956 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c003820 con 0x564d69f18610 2023-03-08T15:50:33.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f33357fa700 1 -- 172.21.15.123:0/305396956 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 16) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f334c018070 con 0x564d69f18610 2023-03-08T15:50:33.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f3368bffb80 10 client.5121 fetch_fsmap finished waiting for FSMap version 16 2023-03-08T15:50:33.144 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f3368bffb80 10 client.5121 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-08T15:50:33.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f3368bffb80 20 client.5121 populate_metadata read hostname 'smithi123' 2023-03-08T15:50:33.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f3368bffb80 1 --2- 172.21.15.123:0/305396956 >> [v2:172.21.15.123:6834/2780487159,v1:172.21.15.123:6836/2780487159] conn(0x564d69f4c0d0 0x564d69f5d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f3368bffb80 4 client.5121 mds_command: new command op to 4896 tid=0[{"prefix": "status"}] 2023-03-08T15:50:33.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f3368bffb80 1 -- 172.21.15.123:0/305396956 --> [v2:172.21.15.123:6834/2780487159,v1:172.21.15.123:6836/2780487159] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564d69cbaca0 con 0x564d69f4c0d0 2023-03-08T15:50:33.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f335659c700 1 --2- 172.21.15.123:0/305396956 >> [v2:172.21.15.123:6834/2780487159,v1:172.21.15.123:6836/2780487159] conn(0x564d69f4c0d0 0x564d69f5d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f33357fa700 10 client.5121 ms_handle_connect on v2:172.21.15.123:6834/2780487159 2023-03-08T15:50:33.145 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.134+0000 7f335659c700 1 --2- 172.21.15.123:0/305396956 >> [v2:172.21.15.123:6834/2780487159,v1:172.21.15.123:6836/2780487159] conn(0x564d69f4c0d0 0x564d69f5d470 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d94a66b16211f32f server_cookie=72430879d4b89eb7 in_seq=0 out_seq=0 2023-03-08T15:50:33.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f33357fa700 1 -- 172.21.15.123:0/305396956 <== mds.0 v2:172.21.15.123:6834/2780487159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x564d69cbaca0 con 0x564d69f4c0d0 2023-03-08T15:50:33.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f33357fa700 10 client.5121 handle_command_reply: tid=0 2023-03-08T15:50:33.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f3368bffb80 1 client.5121 shutdown 2023-03-08T15:50:33.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f3368bffb80 1 -- 172.21.15.123:0/305396956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f18610 msgr2=0x564d69f5c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:33.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f3368bffb80 1 --2- 172.21.15.123:0/305396956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f18610 0x564d69f5c9f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f334c009c40 tx=0x7f334c0047c0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f3368bffb80 1 -- 172.21.15.123:0/305396956 shutdown_connections 2023-03-08T15:50:33.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f3368bffb80 1 --2- 172.21.15.123:0/305396956 >> [v2:172.21.15.123:6834/2780487159,v1:172.21.15.123:6836/2780487159] conn(0x564d69f4c0d0 0x564d69f5d470 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.146 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f3368bffb80 1 --2- 172.21.15.123:0/305396956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d69f417b0 0x564d69f5cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f33357fa700 0 client.5121 ms_handle_reset on v2:172.21.15.123:6834/2780487159 2023-03-08T15:50:33.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f3368bffb80 1 --2- 172.21.15.123:0/305396956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564d69f13dc0 0x564d69fb2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f3368bffb80 1 --2- 172.21.15.123:0/305396956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564d69f18610 0x564d69f5c9f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f3368bffb80 1 -- 172.21.15.123:0/305396956 >> 172.21.15.123:0/305396956 conn(0x564d69f0e290 msgr2=0x564d69f12520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:33.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f3368bffb80 1 -- 172.21.15.123:0/305396956 shutdown_connections 2023-03-08T15:50:33.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f3368bffb80 1 -- 172.21.15.123:0/305396956 wait complete. 2023-03-08T15:50:33.147 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f3368bffb80 20 client.5121 trim_cache size 0 max 16384 2023-03-08T15:50:33.148 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2023-03-08T15:50:33.148 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "1b15c317-0b05-4434-b72b-9beacb9cbd31", 2023-03-08T15:50:33.148 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2023-03-08T15:50:33.148 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4896, 2023-03-08T15:50:33.148 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2023-03-08T15:50:33.148 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2023-03-08T15:50:33.149 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2023-03-08T15:50:33.149 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 10.553314552, 2023-03-08T15:50:33.149 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 16, 2023-03-08T15:50:33.149 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 34, 2023-03-08T15:50:33.149 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 34, 2023-03-08T15:50:33.149 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 17.890673563 2023-03-08T15:50:33.149 INFO:teuthology.orchestra.run.smithi123.stdout:} 2023-03-08T15:50:33.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f335ca66700 1 -- 172.21.15.123:0/3725076635 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f33380698d0 msgr2=0x7f333806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:33.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f335ca66700 1 --2- 172.21.15.123:0/3725076635 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f33380698d0 0x7f333806bd80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3348007fd0 tx=0x7f3348007ec0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f335ca66700 1 -- 172.21.15.123:0/3725076635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358148eb0 msgr2=0x7f335813b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:33.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f335ca66700 1 --2- 172.21.15.123:0/3725076635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358148eb0 0x7f335813b230 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f335000b9a0 tx=0x7f335000bcb0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f335ca66700 1 -- 172.21.15.123:0/3725076635 shutdown_connections 2023-03-08T15:50:33.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f335ca66700 1 --2- 172.21.15.123:0/3725076635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3358148eb0 0x7f335813b230 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f335ca66700 1 --2- 172.21.15.123:0/3725076635 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f33380698d0 0x7f333806bd80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.151 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f335ca66700 1 --2- 172.21.15.123:0/3725076635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33580b3c50 0x7f335806a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f335ca66700 1 --2- 172.21.15.123:0/3725076635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33580b6a00 0x7f33580709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f335ca66700 1 -- 172.21.15.123:0/3725076635 >> 172.21.15.123:0/3725076635 conn(0x7f33580ba3c0 msgr2=0x7f3358146320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:33.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.135+0000 7f335ca66700 1 -- 172.21.15.123:0/3725076635 shutdown_connections 2023-03-08T15:50:33.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.136+0000 7f335ca66700 1 -- 172.21.15.123:0/3725076635 wait complete. 2023-03-08T15:50:33.152 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-08T15:50:33.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.271+0000 7f03b7b44700 1 Processor -- start 2023-03-08T15:50:33.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.272+0000 7f03b7b44700 1 -- start start 2023-03-08T15:50:33.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.272+0000 7f03b7b44700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f03b0142680 0x7f03b014b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.272+0000 7f03b7b44700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f03b00b92f0 0x7f03b0152d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.272+0000 7f03b7b44700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b00b9710 con 0x7f03b00b7f80 2023-03-08T15:50:33.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.272+0000 7f03b7b44700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b00b71e0 con 0x7f03b0142680 2023-03-08T15:50:33.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.272+0000 7f03b7b44700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b00ba0d0 con 0x7f03b00b92f0 2023-03-08T15:50:33.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.272+0000 7f03b58e0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f03b0142680 0x7f03b014b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.272+0000 7f03b58e0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f03b0142680 0x7f03b014b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35644/0 (socket says 172.21.15.123:35644) 2023-03-08T15:50:33.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.272+0000 7f03b58e0700 1 -- 172.21.15.123:0/114696277 learned_addr learned my addr 172.21.15.123:0/114696277 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:33.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.273+0000 7f03b60e1700 1 --2- 172.21.15.123:0/114696277 >> v2:172.21.15.175:3300/0 conn(0x7f03b00b92f0 0x7f03b0152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.273+0000 7f03b58e0700 1 -- 172.21.15.123:0/114696277 >> v2:172.21.15.175:3300/0 conn(0x7f03b00b92f0 msgr2=0x7f03b0152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:50:33.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.273+0000 7f03b58e0700 1 --2- 172.21.15.123:0/114696277 >> v2:172.21.15.175:3300/0 conn(0x7f03b00b92f0 0x7f03b0152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.273+0000 7f03b58e0700 1 -- 172.21.15.123:0/114696277 >> v1:172.21.15.175:6789/0 conn(0x7f03b00b7f80 legacy=0x7f03b0071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.273+0000 7f03b58e0700 1 -- 172.21.15.123:0/114696277 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b00ba690 con 0x7f03b0142680 2023-03-08T15:50:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.273+0000 7f03b58e0700 1 --2- 172.21.15.123:0/114696277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b0142680 0x7f03b014b9b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f03b0066c30 tx=0x7f03a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89ae604a07dd6ff server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.273+0000 7f03b48de700 1 -- 172.21.15.123:0/114696277 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4011830 con 0x7f03b0142680 2023-03-08T15:50:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.273+0000 7f03b48de700 1 -- 172.21.15.123:0/114696277 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a4011990 con 0x7f03b0142680 2023-03-08T15:50:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.273+0000 7f03b48de700 1 -- 172.21.15.123:0/114696277 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4011d20 con 0x7f03b0142680 2023-03-08T15:50:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.273+0000 7f03b7b44700 1 -- 172.21.15.123:0/114696277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b0142680 msgr2=0x7f03b014b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.273+0000 7f03b7b44700 1 --2- 172.21.15.123:0/114696277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b0142680 0x7f03b014b9b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f03b0066c30 tx=0x7f03a4009bd0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.273+0000 7f03b7b44700 1 -- 172.21.15.123:0/114696277 shutdown_connections 2023-03-08T15:50:33.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.273+0000 7f03b7b44700 1 --2- 172.21.15.123:0/114696277 >> v2:172.21.15.175:3300/0 conn(0x7f03b00b92f0 0x7f03b0152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.273+0000 7f03b7b44700 1 --2- 172.21.15.123:0/114696277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b0142680 0x7f03b014b9b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.273+0000 7f03b7b44700 1 -- 172.21.15.123:0/114696277 >> 172.21.15.123:0/114696277 conn(0x7f03b006b360 msgr2=0x7f03b006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:33.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.274+0000 7f03b7b44700 1 -- 172.21.15.123:0/114696277 shutdown_connections 2023-03-08T15:50:33.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.274+0000 7f03b7b44700 1 -- 172.21.15.123:0/114696277 wait complete. 2023-03-08T15:50:33.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.275+0000 7f03b7b44700 1 Processor -- start 2023-03-08T15:50:33.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.275+0000 7f03b7b44700 1 -- start start 2023-03-08T15:50:33.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.275+0000 7f03b7b44700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03b00b7f80 0x7f03b0070210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.275+0000 7f03b7b44700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b00b92f0 0x7f03b01e2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.275+0000 7f03b7b44700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b0142680 0x7f03b014ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.275+0000 7f03b7b44700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b014b0c0 con 0x7f03b0142680 2023-03-08T15:50:33.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.275+0000 7f03b7b44700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b006fd80 con 0x7f03b00b7f80 2023-03-08T15:50:33.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.275+0000 7f03b7b44700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b00719f0 con 0x7f03b00b92f0 2023-03-08T15:50:33.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.275+0000 7f03b60e1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b0142680 0x7f03b014ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.275+0000 7f03b60e1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b0142680 0x7f03b014ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35648/0 (socket says 172.21.15.123:35648) 2023-03-08T15:50:33.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.275+0000 7f03b60e1700 1 -- 172.21.15.123:0/1200720751 learned_addr learned my addr 172.21.15.123:0/1200720751 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:50:33.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.275+0000 7f03b58e0700 1 --2- 172.21.15.123:0/1200720751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03b00b7f80 0x7f03b0070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.275+0000 7f03b50df700 1 --2- 172.21.15.123:0/1200720751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b00b92f0 0x7f03b01e2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.276+0000 7f03b60e1700 1 -- 172.21.15.123:0/1200720751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b00b92f0 msgr2=0x7f03b01e2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:33.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.276+0000 7f03b60e1700 1 --2- 172.21.15.123:0/1200720751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b00b92f0 0x7f03b01e2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.276+0000 7f03b60e1700 1 -- 172.21.15.123:0/1200720751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03b00b7f80 msgr2=0x7f03b0070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:33.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.276+0000 7f03b60e1700 1 --2- 172.21.15.123:0/1200720751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03b00b7f80 0x7f03b0070210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.276+0000 7f03b60e1700 1 -- 172.21.15.123:0/1200720751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a4009550 con 0x7f03b0142680 2023-03-08T15:50:33.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.276+0000 7f03b50df700 1 --2- 172.21.15.123:0/1200720751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b00b92f0 0x7f03b01e2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:50:33.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.276+0000 7f03b60e1700 1 --2- 172.21.15.123:0/1200720751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b0142680 0x7f03b014ab80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f03a800efc0 tx=0x7f03a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:33.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.276+0000 7f03a27fc700 1 -- 172.21.15.123:0/1200720751 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8009ea0 con 0x7f03b0142680 2023-03-08T15:50:33.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.276+0000 7f03a27fc700 1 -- 172.21.15.123:0/1200720751 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a800f040 con 0x7f03b0142680 2023-03-08T15:50:33.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.276+0000 7f03b7b44700 1 -- 172.21.15.123:0/1200720751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b00ba8e0 con 0x7f03b0142680 2023-03-08T15:50:33.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.276+0000 7f03a27fc700 1 -- 172.21.15.123:0/1200720751 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8014480 con 0x7f03b0142680 2023-03-08T15:50:33.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.276+0000 7f03b7b44700 1 -- 172.21.15.123:0/1200720751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b0072330 con 0x7f03b0142680 2023-03-08T15:50:33.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.277+0000 7f03b7b44700 1 -- 172.21.15.123:0/1200720751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b00b8dd0 con 0x7f03b0142680 2023-03-08T15:50:33.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.277+0000 7f03a27fc700 1 -- 172.21.15.123:0/1200720751 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f03a80145e0 con 0x7f03b0142680 2023-03-08T15:50:33.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.278+0000 7f03a27fc700 1 --2- 172.21.15.123:0/1200720751 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f03940698d0 0x7f039406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:50:33.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.278+0000 7f03a27fc700 1 -- 172.21.15.123:0/1200720751 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03a8088080 con 0x7f03b0142680 2023-03-08T15:50:33.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.278+0000 7f03b58e0700 1 --2- 172.21.15.123:0/1200720751 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f03940698d0 0x7f039406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:50:33.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.278+0000 7f03b58e0700 1 --2- 172.21.15.123:0/1200720751 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f03940698d0 0x7f039406bd80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f03a4014040 tx=0x7f03a4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:50:33.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.282+0000 7f03a27fc700 1 -- 172.21.15.123:0/1200720751 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f03a8053e50 con 0x7f03b0142680 2023-03-08T15:50:33.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.507+0000 7f03b7b44700 1 -- 172.21.15.123:0/1200720751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f03b00744c0 con 0x7f03b0142680 2023-03-08T15:50:33.509 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.508+0000 7f03a27fc700 1 -- 172.21.15.123:0/1200720751 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f03a8018060 con 0x7f03b0142680 2023-03-08T15:50:33.510 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-08T15:50:33.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.510+0000 7f03b7b44700 1 -- 172.21.15.123:0/1200720751 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f03940698d0 msgr2=0x7f039406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:33.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.510+0000 7f03b7b44700 1 --2- 172.21.15.123:0/1200720751 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f03940698d0 0x7f039406bd80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f03a4014040 tx=0x7f03a4008030 comp rx=0 tx=0).stop 2023-03-08T15:50:33.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.510+0000 7f03b7b44700 1 -- 172.21.15.123:0/1200720751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b0142680 msgr2=0x7f03b014ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:50:33.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.510+0000 7f03b7b44700 1 --2- 172.21.15.123:0/1200720751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b0142680 0x7f03b014ab80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f03a800efc0 tx=0x7f03a800c3a0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.510+0000 7f03b7b44700 1 -- 172.21.15.123:0/1200720751 shutdown_connections 2023-03-08T15:50:33.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.510+0000 7f03b7b44700 1 --2- 172.21.15.123:0/1200720751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b0142680 0x7f03b014ab80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.510+0000 7f03b7b44700 1 --2- 172.21.15.123:0/1200720751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03b00b7f80 0x7f03b0070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.510+0000 7f03b7b44700 1 --2- 172.21.15.123:0/1200720751 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f03940698d0 0x7f039406bd80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.510+0000 7f03b7b44700 1 --2- 172.21.15.123:0/1200720751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03b00b92f0 0x7f03b01e2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:50:33.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.510+0000 7f03b7b44700 1 -- 172.21.15.123:0/1200720751 >> 172.21.15.123:0/1200720751 conn(0x7f03b006b360 msgr2=0x7f03b0071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:50:33.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.510+0000 7f03b7b44700 1 -- 172.21.15.123:0/1200720751 shutdown_connections 2023-03-08T15:50:33.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:50:33.510+0000 7f03b7b44700 1 -- 172.21.15.123:0/1200720751 wait complete. 2023-03-08T15:50:33.523 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-03-08T15:50:33.523 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-08T15:50:33.523 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi182.front.sepia.ceph.com 2023-03-08T15:50:33.524 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-08T15:50:33.524 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-08T15:50:33.524 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-03-08T15:50:33.524 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-03-08T15:50:33.525 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-08T15:50:33.525 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-08T15:50:33.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:33.526 DEBUG:teuthology.orchestra.run.smithi182:> ip addr 2023-03-08T15:50:33.598 INFO:teuthology.orchestra.run.smithi182.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-08T15:50:33.598 INFO:teuthology.orchestra.run.smithi182.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-08T15:50:33.598 INFO:teuthology.orchestra.run.smithi182.stdout: inet 127.0.0.1/8 scope host lo 2023-03-08T15:50:33.598 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-03-08T15:50:33.598 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 ::1/128 scope host 2023-03-08T15:50:33.598 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-03-08T15:50:33.599 INFO:teuthology.orchestra.run.smithi182.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-08T15:50:33.599 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:d9:19:46 brd ff:ff:ff:ff:ff:ff 2023-03-08T15:50:33.599 INFO:teuthology.orchestra.run.smithi182.stdout: altname enp7s0f0 2023-03-08T15:50:33.599 INFO:teuthology.orchestra.run.smithi182.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-08T15:50:33.599 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:d9:19:47 brd ff:ff:ff:ff:ff:ff 2023-03-08T15:50:33.599 INFO:teuthology.orchestra.run.smithi182.stdout: altname enp7s0f1 2023-03-08T15:50:33.599 INFO:teuthology.orchestra.run.smithi182.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-08T15:50:33.600 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:88:77:8c brd ff:ff:ff:ff:ff:ff 2023-03-08T15:50:33.600 INFO:teuthology.orchestra.run.smithi182.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-08T15:50:33.600 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 0c:c4:7a:88:77:8d brd ff:ff:ff:ff:ff:ff 2023-03-08T15:50:33.600 INFO:teuthology.orchestra.run.smithi182.stdout: inet 172.21.15.182/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-03-08T15:50:33.600 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft 42157sec preferred_lft 42157sec 2023-03-08T15:50:33.600 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 fe80::ec4:7aff:fe88:778d/64 scope link 2023-03-08T15:50:33.600 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-03-08T15:50:33.601 INFO:teuthology.orchestra.run.smithi182.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-08T15:50:33.601 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 8a:2d:64:16:1d:1b brd ff:ff:ff:ff:ff:ff 2023-03-08T15:50:33.601 INFO:teuthology.orchestra.run.smithi182.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-03-08T15:50:33.601 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-03-08T15:50:33.601 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 fe80::e4d0:72ff:fe52:e4a9/64 scope link 2023-03-08T15:50:33.601 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-03-08T15:50:33.601 INFO:teuthology.orchestra.run.smithi182.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-08T15:50:33.601 INFO:teuthology.orchestra.run.smithi182.stdout: link/ether 8a:2d:64:16:1d:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-08T15:50:33.602 INFO:teuthology.orchestra.run.smithi182.stdout: inet6 fe80::882d:64ff:fe16:1d1b/64 scope link 2023-03-08T15:50:33.602 INFO:teuthology.orchestra.run.smithi182.stdout: valid_lft forever preferred_lft forever 2023-03-08T15:50:33.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:33.603 DEBUG:teuthology.orchestra.run.smithi182:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-08T15:50:33.699 INFO:teuthology.orchestra.run.smithi182.stdout:1 2023-03-08T15:50:33.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:33.705 DEBUG:teuthology.orchestra.run.smithi182:> route 2023-03-08T15:50:33.775 INFO:teuthology.orchestra.run.smithi182.stdout:Kernel IP routing table 2023-03-08T15:50:33.775 INFO:teuthology.orchestra.run.smithi182.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-08T15:50:33.776 INFO:teuthology.orchestra.run.smithi182.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-08T15:50:33.776 INFO:teuthology.orchestra.run.smithi182.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-03-08T15:50:33.776 INFO:teuthology.orchestra.run.smithi182.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-08T15:50:33.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:33.777 DEBUG:teuthology.orchestra.run.smithi182:> (cd / && exec bash -c ' 2023-03-08T15:50:33.777 DEBUG:teuthology.orchestra.run.smithi182:> set -e 2023-03-08T15:50:33.778 DEBUG:teuthology.orchestra.run.smithi182:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-08T15:50:33.778 DEBUG:teuthology.orchestra.run.smithi182:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-08T15:50:33.778 DEBUG:teuthology.orchestra.run.smithi182:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-08T15:50:33.779 DEBUG:teuthology.orchestra.run.smithi182:> ') 2023-03-08T15:50:34.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:34.017 DEBUG:teuthology.orchestra.run.smithi182:> ip netns list 2023-03-08T15:50:34.084 INFO:teuthology.orchestra.run.smithi182.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-03-08T15:50:34.085 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-08T15:50:34.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:34.085 DEBUG:teuthology.orchestra.run.smithi182:> sudo ip link set brx.0 up 2023-03-08T15:50:34.185 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-08T15:50:34.186 DEBUG:teuthology.orchestra.run.smithi182:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-03-08T15:50:34.252 INFO:teuthology.orchestra.run.smithi182.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-03-08T15:50:34.253 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-08T15:50:34.254 DEBUG:teuthology.orchestra.run.smithi182:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-03-08T15:50:34.319 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-03-08T15:50:34.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:34.320 DEBUG:teuthology.orchestra.run.smithi182:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-08T15:50:34.465 INFO:teuthology.orchestra.run.smithi182.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-08T15:50:34.465 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-08T15:50:34.465 INFO:teuthology.orchestra.run.smithi182.stdout:invalid new device string format 2023-03-08T15:50:34.487 INFO:teuthology.orchestra.run.smithi182.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-08T15:50:34.488 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-08T15:50:34.488 INFO:teuthology.orchestra.run.smithi182.stdout:invalid new device string format 2023-03-08T15:50:34.488 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.175:3300,172.21.15.175:3301" 2023-03-08T15:50:34.488 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-08T15:50:34.513 INFO:teuthology.orchestra.run.smithi182.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-08T15:50:34.513 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-08T15:50:34.514 INFO:teuthology.orchestra.run.smithi182.stdout:invalid new device string format 2023-03-08T15:50:34.514 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.175:3300,172.21.15.175:3301" 2023-03-08T15:50:34.514 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-08T15:50:34.514 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.175:6789,172.21.15.175:6790" 2023-03-08T15:50:34.514 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.175:6789,172.21.15.175:6790:/ 2023-03-08T15:50:34.514 INFO:teuthology.orchestra.run.smithi182.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1b15c317-0b05-4434-b72b-9beacb9cbd31" will pass to kernel 2023-03-08T15:50:34.522 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-08T15:50:34.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:34.523 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-03-08T15:50:34.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:34.623 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-08T15:50:34.770 INFO:teuthology.orchestra.run.smithi182.stdout:client4969 2023-03-08T15:50:34.771 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:50:34.771 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-08T15:50:34.838 DEBUG:teuthology.orchestra.run.smithi182:> mktemp -d --suffix=xfstests-dev 2023-03-08T15:50:34.904 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.AsxONLoNsgxfstests-dev 2023-03-08T15:50:34.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:34.905 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.AsxONLoNsgxfstests-dev) 2023-03-08T15:50:35.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:35.007 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.AsxONLoNsgxfstests-dev) 2023-03-08T15:50:35.082 INFO:teuthology.orchestra.run.smithi182.stderr:Cloning into '/tmp/tmp.AsxONLoNsgxfstests-dev'... 2023-03-08T15:50:36.038 DEBUG:teuthology.orchestra.run.smithi182:> mktemp -d --suffix=xfsprogs-dev 2023-03-08T15:50:36.105 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.P05QXIwErbxfsprogs-dev 2023-03-08T15:50:36.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:36.106 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.P05QXIwErbxfsprogs-dev) 2023-03-08T15:50:36.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:36.207 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.P05QXIwErbxfsprogs-dev) 2023-03-08T15:50:36.275 INFO:teuthology.orchestra.run.smithi182.stderr:Cloning into '/tmp/tmp.P05QXIwErbxfsprogs-dev'... 2023-03-08T15:50:36.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:36.846 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-03-08T15:50:36.919 DEBUG:teuthology.orchestra.run.smithi182:> mktemp -d --suffix=test 2023-03-08T15:50:36.985 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.maEWJIuC5stest 2023-03-08T15:50:36.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-08T15:50:36.986 DEBUG:teuthology.orchestra.run.smithi182:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-03-08T15:50:37.059 DEBUG:teuthology.orchestra.run.smithi182:> mktemp -d --suffix=scratch 2023-03-08T15:50:37.125 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.gBRMxQDUw9scratch 2023-03-08T15:50:37.125 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-03-08T15:50:37.126 DEBUG:teuthology.orchestra.run.smithi182:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel xfsprogs-qa-devel 2023-03-08T15:50:38.175 INFO:teuthology.orchestra.run.smithi182.stdout:Last metadata expiration check: 0:04:25 ago on Wed 08 Mar 2023 03:46:13 PM UTC. 2023-03-08T15:50:38.675 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:50:38.678 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:50:38.681 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:50:39.328 INFO:teuthology.orchestra.run.smithi182.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-03-08T15:50:39.329 INFO:teuthology.orchestra.run.smithi182.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-03-08T15:50:39.330 INFO:teuthology.orchestra.run.smithi182.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-03-08T15:50:39.331 INFO:teuthology.orchestra.run.smithi182.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-03-08T15:50:39.332 INFO:teuthology.orchestra.run.smithi182.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-03-08T15:50:39.334 INFO:teuthology.orchestra.run.smithi182.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-03-08T15:50:39.336 INFO:teuthology.orchestra.run.smithi182.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-03-08T15:50:39.337 INFO:teuthology.orchestra.run.smithi182.stdout:Package gcc-8.5.0-17.el8.x86_64 is already installed. 2023-03-08T15:50:39.338 INFO:teuthology.orchestra.run.smithi182.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-03-08T15:50:39.339 INFO:teuthology.orchestra.run.smithi182.stdout:Package lvm2-8:2.03.14-6.el8.x86_64 is already installed. 2023-03-08T15:50:39.340 INFO:teuthology.orchestra.run.smithi182.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-03-08T15:50:39.341 INFO:teuthology.orchestra.run.smithi182.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-03-08T15:50:39.342 INFO:teuthology.orchestra.run.smithi182.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-03-08T15:50:39.343 INFO:teuthology.orchestra.run.smithi182.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-03-08T15:50:39.345 INFO:teuthology.orchestra.run.smithi182.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-08T15:50:39.345 INFO:teuthology.orchestra.run.smithi182.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-08T15:50:39.346 INFO:teuthology.orchestra.run.smithi182.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-08T15:50:39.347 INFO:teuthology.orchestra.run.smithi182.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-08T15:50:39.348 INFO:teuthology.orchestra.run.smithi182.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-03-08T15:50:39.349 INFO:teuthology.orchestra.run.smithi182.stdout:Package libuuid-devel-2.32.1-40.el8.x86_64 is already installed. 2023-03-08T15:50:39.351 INFO:teuthology.orchestra.run.smithi182.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-03-08T15:50:39.352 INFO:teuthology.orchestra.run.smithi182.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-03-08T15:50:39.356 INFO:teuthology.orchestra.run.smithi182.stdout:Package gettext-0.19.8.1-17.el8.x86_64 is already installed. 2023-03-08T15:50:39.362 INFO:teuthology.orchestra.run.smithi182.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-08T15:50:39.495 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies resolved. 2023-03-08T15:50:39.500 INFO:teuthology.orchestra.run.smithi182.stdout:=================================================================================================== 2023-03-08T15:50:39.500 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository Size 2023-03-08T15:50:39.500 INFO:teuthology.orchestra.run.smithi182.stdout:=================================================================================================== 2023-03-08T15:50:39.501 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2023-03-08T15:50:39.501 INFO:teuthology.orchestra.run.smithi182.stdout: device-mapper-devel x86_64 8:1.02.181-9.el8 CentOS-PowerTools 284 k 2023-03-08T15:50:39.501 INFO:teuthology.orchestra.run.smithi182.stdout: dump x86_64 1:0.4-0.36.b46.el8 CentOS-BaseOS 164 k 2023-03-08T15:50:39.501 INFO:teuthology.orchestra.run.smithi182.stdout: fio x86_64 3.19-4.el8 CentOS-AppStream 538 k 2023-03-08T15:50:39.501 INFO:teuthology.orchestra.run.smithi182.stdout: indent x86_64 2.2.12-4.el8 epel 185 k 2023-03-08T15:50:39.501 INFO:teuthology.orchestra.run.smithi182.stdout: inih-devel x86_64 56-1.el8 epel 13 k 2023-03-08T15:50:39.501 INFO:teuthology.orchestra.run.smithi182.stdout: libblkid-devel x86_64 2.32.1-40.el8 CentOS-BaseOS 87 k 2023-03-08T15:50:39.502 INFO:teuthology.orchestra.run.smithi182.stdout: libedit-devel x86_64 3.1-23.20170329cvs.el8 CentOS-PowerTools 44 k 2023-03-08T15:50:39.502 INFO:teuthology.orchestra.run.smithi182.stdout: libicu-devel x86_64 60.3-2.el8_1 CentOS-BaseOS 922 k 2023-03-08T15:50:39.502 INFO:teuthology.orchestra.run.smithi182.stdout: python2 x86_64 2.7.18-11.module_el8.7.0+1179+42dadd5f CentOS-AppStream 110 k 2023-03-08T15:50:39.502 INFO:teuthology.orchestra.run.smithi182.stdout: userspace-rcu-devel x86_64 0.10.1-4.el8 CentOS-PowerTools 84 k 2023-03-08T15:50:39.502 INFO:teuthology.orchestra.run.smithi182.stdout:Upgrading: 2023-03-08T15:50:39.502 INFO:teuthology.orchestra.run.smithi182.stdout: cpp x86_64 8.5.0-18.el8 CentOS-BaseOS 10 M 2023-03-08T15:50:39.502 INFO:teuthology.orchestra.run.smithi182.stdout: device-mapper x86_64 8:1.02.181-9.el8 CentOS-BaseOS 378 k 2023-03-08T15:50:39.503 INFO:teuthology.orchestra.run.smithi182.stdout: device-mapper-event x86_64 8:1.02.181-9.el8 CentOS-BaseOS 272 k 2023-03-08T15:50:39.503 INFO:teuthology.orchestra.run.smithi182.stdout: device-mapper-event-libs x86_64 8:1.02.181-9.el8 CentOS-BaseOS 271 k 2023-03-08T15:50:39.503 INFO:teuthology.orchestra.run.smithi182.stdout: device-mapper-libs x86_64 8:1.02.181-9.el8 CentOS-BaseOS 410 k 2023-03-08T15:50:39.503 INFO:teuthology.orchestra.run.smithi182.stdout: gcc x86_64 8.5.0-18.el8 CentOS-BaseOS 23 M 2023-03-08T15:50:39.503 INFO:teuthology.orchestra.run.smithi182.stdout: gcc-gdb-plugin x86_64 8.5.0-18.el8 CentOS-AppStream 120 k 2023-03-08T15:50:39.503 INFO:teuthology.orchestra.run.smithi182.stdout: gcc-plugin-annobin x86_64 8.5.0-18.el8 CentOS-BaseOS 35 k 2023-03-08T15:50:39.503 INFO:teuthology.orchestra.run.smithi182.stdout: libgcc x86_64 8.5.0-18.el8 CentOS-BaseOS 81 k 2023-03-08T15:50:39.503 INFO:teuthology.orchestra.run.smithi182.stdout: libgomp x86_64 8.5.0-18.el8 CentOS-BaseOS 208 k 2023-03-08T15:50:39.504 INFO:teuthology.orchestra.run.smithi182.stdout: lvm2 x86_64 8:2.03.14-9.el8 CentOS-BaseOS 1.7 M 2023-03-08T15:50:39.504 INFO:teuthology.orchestra.run.smithi182.stdout: lvm2-libs x86_64 8:2.03.14-9.el8 CentOS-BaseOS 1.2 M 2023-03-08T15:50:39.504 INFO:teuthology.orchestra.run.smithi182.stdout: sqlite x86_64 3.26.0-17.el8 CentOS-BaseOS 668 k 2023-03-08T15:50:39.504 INFO:teuthology.orchestra.run.smithi182.stdout: sqlite-libs x86_64 3.26.0-17.el8 CentOS-BaseOS 581 k 2023-03-08T15:50:39.504 INFO:teuthology.orchestra.run.smithi182.stdout:Installing dependencies: 2023-03-08T15:50:39.504 INFO:teuthology.orchestra.run.smithi182.stdout: daxctl-libs x86_64 71.1-4.el8 CentOS-BaseOS 42 k 2023-03-08T15:50:39.504 INFO:teuthology.orchestra.run.smithi182.stdout: inih x86_64 56-1.el8 epel 27 k 2023-03-08T15:50:39.504 INFO:teuthology.orchestra.run.smithi182.stdout: libpmemblk x86_64 1.6.1-1.el8 CentOS-AppStream 92 k 2023-03-08T15:50:39.505 INFO:teuthology.orchestra.run.smithi182.stdout: ndctl-libs x86_64 71.1-4.el8 CentOS-BaseOS 80 k 2023-03-08T15:50:39.505 INFO:teuthology.orchestra.run.smithi182.stdout: python2-libs x86_64 2.7.18-11.module_el8.7.0+1179+42dadd5f CentOS-AppStream 6.0 M 2023-03-08T15:50:39.505 INFO:teuthology.orchestra.run.smithi182.stdout: python2-pip-wheel noarch 9.0.3-19.module_el8.6.0+987+71f62bb6 CentOS-AppStream 892 k 2023-03-08T15:50:39.505 INFO:teuthology.orchestra.run.smithi182.stdout: python2-setuptools-wheel noarch 39.0.1-13.module_el8.5.0+743+cd2f5d28 CentOS-AppStream 287 k 2023-03-08T15:50:39.505 INFO:teuthology.orchestra.run.smithi182.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module_el8.6.0+940+9e7326fe CentOS-AppStream 45 k 2023-03-08T15:50:39.505 INFO:teuthology.orchestra.run.smithi182.stdout: rmt x86_64 2:1.5.3-13.el8 CentOS-BaseOS 51 k 2023-03-08T15:50:39.505 INFO:teuthology.orchestra.run.smithi182.stdout: systemd-devel x86_64 239-71.el8 CentOS-BaseOS 401 k 2023-03-08T15:50:39.506 INFO:teuthology.orchestra.run.smithi182.stdout:Installing weak dependencies: 2023-03-08T15:50:39.506 INFO:teuthology.orchestra.run.smithi182.stdout: python2-pip noarch 9.0.3-19.module_el8.6.0+987+71f62bb6 CentOS-AppStream 1.6 M 2023-03-08T15:50:39.506 INFO:teuthology.orchestra.run.smithi182.stdout: python2-setuptools noarch 39.0.1-13.module_el8.5.0+743+cd2f5d28 CentOS-AppStream 642 k 2023-03-08T15:50:39.506 INFO:teuthology.orchestra.run.smithi182.stdout:Enabling module streams: 2023-03-08T15:50:39.506 INFO:teuthology.orchestra.run.smithi182.stdout: python27 2.7 2023-03-08T15:50:39.506 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:50:39.506 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2023-03-08T15:50:39.506 INFO:teuthology.orchestra.run.smithi182.stdout:=================================================================================================== 2023-03-08T15:50:39.507 INFO:teuthology.orchestra.run.smithi182.stdout:Install 22 Packages 2023-03-08T15:50:39.507 INFO:teuthology.orchestra.run.smithi182.stdout:Upgrade 14 Packages 2023-03-08T15:50:39.507 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:50:39.507 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 52 M 2023-03-08T15:50:39.507 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading Packages: 2023-03-08T15:50:39.705 INFO:teuthology.orchestra.run.smithi182.stdout:(1/36): fio-3.19-4.el8.x86_64.rpm 2.7 MB/s | 538 kB 00:00 2023-03-08T15:50:39.729 INFO:teuthology.orchestra.run.smithi182.stdout:(2/36): python2-2.7.18-11.module_el8.7.0+1179+4 504 kB/s | 110 kB 00:00 2023-03-08T15:50:39.755 INFO:teuthology.orchestra.run.smithi182.stdout:(3/36): libpmemblk-1.6.1-1.el8.x86_64.rpm 374 kB/s | 92 kB 00:00 2023-03-08T15:50:39.864 INFO:teuthology.orchestra.run.smithi182.stdout:(4/36): python2-pip-9.0.3-19.module_el8.6.0+987 12 MB/s | 1.6 MB 00:00 2023-03-08T15:50:39.914 INFO:teuthology.orchestra.run.smithi182.stdout:(5/36): python2-pip-wheel-9.0.3-19.module_el8.6 5.5 MB/s | 892 kB 00:00 2023-03-08T15:50:39.972 INFO:teuthology.orchestra.run.smithi182.stdout:(6/36): python2-setuptools-wheel-39.0.1-13.modu 4.8 MB/s | 287 kB 00:00 2023-03-08T15:50:40.065 INFO:teuthology.orchestra.run.smithi182.stdout:(7/36): python2-libs-2.7.18-11.module_el8.7.0+1 17 MB/s | 6.0 MB 00:00 2023-03-08T15:50:40.090 INFO:teuthology.orchestra.run.smithi182.stdout:(8/36): python2-wheel-wheel-0.31.1-3.module_el8 382 kB/s | 45 kB 00:00 2023-03-08T15:50:40.123 INFO:teuthology.orchestra.run.smithi182.stdout:(9/36): python2-setuptools-39.0.1-13.module_el8 2.4 MB/s | 642 kB 00:00 2023-03-08T15:50:40.165 INFO:teuthology.orchestra.run.smithi182.stdout:(10/36): daxctl-libs-71.1-4.el8.x86_64.rpm 417 kB/s | 42 kB 00:00 2023-03-08T15:50:40.191 INFO:teuthology.orchestra.run.smithi182.stdout:(11/36): dump-0.4-0.36.b46.el8.x86_64.rpm 1.6 MB/s | 164 kB 00:00 2023-03-08T15:50:40.216 INFO:teuthology.orchestra.run.smithi182.stdout:(12/36): libblkid-devel-2.32.1-40.el8.x86_64.rp 945 kB/s | 87 kB 00:00 2023-03-08T15:50:40.275 INFO:teuthology.orchestra.run.smithi182.stdout:(13/36): ndctl-libs-71.1-4.el8.x86_64.rpm 954 kB/s | 80 kB 00:00 2023-03-08T15:50:40.317 INFO:teuthology.orchestra.run.smithi182.stdout:(14/36): rmt-1.5.3-13.el8.x86_64.rpm 514 kB/s | 51 kB 00:00 2023-03-08T15:50:40.359 INFO:teuthology.orchestra.run.smithi182.stdout:(15/36): libicu-devel-60.3-2.el8_1.x86_64.rpm 4.7 MB/s | 922 kB 00:00 2023-03-08T15:50:40.392 INFO:teuthology.orchestra.run.smithi182.stdout:(16/36): systemd-devel-239-71.el8.x86_64.rpm 3.3 MB/s | 401 kB 00:00 2023-03-08T15:50:40.434 INFO:teuthology.orchestra.run.smithi182.stdout:(17/36): device-mapper-devel-1.02.181-9.el8.x86 2.4 MB/s | 284 kB 00:00 2023-03-08T15:50:40.459 INFO:teuthology.orchestra.run.smithi182.stdout:(18/36): libedit-devel-3.1-23.20170329cvs.el8.x 440 kB/s | 44 kB 00:00 2023-03-08T15:50:40.485 INFO:teuthology.orchestra.run.smithi182.stdout:(19/36): userspace-rcu-devel-0.10.1-4.el8.x86_6 912 kB/s | 84 kB 00:00 2023-03-08T15:50:40.835 INFO:teuthology.orchestra.run.smithi182.stdout:(20/36): inih-56-1.el8.x86_64.rpm 73 kB/s | 27 kB 00:00 2023-03-08T15:50:40.860 INFO:teuthology.orchestra.run.smithi182.stdout:(21/36): inih-devel-56-1.el8.x86_64.rpm 35 kB/s | 13 kB 00:00 2023-03-08T15:50:40.927 INFO:teuthology.orchestra.run.smithi182.stdout:(22/36): gcc-gdb-plugin-8.5.0-18.el8.x86_64.rpm 1.3 MB/s | 120 kB 00:00 2023-03-08T15:50:40.994 INFO:teuthology.orchestra.run.smithi182.stdout:(23/36): device-mapper-1.02.181-9.el8.x86_64.rp 5.6 MB/s | 378 kB 00:00 2023-03-08T15:50:41.020 INFO:teuthology.orchestra.run.smithi182.stdout:(24/36): indent-2.2.12-4.el8.x86_64.rpm 317 kB/s | 185 kB 00:00 2023-03-08T15:50:41.062 INFO:teuthology.orchestra.run.smithi182.stdout:(25/36): device-mapper-event-1.02.181-9.el8.x86 4.0 MB/s | 272 kB 00:00 2023-03-08T15:50:41.095 INFO:teuthology.orchestra.run.smithi182.stdout:(26/36): device-mapper-event-libs-1.02.181-9.el 3.5 MB/s | 271 kB 00:00 2023-03-08T15:50:41.146 INFO:teuthology.orchestra.run.smithi182.stdout:(27/36): device-mapper-libs-1.02.181-9.el8.x86_ 4.8 MB/s | 410 kB 00:00 2023-03-08T15:50:41.229 INFO:teuthology.orchestra.run.smithi182.stdout:(28/36): gcc-plugin-annobin-8.5.0-18.el8.x86_64 424 kB/s | 35 kB 00:00 2023-03-08T15:50:41.313 INFO:teuthology.orchestra.run.smithi182.stdout:(29/36): libgcc-8.5.0-18.el8.x86_64.rpm 975 kB/s | 81 kB 00:00 2023-03-08T15:50:41.372 INFO:teuthology.orchestra.run.smithi182.stdout:(30/36): libgomp-8.5.0-18.el8.x86_64.rpm 3.5 MB/s | 208 kB 00:00 2023-03-08T15:50:41.556 INFO:teuthology.orchestra.run.smithi182.stdout:(31/36): cpp-8.5.0-18.el8.x86_64.rpm 15 MB/s | 10 MB 00:00 2023-03-08T15:50:41.606 INFO:teuthology.orchestra.run.smithi182.stdout:(32/36): lvm2-2.03.14-9.el8.x86_64.rpm 7.1 MB/s | 1.7 MB 00:00 2023-03-08T15:50:41.689 INFO:teuthology.orchestra.run.smithi182.stdout:(33/36): lvm2-libs-2.03.14-9.el8.x86_64.rpm 8.9 MB/s | 1.2 MB 00:00 2023-03-08T15:50:41.731 INFO:teuthology.orchestra.run.smithi182.stdout:(34/36): sqlite-3.26.0-17.el8.x86_64.rpm 5.2 MB/s | 668 kB 00:00 2023-03-08T15:50:41.773 INFO:teuthology.orchestra.run.smithi182.stdout:(35/36): sqlite-libs-3.26.0-17.el8.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2023-03-08T15:50:42.307 INFO:teuthology.orchestra.run.smithi182.stdout:(36/36): gcc-8.5.0-18.el8.x86_64.rpm 19 MB/s | 23 MB 00:01 2023-03-08T15:50:42.309 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2023-03-08T15:50:42.310 INFO:teuthology.orchestra.run.smithi182.stdout:Total 19 MB/s | 52 MB 00:02 2023-03-08T15:50:43.919 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2023-03-08T15:50:44.064 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction check succeeded. 2023-03-08T15:50:44.064 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2023-03-08T15:50:44.677 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded. 2023-03-08T15:50:44.682 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2023-03-08T15:50:46.398 INFO:teuthology.orchestra.run.smithi182.stdout: Preparing : 1/1 2023-03-08T15:50:46.483 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libgcc-8.5.0-18.el8.x86_64 1/1 2023-03-08T15:50:46.648 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : libgcc-8.5.0-18.el8.x86_64 1/50 2023-03-08T15:50:46.776 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libgcc-8.5.0-18.el8.x86_64 1/50 2023-03-08T15:50:47.031 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : device-mapper-libs-8:1.02.181-9.el8.x86_64 2/50 2023-03-08T15:50:47.296 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : device-mapper-8:1.02.181-9.el8.x86_64 3/50 2023-03-08T15:50:47.564 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : device-mapper-event-libs-8:1.02.181-9.el8.x86_64 4/50 2023-03-08T15:50:47.780 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : sqlite-libs-3.26.0-17.el8.x86_64 5/50 2023-03-08T15:50:47.965 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : daxctl-libs-71.1-4.el8.x86_64 6/50 2023-03-08T15:50:48.083 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: daxctl-libs-71.1-4.el8.x86_64 6/50 2023-03-08T15:50:48.265 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : ndctl-libs-71.1-4.el8.x86_64 7/50 2023-03-08T15:50:48.367 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: ndctl-libs-71.1-4.el8.x86_64 7/50 2023-03-08T15:50:48.548 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 8/50 2023-03-08T15:50:48.656 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 8/50 2023-03-08T15:50:48.874 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : device-mapper-event-8:1.02.181-9.el8.x86_64 9/50 2023-03-08T15:50:49.322 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: device-mapper-event-8:1.02.181-9.el8.x86_64 9/50 2023-03-08T15:50:49.578 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : lvm2-libs-8:2.03.14-9.el8.x86_64 10/50 2023-03-08T15:50:49.821 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : inih-56-1.el8.x86_64 11/50 2023-03-08T15:50:50.073 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : libgomp-8.5.0-18.el8.x86_64 12/50 2023-03-08T15:50:51.122 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libgomp-8.5.0-18.el8.x86_64 12/50 2023-03-08T15:50:51.489 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : cpp-8.5.0-18.el8.x86_64 13/50 2023-03-08T15:50:53.423 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: cpp-8.5.0-18.el8.x86_64 13/50 2023-03-08T15:50:53.705 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : gcc-8.5.0-18.el8.x86_64 14/50 2023-03-08T15:50:54.043 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: gcc-8.5.0-18.el8.x86_64 14/50 2023-03-08T15:50:54.281 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : systemd-devel-239-71.el8.x86_64 15/50 2023-03-08T15:50:54.469 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 16/50 2023-03-08T15:50:54.662 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module_el8.5.0+ 17/50 2023-03-08T15:50:56.281 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python2-pip-wheel-9.0.3-19.module_el8.6.0+987+71f6 18/50 2023-03-08T15:50:57.144 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python2-libs-2.7.18-11.module_el8.7.0+1179+42dadd5 19/50 2023-03-08T15:50:57.615 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python2-pip-9.0.3-19.module_el8.6.0+987+71f62bb6.n 20/50 2023-03-08T15:50:57.896 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python2-setuptools-39.0.1-13.module_el8.5.0+743+cd 21/50 2023-03-08T15:50:58.101 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python2-2.7.18-11.module_el8.7.0+1179+42dadd5f.x86 22/50 2023-03-08T15:50:58.171 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: python2-2.7.18-11.module_el8.7.0+1179+42dadd5f.x86 22/50 2023-03-08T15:50:58.419 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 23/50 2023-03-08T15:50:58.630 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : device-mapper-devel-8:1.02.181-9.el8.x86_64 24/50 2023-03-08T15:50:58.838 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : gcc-gdb-plugin-8.5.0-18.el8.x86_64 25/50 2023-03-08T15:50:58.942 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-18.el8.x86_64 25/50 2023-03-08T15:50:59.105 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : gcc-plugin-annobin-8.5.0-18.el8.x86_64 26/50 2023-03-08T15:50:59.198 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-18.el8.x86_64 26/50 2023-03-08T15:50:59.624 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : inih-devel-56-1.el8.x86_64 27/50 2023-03-08T15:50:59.624 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : lvm2-8:2.03.14-9.el8.x86_64 28/50 2023-03-08T15:50:59.624 INFO:teuthology.orchestra.run.smithi182.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2023-03-08T15:50:59.625 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:51:00.325 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: lvm2-8:2.03.14-9.el8.x86_64 28/50 2023-03-08T15:51:00.623 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : fio-3.19-4.el8.x86_64 29/50 2023-03-08T15:51:01.170 INFO:teuthology.orchestra.run.smithi182.stdout: Upgrading : sqlite-3.26.0-17.el8.x86_64 30/50 2023-03-08T15:51:01.577 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libicu-devel-60.3-2.el8_1.x86_64 31/50 2023-03-08T15:51:01.886 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : indent-2.2.12-4.el8.x86_64 32/50 2023-03-08T15:51:02.145 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : userspace-rcu-devel-0.10.1-4.el8.x86_64 33/50 2023-03-08T15:51:02.316 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libedit-devel-3.1-23.20170329cvs.el8.x86_64 34/50 2023-03-08T15:51:02.466 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libblkid-devel-2.32.1-40.el8.x86_64 35/50 2023-03-08T15:51:02.648 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module_el8.6.0+940+ 36/50 2023-03-08T15:51:02.705 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: lvm2-8:2.03.14-6.el8.x86_64 37/50 2023-03-08T15:51:02.705 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : lvm2-8:2.03.14-6.el8.x86_64 37/50 2023-03-08T15:51:03.008 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: lvm2-8:2.03.14-6.el8.x86_64 37/50 2023-03-08T15:51:03.230 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : lvm2-libs-8:2.03.14-6.el8.x86_64 38/50 2023-03-08T15:51:03.264 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: device-mapper-event-8:1.02.181-6.el8.x86_64 39/50 2023-03-08T15:51:03.481 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : device-mapper-event-8:1.02.181-6.el8.x86_64 39/50 2023-03-08T15:51:03.655 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : device-mapper-event-libs-8:1.02.181-6.el8.x86_64 40/50 2023-03-08T15:51:03.656 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : gcc-gdb-plugin-8.5.0-17.el8.x86_64 41/50 2023-03-08T15:51:04.389 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-17.el8.x86_64 41/50 2023-03-08T15:51:04.546 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : gcc-plugin-annobin-8.5.0-17.el8.x86_64 42/50 2023-03-08T15:51:04.588 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: gcc-8.5.0-17.el8.x86_64 43/50 2023-03-08T15:51:04.839 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : gcc-8.5.0-17.el8.x86_64 43/50 2023-03-08T15:51:05.038 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : device-mapper-libs-8:1.02.181-6.el8.x86_64 44/50 2023-03-08T15:51:05.271 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : device-mapper-8:1.02.181-6.el8.x86_64 45/50 2023-03-08T15:51:05.438 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 46/50 2023-03-08T15:51:05.612 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 47/50 2023-03-08T15:51:05.648 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: cpp-8.5.0-17.el8.x86_64 48/50 2023-03-08T15:51:05.822 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : cpp-8.5.0-17.el8.x86_64 48/50 2023-03-08T15:51:05.822 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : libgcc-8.5.0-17.el8.x86_64 49/50 2023-03-08T15:51:06.105 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libgcc-8.5.0-17.el8.x86_64 49/50 2023-03-08T15:51:06.139 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libgomp-8.5.0-17.el8.x86_64 50/50 2023-03-08T15:51:06.140 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : libgomp-8.5.0-17.el8.x86_64 50/50 2023-03-08T15:51:07.805 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: libgomp-8.5.0-17.el8.x86_64 50/50 2023-03-08T15:51:07.806 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : fio-3.19-4.el8.x86_64 1/50 2023-03-08T15:51:07.806 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/50 2023-03-08T15:51:07.806 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python2-2.7.18-11.module_el8.7.0+1179+42dadd5f.x86 3/50 2023-03-08T15:51:07.806 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python2-libs-2.7.18-11.module_el8.7.0+1179+42dadd5 4/50 2023-03-08T15:51:07.806 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python2-pip-9.0.3-19.module_el8.6.0+987+71f62bb6.n 5/50 2023-03-08T15:51:07.806 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python2-pip-wheel-9.0.3-19.module_el8.6.0+987+71f6 6/50 2023-03-08T15:51:07.807 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python2-setuptools-39.0.1-13.module_el8.5.0+743+cd 7/50 2023-03-08T15:51:07.807 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module_el8.5.0+ 8/50 2023-03-08T15:51:07.807 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module_el8.6.0+940+ 9/50 2023-03-08T15:51:07.807 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : daxctl-libs-71.1-4.el8.x86_64 10/50 2023-03-08T15:51:07.807 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/50 2023-03-08T15:51:07.807 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libblkid-devel-2.32.1-40.el8.x86_64 12/50 2023-03-08T15:51:07.807 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libicu-devel-60.3-2.el8_1.x86_64 13/50 2023-03-08T15:51:07.807 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : ndctl-libs-71.1-4.el8.x86_64 14/50 2023-03-08T15:51:07.808 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 15/50 2023-03-08T15:51:07.808 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : systemd-devel-239-71.el8.x86_64 16/50 2023-03-08T15:51:07.808 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : device-mapper-devel-8:1.02.181-9.el8.x86_64 17/50 2023-03-08T15:51:07.808 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libedit-devel-3.1-23.20170329cvs.el8.x86_64 18/50 2023-03-08T15:51:07.808 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : userspace-rcu-devel-0.10.1-4.el8.x86_64 19/50 2023-03-08T15:51:07.808 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : indent-2.2.12-4.el8.x86_64 20/50 2023-03-08T15:51:07.808 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : inih-56-1.el8.x86_64 21/50 2023-03-08T15:51:07.808 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : inih-devel-56-1.el8.x86_64 22/50 2023-03-08T15:51:07.809 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : gcc-gdb-plugin-8.5.0-18.el8.x86_64 23/50 2023-03-08T15:51:07.809 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : gcc-gdb-plugin-8.5.0-17.el8.x86_64 24/50 2023-03-08T15:51:07.809 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : cpp-8.5.0-18.el8.x86_64 25/50 2023-03-08T15:51:07.809 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : cpp-8.5.0-17.el8.x86_64 26/50 2023-03-08T15:51:07.809 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : device-mapper-8:1.02.181-9.el8.x86_64 27/50 2023-03-08T15:51:07.809 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : device-mapper-8:1.02.181-6.el8.x86_64 28/50 2023-03-08T15:51:07.811 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : device-mapper-event-8:1.02.181-9.el8.x86_64 29/50 2023-03-08T15:51:07.811 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : device-mapper-event-8:1.02.181-6.el8.x86_64 30/50 2023-03-08T15:51:07.811 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : device-mapper-event-libs-8:1.02.181-9.el8.x86_64 31/50 2023-03-08T15:51:07.811 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : device-mapper-event-libs-8:1.02.181-6.el8.x86_64 32/50 2023-03-08T15:51:07.812 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : device-mapper-libs-8:1.02.181-9.el8.x86_64 33/50 2023-03-08T15:51:07.812 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : device-mapper-libs-8:1.02.181-6.el8.x86_64 34/50 2023-03-08T15:51:07.812 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : gcc-8.5.0-18.el8.x86_64 35/50 2023-03-08T15:51:07.812 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : gcc-8.5.0-17.el8.x86_64 36/50 2023-03-08T15:51:07.812 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : gcc-plugin-annobin-8.5.0-18.el8.x86_64 37/50 2023-03-08T15:51:07.812 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : gcc-plugin-annobin-8.5.0-17.el8.x86_64 38/50 2023-03-08T15:51:07.812 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libgcc-8.5.0-18.el8.x86_64 39/50 2023-03-08T15:51:07.813 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libgcc-8.5.0-17.el8.x86_64 40/50 2023-03-08T15:51:07.813 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libgomp-8.5.0-18.el8.x86_64 41/50 2023-03-08T15:51:07.813 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libgomp-8.5.0-17.el8.x86_64 42/50 2023-03-08T15:51:07.813 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : lvm2-8:2.03.14-9.el8.x86_64 43/50 2023-03-08T15:51:07.813 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : lvm2-8:2.03.14-6.el8.x86_64 44/50 2023-03-08T15:51:07.813 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : lvm2-libs-8:2.03.14-9.el8.x86_64 45/50 2023-03-08T15:51:07.813 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : lvm2-libs-8:2.03.14-6.el8.x86_64 46/50 2023-03-08T15:51:07.813 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : sqlite-3.26.0-17.el8.x86_64 47/50 2023-03-08T15:51:07.814 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 48/50 2023-03-08T15:51:07.814 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : sqlite-libs-3.26.0-17.el8.x86_64 49/50 2023-03-08T15:51:08.875 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:51:08.879 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:51:08.881 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:51:08.913 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 50/50 2023-03-08T15:51:08.913 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:51:08.913 INFO:teuthology.orchestra.run.smithi182.stdout:Upgraded: 2023-03-08T15:51:08.913 INFO:teuthology.orchestra.run.smithi182.stdout: cpp-8.5.0-18.el8.x86_64 2023-03-08T15:51:08.914 INFO:teuthology.orchestra.run.smithi182.stdout: device-mapper-8:1.02.181-9.el8.x86_64 2023-03-08T15:51:08.914 INFO:teuthology.orchestra.run.smithi182.stdout: device-mapper-event-8:1.02.181-9.el8.x86_64 2023-03-08T15:51:08.914 INFO:teuthology.orchestra.run.smithi182.stdout: device-mapper-event-libs-8:1.02.181-9.el8.x86_64 2023-03-08T15:51:08.914 INFO:teuthology.orchestra.run.smithi182.stdout: device-mapper-libs-8:1.02.181-9.el8.x86_64 2023-03-08T15:51:08.914 INFO:teuthology.orchestra.run.smithi182.stdout: gcc-8.5.0-18.el8.x86_64 2023-03-08T15:51:08.914 INFO:teuthology.orchestra.run.smithi182.stdout: gcc-gdb-plugin-8.5.0-18.el8.x86_64 2023-03-08T15:51:08.914 INFO:teuthology.orchestra.run.smithi182.stdout: gcc-plugin-annobin-8.5.0-18.el8.x86_64 2023-03-08T15:51:08.915 INFO:teuthology.orchestra.run.smithi182.stdout: libgcc-8.5.0-18.el8.x86_64 2023-03-08T15:51:08.915 INFO:teuthology.orchestra.run.smithi182.stdout: libgomp-8.5.0-18.el8.x86_64 2023-03-08T15:51:08.915 INFO:teuthology.orchestra.run.smithi182.stdout: lvm2-8:2.03.14-9.el8.x86_64 2023-03-08T15:51:08.915 INFO:teuthology.orchestra.run.smithi182.stdout: lvm2-libs-8:2.03.14-9.el8.x86_64 2023-03-08T15:51:08.915 INFO:teuthology.orchestra.run.smithi182.stdout: sqlite-3.26.0-17.el8.x86_64 2023-03-08T15:51:08.915 INFO:teuthology.orchestra.run.smithi182.stdout: sqlite-libs-3.26.0-17.el8.x86_64 2023-03-08T15:51:08.915 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2023-03-08T15:51:08.915 INFO:teuthology.orchestra.run.smithi182.stdout: daxctl-libs-71.1-4.el8.x86_64 2023-03-08T15:51:08.916 INFO:teuthology.orchestra.run.smithi182.stdout: device-mapper-devel-8:1.02.181-9.el8.x86_64 2023-03-08T15:51:08.916 INFO:teuthology.orchestra.run.smithi182.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-03-08T15:51:08.916 INFO:teuthology.orchestra.run.smithi182.stdout: fio-3.19-4.el8.x86_64 2023-03-08T15:51:08.916 INFO:teuthology.orchestra.run.smithi182.stdout: indent-2.2.12-4.el8.x86_64 2023-03-08T15:51:08.916 INFO:teuthology.orchestra.run.smithi182.stdout: inih-56-1.el8.x86_64 2023-03-08T15:51:08.916 INFO:teuthology.orchestra.run.smithi182.stdout: inih-devel-56-1.el8.x86_64 2023-03-08T15:51:08.916 INFO:teuthology.orchestra.run.smithi182.stdout: libblkid-devel-2.32.1-40.el8.x86_64 2023-03-08T15:51:08.917 INFO:teuthology.orchestra.run.smithi182.stdout: libedit-devel-3.1-23.20170329cvs.el8.x86_64 2023-03-08T15:51:08.917 INFO:teuthology.orchestra.run.smithi182.stdout: libicu-devel-60.3-2.el8_1.x86_64 2023-03-08T15:51:08.917 INFO:teuthology.orchestra.run.smithi182.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-03-08T15:51:08.917 INFO:teuthology.orchestra.run.smithi182.stdout: ndctl-libs-71.1-4.el8.x86_64 2023-03-08T15:51:08.917 INFO:teuthology.orchestra.run.smithi182.stdout: python2-2.7.18-11.module_el8.7.0+1179+42dadd5f.x86_64 2023-03-08T15:51:08.917 INFO:teuthology.orchestra.run.smithi182.stdout: python2-libs-2.7.18-11.module_el8.7.0+1179+42dadd5f.x86_64 2023-03-08T15:51:08.917 INFO:teuthology.orchestra.run.smithi182.stdout: python2-pip-9.0.3-19.module_el8.6.0+987+71f62bb6.noarch 2023-03-08T15:51:08.917 INFO:teuthology.orchestra.run.smithi182.stdout: python2-pip-wheel-9.0.3-19.module_el8.6.0+987+71f62bb6.noarch 2023-03-08T15:51:08.918 INFO:teuthology.orchestra.run.smithi182.stdout: python2-setuptools-39.0.1-13.module_el8.5.0+743+cd2f5d28.noarch 2023-03-08T15:51:08.918 INFO:teuthology.orchestra.run.smithi182.stdout: python2-setuptools-wheel-39.0.1-13.module_el8.5.0+743+cd2f5d28.noarch 2023-03-08T15:51:08.918 INFO:teuthology.orchestra.run.smithi182.stdout: python2-wheel-wheel-1:0.31.1-3.module_el8.6.0+940+9e7326fe.noarch 2023-03-08T15:51:08.918 INFO:teuthology.orchestra.run.smithi182.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-03-08T15:51:08.918 INFO:teuthology.orchestra.run.smithi182.stdout: systemd-devel-239-71.el8.x86_64 2023-03-08T15:51:08.918 INFO:teuthology.orchestra.run.smithi182.stdout: userspace-rcu-devel-0.10.1-4.el8.x86_64 2023-03-08T15:51:08.918 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:51:08.918 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2023-03-08T15:51:09.270 DEBUG:teuthology.orchestra.run.smithi182:> sudo useradd -m fsgqa 2023-03-08T15:51:09.371 INFO:teuthology.orchestra.run.smithi182.stderr:useradd: user 'fsgqa' already exists 2023-03-08T15:51:09.375 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-03-08T15:51:09.376 DEBUG:teuthology.orchestra.run.smithi182:> sudo groupadd fsgqa 2023-03-08T15:51:09.476 INFO:teuthology.orchestra.run.smithi182.stderr:groupadd: group 'fsgqa' already exists 2023-03-08T15:51:09.480 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-03-08T15:51:09.481 DEBUG:teuthology.orchestra.run.smithi182:> sudo useradd fsgqa2 2023-03-08T15:51:12.782 DEBUG:teuthology.orchestra.run.smithi182:> sudo useradd 123456-fsgqa 2023-03-08T15:51:14.286 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-03-08T15:51:14.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.421+0000 7f169f864700 1 Processor -- start 2023-03-08T15:51:14.422 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.421+0000 7f169f864700 1 -- start start 2023-03-08T15:51:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169f864700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1698147e50 0x7f169806a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:51:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169f864700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f169806fef0 0x7f169814ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:51:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169f864700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f169814b250 0x7f169814dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:51:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169f864700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169814b6c0 con 0x7f169814b250 2023-03-08T15:51:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169f864700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169814a810 con 0x7f1698147e50 2023-03-08T15:51:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169f864700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1698071a40 con 0x7f169806fef0 2023-03-08T15:51:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169cdff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f169806fef0 0x7f169814ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:51:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169d600700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1698147e50 0x7f169806a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:51:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169de01700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f169814b250 0x7f169814dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:51:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169d600700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1698147e50 0x7f169806a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.123:48876/0 (socket says 172.21.15.123:48876) 2023-03-08T15:51:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169cdff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f169806fef0 0x7f169814ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.123:40370/0 (socket says 172.21.15.123:40370) 2023-03-08T15:51:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169d600700 1 -- 172.21.15.123:0/1990665583 learned_addr learned my addr 172.21.15.123:0/1990665583 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:51:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169de01700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f169814b250 0x7f169814dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34068/0 (socket says 172.21.15.123:34068) 2023-03-08T15:51:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169de01700 1 -- 172.21.15.123:0/1990665583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f169806fef0 msgr2=0x7f169814ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:51:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169de01700 1 --2- 172.21.15.123:0/1990665583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f169806fef0 0x7f169814ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169de01700 1 -- 172.21.15.123:0/1990665583 >> v2:172.21.15.175:3300/0 conn(0x7f1698147e50 msgr2=0x7f169806a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:51:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169de01700 1 --2- 172.21.15.123:0/1990665583 >> v2:172.21.15.175:3300/0 conn(0x7f1698147e50 0x7f169806a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169de01700 1 -- 172.21.15.123:0/1990665583 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1698071d20 con 0x7f169814b250 2023-03-08T15:51:14.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f169de01700 1 --2- 172.21.15.123:0/1990665583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f169814b250 0x7f169814dd10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f169814edd0 tx=0x7f169000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc330e6327223390 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:51:14.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f168ffff700 1 -- 172.21.15.123:0/1990665583 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169000e070 con 0x7f169814b250 2023-03-08T15:51:14.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f168ffff700 1 -- 172.21.15.123:0/1990665583 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169000bb20 con 0x7f169814b250 2023-03-08T15:51:14.427 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.422+0000 7f168ffff700 1 -- 172.21.15.123:0/1990665583 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690012430 con 0x7f169814b250 2023-03-08T15:51:14.429 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.423+0000 7f169f864700 1 -- 172.21.15.123:0/1990665583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f169814b250 msgr2=0x7f169814dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:51:14.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.423+0000 7f169f864700 1 --2- 172.21.15.123:0/1990665583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f169814b250 0x7f169814dd10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f169814edd0 tx=0x7f169000b330 comp rx=0 tx=0).stop 2023-03-08T15:51:14.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.423+0000 7f169f864700 1 -- 172.21.15.123:0/1990665583 shutdown_connections 2023-03-08T15:51:14.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.423+0000 7f169f864700 1 --2- 172.21.15.123:0/1990665583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f169814b250 0x7f169814dd10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.423+0000 7f169f864700 1 --2- 172.21.15.123:0/1990665583 >> v2:172.21.15.175:3300/0 conn(0x7f1698147e50 0x7f169806a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.423+0000 7f169f864700 1 --2- 172.21.15.123:0/1990665583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f169806fef0 0x7f169814ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.423+0000 7f169f864700 1 -- 172.21.15.123:0/1990665583 >> 172.21.15.123:0/1990665583 conn(0x7f169806b360 msgr2=0x7f169806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:51:14.430 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.423+0000 7f169f864700 1 -- 172.21.15.123:0/1990665583 shutdown_connections 2023-03-08T15:51:14.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.423+0000 7f169f864700 1 -- 172.21.15.123:0/1990665583 wait complete. 2023-03-08T15:51:14.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.424+0000 7f169f864700 1 Processor -- start 2023-03-08T15:51:14.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.424+0000 7f169f864700 1 -- start start 2023-03-08T15:51:14.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169f864700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f169806fef0 0x7f1698146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:51:14.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169f864700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1698147e50 0x7f16980bc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:51:14.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169f864700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f169814b250 0x7f16981e01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:51:14.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169f864700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16980bb7c0 con 0x7f1698147e50 2023-03-08T15:51:14.431 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169f864700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16981466b0 con 0x7f169806fef0 2023-03-08T15:51:14.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169f864700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1698146ec0 con 0x7f169814b250 2023-03-08T15:51:14.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169cdff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1698147e50 0x7f16980bc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:51:14.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169cdff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1698147e50 0x7f16980bc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34074/0 (socket says 172.21.15.123:34074) 2023-03-08T15:51:14.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169cdff700 1 -- 172.21.15.123:0/1961984271 learned_addr learned my addr 172.21.15.123:0/1961984271 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:51:14.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169d600700 1 --2- 172.21.15.123:0/1961984271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f169806fef0 0x7f1698146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:51:14.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169de01700 1 --2- 172.21.15.123:0/1961984271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f169814b250 0x7f16981e01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:51:14.432 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169cdff700 1 -- 172.21.15.123:0/1961984271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f169814b250 msgr2=0x7f16981e01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:51:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169cdff700 1 --2- 172.21.15.123:0/1961984271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f169814b250 0x7f16981e01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169cdff700 1 -- 172.21.15.123:0/1961984271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f169806fef0 msgr2=0x7f1698146170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:51:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169cdff700 1 --2- 172.21.15.123:0/1961984271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f169806fef0 0x7f1698146170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.425+0000 7f169cdff700 1 -- 172.21.15.123:0/1961984271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1690009a70 con 0x7f1698147e50 2023-03-08T15:51:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.426+0000 7f169cdff700 1 --2- 172.21.15.123:0/1961984271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1698147e50 0x7f16980bc510 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f168800e9e0 tx=0x7f168800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:51:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.426+0000 7f168dffb700 1 -- 172.21.15.123:0/1961984271 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168800c5e0 con 0x7f1698147e50 2023-03-08T15:51:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.426+0000 7f168dffb700 1 -- 172.21.15.123:0/1961984271 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168800c740 con 0x7f1698147e50 2023-03-08T15:51:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.426+0000 7f169f864700 1 -- 172.21.15.123:0/1961984271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1698148220 con 0x7f1698147e50 2023-03-08T15:51:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.426+0000 7f168dffb700 1 -- 172.21.15.123:0/1961984271 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168800cab0 con 0x7f1698147e50 2023-03-08T15:51:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.426+0000 7f169f864700 1 -- 172.21.15.123:0/1961984271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1698072000 con 0x7f1698147e50 2023-03-08T15:51:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.427+0000 7f169f864700 1 -- 172.21.15.123:0/1961984271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16980728f0 con 0x7f1698147e50 2023-03-08T15:51:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.427+0000 7f168dffb700 1 -- 172.21.15.123:0/1961984271 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f1688023070 con 0x7f1698147e50 2023-03-08T15:51:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.428+0000 7f168dffb700 1 --2- 172.21.15.123:0/1961984271 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f167c0698d0 0x7f167c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:51:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.428+0000 7f168dffb700 1 -- 172.21.15.123:0/1961984271 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f16880879c0 con 0x7f1698147e50 2023-03-08T15:51:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.428+0000 7f169d600700 1 --2- 172.21.15.123:0/1961984271 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f167c0698d0 0x7f167c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:51:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.428+0000 7f169d600700 1 --2- 172.21.15.123:0/1961984271 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f167c0698d0 0x7f167c06bd80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1694009b50 tx=0x7f16940092c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:51:14.435 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.432+0000 7f168dffb700 1 -- 172.21.15.123:0/1961984271 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f1688053730 con 0x7f1698147e50 2023-03-08T15:51:14.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.695+0000 7f169f864700 1 -- 172.21.15.123:0/1961984271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f16980744c0 con 0x7f1698147e50 2023-03-08T15:51:14.697 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.696+0000 7f168dffb700 1 -- 172.21.15.123:0/1961984271 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7f1688056d50 con 0x7f1698147e50 2023-03-08T15:51:14.698 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:51:14.698 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":1,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","modified":"2023-03-08T15:48:40.160332Z","created":"2023-03-08T15:48:40.160332Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-03-08T15:51:14.699 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.698+0000 7f169f864700 1 -- 172.21.15.123:0/1961984271 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f167c0698d0 msgr2=0x7f167c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:51:14.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.698+0000 7f169f864700 1 --2- 172.21.15.123:0/1961984271 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f167c0698d0 0x7f167c06bd80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1694009b50 tx=0x7f16940092c0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.698+0000 7f169f864700 1 -- 172.21.15.123:0/1961984271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1698147e50 msgr2=0x7f16980bc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:51:14.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.698+0000 7f169f864700 1 --2- 172.21.15.123:0/1961984271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1698147e50 0x7f16980bc510 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f168800e9e0 tx=0x7f168800ecf0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.698+0000 7f169f864700 1 -- 172.21.15.123:0/1961984271 shutdown_connections 2023-03-08T15:51:14.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.698+0000 7f169f864700 1 --2- 172.21.15.123:0/1961984271 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f167c0698d0 0x7f167c06bd80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.698+0000 7f169f864700 1 --2- 172.21.15.123:0/1961984271 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f169814b250 0x7f16981e01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.700 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.698+0000 7f169f864700 1 --2- 172.21.15.123:0/1961984271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f169806fef0 0x7f1698146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.698+0000 7f169f864700 1 --2- 172.21.15.123:0/1961984271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1698147e50 0x7f16980bc510 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.698+0000 7f169f864700 1 -- 172.21.15.123:0/1961984271 >> 172.21.15.123:0/1961984271 conn(0x7f169806b360 msgr2=0x7f16980b9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:51:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.698+0000 7f169f864700 1 -- 172.21.15.123:0/1961984271 shutdown_connections 2023-03-08T15:51:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.698+0000 7f169f864700 1 -- 172.21.15.123:0/1961984271 wait complete. 2023-03-08T15:51:14.702 INFO:teuthology.orchestra.run.smithi123.stderr:dumped monmap epoch 1 2023-03-08T15:51:14.711 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-03-08T15:51:14.831 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.830+0000 7f441fe11700 1 Processor -- start 2023-03-08T15:51:14.832 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.830+0000 7f441fe11700 1 -- start start 2023-03-08T15:51:14.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.831+0000 7f441fe11700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4418147e50 0x7f441806a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:51:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.831+0000 7f441fe11700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441814a810 con 0x7f441814b420 2023-03-08T15:51:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.831+0000 7f441fe11700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4418071a40 con 0x7f441806fef0 2023-03-08T15:51:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.831+0000 7f441fe11700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4418071d20 con 0x7f4418147e50 2023-03-08T15:51:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.831+0000 7f441e3ae700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f441814b420 0x7f4418155040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49706/0 (socket says 172.21.15.123:49706) 2023-03-08T15:51:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.831+0000 7f441e3ae700 1 -- 172.21.15.123:0/882751408 learned_addr learned my addr 172.21.15.123:0/882751408 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:51:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.831+0000 7f441cbab700 1 -- 172.21.15.123:0/882751408 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148608985 0 0) 0x7f441814a810 con 0x7f441814b420 2023-03-08T15:51:14.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.831+0000 7f441cbab700 1 -- 172.21.15.123:0/882751408 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44040035b0 con 0x7f441814b420 2023-03-08T15:51:14.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.831+0000 7f441dbad700 1 --2- 172.21.15.123:0/882751408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4418147e50 0x7f441806a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:51:14.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 -- 172.21.15.123:0/882751408 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2560552065 0 0) 0x7f44040035b0 con 0x7f441814b420 2023-03-08T15:51:14.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 -- 172.21.15.123:0/882751408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4418147e50 msgr2=0x7f441806a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:51:14.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 --2- 172.21.15.123:0/882751408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4418147e50 0x7f441806a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 -- 172.21.15.123:0/882751408 >> v1:172.21.15.175:6789/0 conn(0x7f441806fef0 legacy=0x7f441814ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:51:14.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 -- 172.21.15.123:0/882751408 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4418072000 con 0x7f441814b420 2023-03-08T15:51:14.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 -- 172.21.15.123:0/882751408 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f44100019f0 con 0x7f441814b420 2023-03-08T15:51:14.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 -- 172.21.15.123:0/882751408 >> v1:172.21.15.123:6789/0 conn(0x7f441814b420 legacy=0x7f4418155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:51:14.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 --2- 172.21.15.123:0/882751408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4404003a30 0x7f4404003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:51:14.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 --2- 172.21.15.123:0/882751408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4404004850 0x7f4404004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:51:14.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 --2- 172.21.15.123:0/882751408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4418147e50 0x7f4404005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:51:14.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 -- 172.21.15.123:0/882751408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4418071d20 con 0x7f4404004850 2023-03-08T15:51:14.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 -- 172.21.15.123:0/882751408 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440400bac0 con 0x7f4404003a30 2023-03-08T15:51:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 -- 172.21.15.123:0/882751408 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440400bc50 con 0x7f4418147e50 2023-03-08T15:51:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441d3ac700 1 --2- 172.21.15.123:0/882751408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4404004850 0x7f4404004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:51:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441dbad700 1 --2- 172.21.15.123:0/882751408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4404003a30 0x7f4404003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:51:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441e3ae700 1 --2- 172.21.15.123:0/882751408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4418147e50 0x7f4404005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:51:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441d3ac700 1 -- 172.21.15.123:0/882751408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4418147e50 msgr2=0x7f4404005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:51:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441d3ac700 1 --2- 172.21.15.123:0/882751408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4418147e50 0x7f4404005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441d3ac700 1 -- 172.21.15.123:0/882751408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4404003a30 msgr2=0x7f4404003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:51:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441d3ac700 1 --2- 172.21.15.123:0/882751408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4404003a30 0x7f4404003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441d3ac700 1 -- 172.21.15.123:0/882751408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44040035b0 con 0x7f4404004850 2023-03-08T15:51:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441e3ae700 1 --2- 172.21.15.123:0/882751408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4418147e50 0x7f4404005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:51:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441d3ac700 1 --2- 172.21.15.123:0/882751408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4404004850 0x7f4404004cc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f44180702e0 tx=0x7f4404005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253492d128540ce0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:51:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 -- 172.21.15.123:0/882751408 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44140012f0 con 0x7f4404004850 2023-03-08T15:51:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 -- 172.21.15.123:0/882751408 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44140052f0 con 0x7f4404004850 2023-03-08T15:51:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.832+0000 7f441cbab700 1 -- 172.21.15.123:0/882751408 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414006860 con 0x7f4404004850 2023-03-08T15:51:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.833+0000 7f441fe11700 1 -- 172.21.15.123:0/882751408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4404004850 msgr2=0x7f4404004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:51:14.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.833+0000 7f441fe11700 1 --2- 172.21.15.123:0/882751408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4404004850 0x7f4404004cc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f44180702e0 tx=0x7f4404005880 comp rx=0 tx=0).stop 2023-03-08T15:51:14.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.833+0000 7f441e3ae700 1 -- 172.21.15.123:0/882751408 reap_dead start 2023-03-08T15:51:14.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.833+0000 7f441fe11700 1 -- 172.21.15.123:0/882751408 shutdown_connections 2023-03-08T15:51:14.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.833+0000 7f441fe11700 1 -- 172.21.15.123:0/882751408 >> 172.21.15.123:0/882751408 conn(0x7f441806b360 msgr2=0x7f441806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:51:14.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.833+0000 7f441fe11700 1 -- 172.21.15.123:0/882751408 shutdown_connections 2023-03-08T15:51:14.840 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.833+0000 7f441fe11700 1 -- 172.21.15.123:0/882751408 wait complete. 2023-03-08T15:51:14.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.834+0000 7f441fe11700 1 Processor -- start 2023-03-08T15:51:14.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.834+0000 7f441fe11700 1 -- start start 2023-03-08T15:51:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.835+0000 7f441fe11700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4404004850 0x7f44180bcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:51:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.835+0000 7f441fe11700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44180b5000 0x7f44181e3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:51:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.835+0000 7f441fe11700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44181e36d0 0x7f4418141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:51:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.835+0000 7f441fe11700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44180bd180 con 0x7f44180b5000 2023-03-08T15:51:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.835+0000 7f441fe11700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4418142f10 con 0x7f4404004850 2023-03-08T15:51:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.835+0000 7f441fe11700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441814a3b0 con 0x7f44181e36d0 2023-03-08T15:51:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.835+0000 7f441d3ac700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44180b5000 0x7f44181e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:51:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.835+0000 7f441d3ac700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44180b5000 0x7f44181e3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34078/0 (socket says 172.21.15.123:34078) 2023-03-08T15:51:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.835+0000 7f441d3ac700 1 -- 172.21.15.123:0/1655112844 learned_addr learned my addr 172.21.15.123:0/1655112844 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:51:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.835+0000 7f441dbad700 1 --2- 172.21.15.123:0/1655112844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4404004850 0x7f44180bcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:51:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.836+0000 7f441e3ae700 1 --2- 172.21.15.123:0/1655112844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44181e36d0 0x7f4418141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:51:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.836+0000 7f441d3ac700 1 -- 172.21.15.123:0/1655112844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44181e36d0 msgr2=0x7f4418141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:51:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.836+0000 7f441d3ac700 1 --2- 172.21.15.123:0/1655112844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44181e36d0 0x7f4418141b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.836+0000 7f441d3ac700 1 -- 172.21.15.123:0/1655112844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4404004850 msgr2=0x7f44180bcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:51:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.836+0000 7f441d3ac700 1 --2- 172.21.15.123:0/1655112844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4404004850 0x7f44180bcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.836+0000 7f441d3ac700 1 -- 172.21.15.123:0/1655112844 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44180728f0 con 0x7f44180b5000 2023-03-08T15:51:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.836+0000 7f441dbad700 1 --2- 172.21.15.123:0/1655112844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4404004850 0x7f44180bcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-08T15:51:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.836+0000 7f441d3ac700 1 --2- 172.21.15.123:0/1655112844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44180b5000 0x7f44181e3190 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4414005690 tx=0x7f4414001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:51:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.836+0000 7f440e7fc700 1 -- 172.21.15.123:0/1655112844 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414003880 con 0x7f44180b5000 2023-03-08T15:51:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.836+0000 7f440e7fc700 1 -- 172.21.15.123:0/1655112844 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4414003a00 con 0x7f44180b5000 2023-03-08T15:51:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.836+0000 7f440e7fc700 1 -- 172.21.15.123:0/1655112844 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414003db0 con 0x7f44180b5000 2023-03-08T15:51:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.836+0000 7f441fe11700 1 -- 172.21.15.123:0/1655112844 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4418148220 con 0x7f44180b5000 2023-03-08T15:51:14.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.836+0000 7f441fe11700 1 -- 172.21.15.123:0/1655112844 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44180b45f0 con 0x7f44180b5000 2023-03-08T15:51:14.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.837+0000 7f441fe11700 1 -- 172.21.15.123:0/1655112844 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44180744c0 con 0x7f44180b5000 2023-03-08T15:51:14.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.837+0000 7f440e7fc700 1 -- 172.21.15.123:0/1655112844 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f441402e070 con 0x7f44180b5000 2023-03-08T15:51:14.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.838+0000 7f440e7fc700 1 --2- 172.21.15.123:0/1655112844 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f43fc0698d0 0x7f43fc06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:51:14.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.838+0000 7f440e7fc700 1 -- 172.21.15.123:0/1655112844 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4414088890 con 0x7f44180b5000 2023-03-08T15:51:14.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.838+0000 7f441dbad700 1 --2- 172.21.15.123:0/1655112844 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f43fc0698d0 0x7f43fc06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:51:14.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.838+0000 7f441dbad700 1 --2- 172.21.15.123:0/1655112844 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f43fc0698d0 0x7f43fc06bd80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4408009ce0 tx=0x7f4408008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:51:14.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:14.842+0000 7f440e7fc700 1 -- 172.21.15.123:0/1655112844 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f4414054660 con 0x7f44180b5000 2023-03-08T15:51:15.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:15.103+0000 7f441fe11700 1 -- 172.21.15.123:0/1655112844 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f44180b5830 con 0x7f44180b5000 2023-03-08T15:51:15.104 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:15.103+0000 7f440e7fc700 1 -- 172.21.15.123:0/1655112844 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f441402c0a0 con 0x7f44180b5000 2023-03-08T15:51:15.105 INFO:teuthology.orchestra.run.smithi123.stdout:[client.admin] 2023-03-08T15:51:15.105 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBYrghkBXe4HRAAQ7OV7ftTtz+Ijw9yEcu/xg== 2023-03-08T15:51:15.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:15.105+0000 7f441fe11700 1 -- 172.21.15.123:0/1655112844 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f43fc0698d0 msgr2=0x7f43fc06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:51:15.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:15.105+0000 7f441fe11700 1 --2- 172.21.15.123:0/1655112844 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f43fc0698d0 0x7f43fc06bd80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4408009ce0 tx=0x7f4408008040 comp rx=0 tx=0).stop 2023-03-08T15:51:15.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:15.105+0000 7f441fe11700 1 -- 172.21.15.123:0/1655112844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44180b5000 msgr2=0x7f44181e3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:51:15.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:15.105+0000 7f441fe11700 1 --2- 172.21.15.123:0/1655112844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44180b5000 0x7f44181e3190 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4414005690 tx=0x7f4414001120 comp rx=0 tx=0).stop 2023-03-08T15:51:15.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:15.105+0000 7f441fe11700 1 -- 172.21.15.123:0/1655112844 shutdown_connections 2023-03-08T15:51:15.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:15.105+0000 7f441fe11700 1 --2- 172.21.15.123:0/1655112844 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f43fc0698d0 0x7f43fc06bd80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:15.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:15.105+0000 7f441fe11700 1 --2- 172.21.15.123:0/1655112844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44181e36d0 0x7f4418141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:15.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:15.105+0000 7f441fe11700 1 --2- 172.21.15.123:0/1655112844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4404004850 0x7f44180bcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:15.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:15.105+0000 7f441fe11700 1 --2- 172.21.15.123:0/1655112844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44180b5000 0x7f44181e3190 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:51:15.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:15.105+0000 7f441fe11700 1 -- 172.21.15.123:0/1655112844 >> 172.21.15.123:0/1655112844 conn(0x7f441806b360 msgr2=0x7f441806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:51:15.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:15.105+0000 7f441fe11700 1 -- 172.21.15.123:0/1655112844 shutdown_connections 2023-03-08T15:51:15.108 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:51:15.105+0000 7f441fe11700 1 -- 172.21.15.123:0/1655112844 wait complete. 2023-03-08T15:51:15.118 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:51:15.118 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/tmp/tmp.AsxONLoNsgxfstests-dev/local.config 2023-03-08T15:51:15.224 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.123:6789:/test export TEST_DIR=/tmp/tmp.maEWJIuC5stest export SCRATCH_DEV=172.21.15.123:6789:/scratch export SCRATCH_MNT=/tmp/tmp.gBRMxQDUw9scratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBYrghkBXe4HRAAQ7OV7ftTtz+Ijw9yEcu/xg==" 2023-03-08T15:51:15.224 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:51:15.225 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/tmp/tmp.AsxONLoNsgxfstests-dev/ceph.exclude 2023-03-08T15:51:15.365 DEBUG:teuthology.orchestra.run.smithi182:> (cd /tmp/tmp.AsxONLoNsgxfstests-dev && exec sudo make) 2023-03-08T15:51:15.543 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize -cfi 2023-03-08T15:51:16.164 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: putting auxiliary files in '.'. 2023-03-08T15:51:16.165 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file './config.guess' 2023-03-08T15:51:16.180 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file './config.sub' 2023-03-08T15:51:16.196 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file './install-sh' 2023-03-08T15:51:16.212 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file './ltmain.sh' 2023-03-08T15:51:16.307 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-03-08T15:51:16.307 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-03-08T15:51:16.327 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-03-08T15:51:16.347 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-03-08T15:51:16.366 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-03-08T15:51:16.386 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-03-08T15:51:16.411 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-03-08T15:51:16.417 INFO:teuthology.orchestra.run.smithi182.stdout:cp include/install-sh . 2023-03-08T15:51:16.420 INFO:teuthology.orchestra.run.smithi182.stdout:aclocal -I m4 2023-03-08T15:51:17.893 INFO:teuthology.orchestra.run.smithi182.stdout:autoheader 2023-03-08T15:51:18.296 INFO:teuthology.orchestra.run.smithi182.stdout:autoconf 2023-03-08T15:51:18.543 INFO:teuthology.orchestra.run.smithi182.stdout:./configure \ 2023-03-08T15:51:18.544 INFO:teuthology.orchestra.run.smithi182.stdout: --libexecdir=/usr/lib \ 2023-03-08T15:51:18.544 INFO:teuthology.orchestra.run.smithi182.stdout: --exec_prefix=/var/lib 2023-03-08T15:51:19.040 INFO:teuthology.orchestra.run.smithi182.stdout:checking build system type... x86_64-pc-linux-gnu 2023-03-08T15:51:19.041 INFO:teuthology.orchestra.run.smithi182.stdout:checking host system type... x86_64-pc-linux-gnu 2023-03-08T15:51:19.046 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to print strings... printf 2023-03-08T15:51:19.047 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gcc... gcc 2023-03-08T15:51:19.244 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether the C compiler works... yes 2023-03-08T15:51:19.244 INFO:teuthology.orchestra.run.smithi182.stdout:checking for C compiler default output file name... a.out 2023-03-08T15:51:19.314 INFO:teuthology.orchestra.run.smithi182.stdout:checking for suffix of executables... 2023-03-08T15:51:19.399 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether we are cross compiling... no 2023-03-08T15:51:19.454 INFO:teuthology.orchestra.run.smithi182.stdout:checking for suffix of object files... o 2023-03-08T15:51:19.504 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether we are using the GNU C compiler... yes 2023-03-08T15:51:19.554 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether gcc accepts -g... yes 2023-03-08T15:51:19.621 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gcc option to accept ISO C89... none needed 2023-03-08T15:51:19.631 INFO:teuthology.orchestra.run.smithi182.stdout:checking for a sed that does not truncate output... /bin/sed 2023-03-08T15:51:19.639 INFO:teuthology.orchestra.run.smithi182.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-03-08T15:51:19.643 INFO:teuthology.orchestra.run.smithi182.stdout:checking for egrep... /bin/grep -E 2023-03-08T15:51:19.647 INFO:teuthology.orchestra.run.smithi182.stdout:checking for fgrep... /bin/grep -F 2023-03-08T15:51:19.660 INFO:teuthology.orchestra.run.smithi182.stdout:checking for ld used by gcc... /bin/ld 2023-03-08T15:51:19.666 INFO:teuthology.orchestra.run.smithi182.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-03-08T15:51:19.684 INFO:teuthology.orchestra.run.smithi182.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-03-08T15:51:19.745 INFO:teuthology.orchestra.run.smithi182.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-03-08T15:51:19.746 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether ln -s works... yes 2023-03-08T15:51:19.767 INFO:teuthology.orchestra.run.smithi182.stdout:checking the maximum length of command line arguments... 1572864 2023-03-08T15:51:19.776 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-03-08T15:51:19.776 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-03-08T15:51:19.776 INFO:teuthology.orchestra.run.smithi182.stdout:checking for /bin/ld option to reload object files... -r 2023-03-08T15:51:19.777 INFO:teuthology.orchestra.run.smithi182.stdout:checking for objdump... objdump 2023-03-08T15:51:19.777 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to recognize dependent libraries... pass_all 2023-03-08T15:51:19.778 INFO:teuthology.orchestra.run.smithi182.stdout:checking for dlltool... no 2023-03-08T15:51:19.778 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-03-08T15:51:19.779 INFO:teuthology.orchestra.run.smithi182.stdout:checking for ar... ar 2023-03-08T15:51:19.849 INFO:teuthology.orchestra.run.smithi182.stdout:checking for archiver @FILE support... @ 2023-03-08T15:51:19.850 INFO:teuthology.orchestra.run.smithi182.stdout:checking for strip... strip 2023-03-08T15:51:19.850 INFO:teuthology.orchestra.run.smithi182.stdout:checking for ranlib... ranlib 2023-03-08T15:51:19.851 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gawk... gawk 2023-03-08T15:51:20.011 INFO:teuthology.orchestra.run.smithi182.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-03-08T15:51:20.015 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sysroot... no 2023-03-08T15:51:20.027 INFO:teuthology.orchestra.run.smithi182.stdout:checking for a working dd... /bin/dd 2023-03-08T15:51:20.038 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-03-08T15:51:20.080 INFO:teuthology.orchestra.run.smithi182.stdout:checking for mt... no 2023-03-08T15:51:20.089 INFO:teuthology.orchestra.run.smithi182.stdout:checking if : is a manifest tool... no 2023-03-08T15:51:20.174 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to run the C preprocessor... gcc -E 2023-03-08T15:51:20.506 INFO:teuthology.orchestra.run.smithi182.stdout:checking for ANSI C header files... yes 2023-03-08T15:51:20.568 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/types.h... yes 2023-03-08T15:51:20.644 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/stat.h... yes 2023-03-08T15:51:20.720 INFO:teuthology.orchestra.run.smithi182.stdout:checking for stdlib.h... yes 2023-03-08T15:51:20.797 INFO:teuthology.orchestra.run.smithi182.stdout:checking for string.h... yes 2023-03-08T15:51:20.884 INFO:teuthology.orchestra.run.smithi182.stdout:checking for memory.h... yes 2023-03-08T15:51:20.961 INFO:teuthology.orchestra.run.smithi182.stdout:checking for strings.h... yes 2023-03-08T15:51:21.041 INFO:teuthology.orchestra.run.smithi182.stdout:checking for inttypes.h... yes 2023-03-08T15:51:21.119 INFO:teuthology.orchestra.run.smithi182.stdout:checking for stdint.h... yes 2023-03-08T15:51:21.211 INFO:teuthology.orchestra.run.smithi182.stdout:checking for unistd.h... yes 2023-03-08T15:51:21.284 INFO:teuthology.orchestra.run.smithi182.stdout:checking for dlfcn.h... yes 2023-03-08T15:51:21.297 INFO:teuthology.orchestra.run.smithi182.stdout:checking for objdir... .libs 2023-03-08T15:51:21.492 INFO:teuthology.orchestra.run.smithi182.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-03-08T15:51:21.492 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-03-08T15:51:21.551 INFO:teuthology.orchestra.run.smithi182.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-03-08T15:51:21.605 INFO:teuthology.orchestra.run.smithi182.stdout:checking if gcc static flag -static works... no 2023-03-08T15:51:21.686 INFO:teuthology.orchestra.run.smithi182.stdout:checking if gcc supports -c -o file.o... yes 2023-03-08T15:51:21.687 INFO:teuthology.orchestra.run.smithi182.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-03-08T15:51:21.711 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-03-08T15:51:21.782 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether -lc should be explicitly linked in... no 2023-03-08T15:51:21.927 INFO:teuthology.orchestra.run.smithi182.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-03-08T15:51:21.927 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to hardcode library paths into programs... immediate 2023-03-08T15:51:21.939 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether stripping libraries is possible... yes 2023-03-08T15:51:21.939 INFO:teuthology.orchestra.run.smithi182.stdout:checking if libtool supports shared libraries... yes 2023-03-08T15:51:21.940 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether to build shared libraries... yes 2023-03-08T15:51:21.940 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether to build static libraries... yes 2023-03-08T15:51:21.961 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gcc... (cached) gcc 2023-03-08T15:51:22.018 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-03-08T15:51:22.018 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether gcc accepts -g... (cached) yes 2023-03-08T15:51:22.019 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-03-08T15:51:22.019 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gmake... /usr/bin/gmake 2023-03-08T15:51:22.019 INFO:teuthology.orchestra.run.smithi182.stderr:./configure: line 12069: test: $(SHELL): binary operator expected 2023-03-08T15:51:22.020 INFO:teuthology.orchestra.run.smithi182.stdout:checking for tar... /bin/tar 2023-03-08T15:51:22.020 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gzip... /bin/gzip 2023-03-08T15:51:22.044 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether gcc -MM is supported... yes 2023-03-08T15:51:22.045 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sort... /bin/sort 2023-03-08T15:51:22.045 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether ln -s works... yes 2023-03-08T15:51:22.046 INFO:teuthology.orchestra.run.smithi182.stdout:checking for rpm... /bin/rpm 2023-03-08T15:51:22.058 INFO:teuthology.orchestra.run.smithi182.stdout:checking for rpmbuild... no 2023-03-08T15:51:22.135 INFO:teuthology.orchestra.run.smithi182.stdout:checking assert.h usability... yes 2023-03-08T15:51:22.159 INFO:teuthology.orchestra.run.smithi182.stdout:checking assert.h presence... yes 2023-03-08T15:51:22.160 INFO:teuthology.orchestra.run.smithi182.stdout:checking for assert.h... yes 2023-03-08T15:51:22.243 INFO:teuthology.orchestra.run.smithi182.stdout:checking bstring.h usability... no 2023-03-08T15:51:22.280 INFO:teuthology.orchestra.run.smithi182.stdout:checking bstring.h presence... no 2023-03-08T15:51:22.280 INFO:teuthology.orchestra.run.smithi182.stdout:checking for bstring.h... no 2023-03-08T15:51:22.351 INFO:teuthology.orchestra.run.smithi182.stdout:checking libgen.h usability... yes 2023-03-08T15:51:22.375 INFO:teuthology.orchestra.run.smithi182.stdout:checking libgen.h presence... yes 2023-03-08T15:51:22.376 INFO:teuthology.orchestra.run.smithi182.stdout:checking for libgen.h... yes 2023-03-08T15:51:22.460 INFO:teuthology.orchestra.run.smithi182.stdout:checking dirent.h usability... yes 2023-03-08T15:51:22.486 INFO:teuthology.orchestra.run.smithi182.stdout:checking dirent.h presence... yes 2023-03-08T15:51:22.486 INFO:teuthology.orchestra.run.smithi182.stdout:checking for dirent.h... yes 2023-03-08T15:51:22.610 INFO:teuthology.orchestra.run.smithi182.stdout:checking errno.h usability... yes 2023-03-08T15:51:22.635 INFO:teuthology.orchestra.run.smithi182.stdout:checking errno.h presence... yes 2023-03-08T15:51:22.635 INFO:teuthology.orchestra.run.smithi182.stdout:checking for errno.h... yes 2023-03-08T15:51:22.719 INFO:teuthology.orchestra.run.smithi182.stdout:checking malloc.h usability... yes 2023-03-08T15:51:22.746 INFO:teuthology.orchestra.run.smithi182.stdout:checking malloc.h presence... yes 2023-03-08T15:51:22.747 INFO:teuthology.orchestra.run.smithi182.stdout:checking for malloc.h... yes 2023-03-08T15:51:22.828 INFO:teuthology.orchestra.run.smithi182.stdout:checking uuid.h usability... no 2023-03-08T15:51:22.865 INFO:teuthology.orchestra.run.smithi182.stdout:checking uuid.h presence... no 2023-03-08T15:51:22.866 INFO:teuthology.orchestra.run.smithi182.stdout:checking for uuid.h... no 2023-03-08T15:51:22.948 INFO:teuthology.orchestra.run.smithi182.stdout:checking uuid/uuid.h usability... yes 2023-03-08T15:51:22.976 INFO:teuthology.orchestra.run.smithi182.stdout:checking uuid/uuid.h presence... yes 2023-03-08T15:51:22.977 INFO:teuthology.orchestra.run.smithi182.stdout:checking for uuid/uuid.h... yes 2023-03-08T15:51:23.059 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/uuid.h usability... no 2023-03-08T15:51:23.097 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/uuid.h presence... no 2023-03-08T15:51:23.097 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/uuid.h... no 2023-03-08T15:51:23.169 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/file.h usability... yes 2023-03-08T15:51:23.194 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/file.h presence... yes 2023-03-08T15:51:23.195 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/file.h... yes 2023-03-08T15:51:23.278 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/fcntl.h usability... yes 2023-03-08T15:51:23.303 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/fcntl.h presence... yes 2023-03-08T15:51:23.304 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/fcntl.h... yes 2023-03-08T15:51:23.387 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/syssgi.h usability... no 2023-03-08T15:51:23.425 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/syssgi.h presence... no 2023-03-08T15:51:23.425 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/syssgi.h... no 2023-03-08T15:51:23.521 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/param.h usability... yes 2023-03-08T15:51:23.552 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/param.h presence... yes 2023-03-08T15:51:23.552 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/param.h... yes 2023-03-08T15:51:23.574 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/stat.h... (cached) yes 2023-03-08T15:51:23.657 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/statvfs.h usability... yes 2023-03-08T15:51:23.682 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/statvfs.h presence... yes 2023-03-08T15:51:23.682 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/statvfs.h... yes 2023-03-08T15:51:23.766 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/time.h usability... yes 2023-03-08T15:51:23.792 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/time.h presence... yes 2023-03-08T15:51:23.792 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/time.h... yes 2023-03-08T15:51:23.887 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/ioctl.h usability... yes 2023-03-08T15:51:23.913 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/ioctl.h presence... yes 2023-03-08T15:51:23.913 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/ioctl.h... yes 2023-03-08T15:51:24.000 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/wait.h usability... yes 2023-03-08T15:51:24.028 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/wait.h presence... yes 2023-03-08T15:51:24.029 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/wait.h... yes 2023-03-08T15:51:24.050 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/types.h... (cached) yes 2023-03-08T15:51:24.072 INFO:teuthology.orchestra.run.smithi182.stdout:checking for strings.h... (cached) yes 2023-03-08T15:51:24.154 INFO:teuthology.orchestra.run.smithi182.stdout:checking err.h usability... yes 2023-03-08T15:51:24.179 INFO:teuthology.orchestra.run.smithi182.stdout:checking err.h presence... yes 2023-03-08T15:51:24.180 INFO:teuthology.orchestra.run.smithi182.stdout:checking for err.h... yes 2023-03-08T15:51:24.271 INFO:teuthology.orchestra.run.smithi182.stdout:checking linux/falloc.h usability... yes 2023-03-08T15:51:24.295 INFO:teuthology.orchestra.run.smithi182.stdout:checking linux/falloc.h presence... yes 2023-03-08T15:51:24.296 INFO:teuthology.orchestra.run.smithi182.stdout:checking for linux/falloc.h... yes 2023-03-08T15:51:24.379 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-03-08T15:51:24.416 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-03-08T15:51:24.416 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/fs/xfs_fsops.h... no 2023-03-08T15:51:24.486 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/fs/xfs_itable.h usability... no 2023-03-08T15:51:24.523 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/fs/xfs_itable.h presence... no 2023-03-08T15:51:24.523 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/fs/xfs_itable.h... no 2023-03-08T15:51:24.592 INFO:teuthology.orchestra.run.smithi182.stdout:checking xfs/platform_defs.h usability... no 2023-03-08T15:51:24.629 INFO:teuthology.orchestra.run.smithi182.stdout:checking xfs/platform_defs.h presence... no 2023-03-08T15:51:24.630 INFO:teuthology.orchestra.run.smithi182.stdout:checking for xfs/platform_defs.h... no 2023-03-08T15:51:24.699 INFO:teuthology.orchestra.run.smithi182.stdout:checking btrfs/ioctl.h usability... no 2023-03-08T15:51:24.736 INFO:teuthology.orchestra.run.smithi182.stdout:checking btrfs/ioctl.h presence... no 2023-03-08T15:51:24.737 INFO:teuthology.orchestra.run.smithi182.stdout:checking for btrfs/ioctl.h... no 2023-03-08T15:51:24.806 INFO:teuthology.orchestra.run.smithi182.stdout:checking cifs/ioctl.h usability... no 2023-03-08T15:51:24.843 INFO:teuthology.orchestra.run.smithi182.stdout:checking cifs/ioctl.h presence... no 2023-03-08T15:51:24.844 INFO:teuthology.orchestra.run.smithi182.stdout:checking for cifs/ioctl.h... no 2023-03-08T15:51:24.921 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/mman.h usability... yes 2023-03-08T15:51:24.946 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/mman.h presence... yes 2023-03-08T15:51:24.946 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/mman.h... yes 2023-03-08T15:51:25.003 INFO:teuthology.orchestra.run.smithi182.stdout:checking for xfs/xfs_log_format.h... no 2023-03-08T15:51:25.100 INFO:teuthology.orchestra.run.smithi182.stdout:checking for uuid_compare... no 2023-03-08T15:51:25.180 INFO:teuthology.orchestra.run.smithi182.stdout:checking for uuid_compare in -luuid... yes 2023-03-08T15:51:25.302 INFO:teuthology.orchestra.run.smithi182.stdout:checking for xfs/xfs.h... yes 2023-03-08T15:51:25.350 INFO:teuthology.orchestra.run.smithi182.stdout:checking for xfs/libxfs.h... no 2023-03-08T15:51:25.416 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether xlog_assign_lsn is declared... no 2023-03-08T15:51:25.492 INFO:teuthology.orchestra.run.smithi182.stdout:checking for xfs/xqm.h... yes 2023-03-08T15:51:25.603 INFO:teuthology.orchestra.run.smithi182.stdout:checking xfsctl from xfs/xfs.h... ok 2023-03-08T15:51:25.666 INFO:teuthology.orchestra.run.smithi182.stdout:checking xfs/handle.h usability... yes 2023-03-08T15:51:25.690 INFO:teuthology.orchestra.run.smithi182.stdout:checking xfs/handle.h presence... yes 2023-03-08T15:51:25.690 INFO:teuthology.orchestra.run.smithi182.stdout:checking for xfs/handle.h... yes 2023-03-08T15:51:25.781 INFO:teuthology.orchestra.run.smithi182.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-03-08T15:51:25.846 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/acl.h usability... yes 2023-03-08T15:51:25.873 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/acl.h presence... yes 2023-03-08T15:51:25.874 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/acl.h... yes 2023-03-08T15:51:25.958 INFO:teuthology.orchestra.run.smithi182.stdout:checking acl/libacl.h usability... yes 2023-03-08T15:51:25.985 INFO:teuthology.orchestra.run.smithi182.stdout:checking acl/libacl.h presence... yes 2023-03-08T15:51:25.986 INFO:teuthology.orchestra.run.smithi182.stdout:checking for acl/libacl.h... yes 2023-03-08T15:51:26.071 INFO:teuthology.orchestra.run.smithi182.stdout:checking for acl_init in -lacl... yes 2023-03-08T15:51:26.135 INFO:teuthology.orchestra.run.smithi182.stdout:checking gdbm-ndbm.h usability... no 2023-03-08T15:51:26.172 INFO:teuthology.orchestra.run.smithi182.stdout:checking gdbm-ndbm.h presence... no 2023-03-08T15:51:26.173 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gdbm-ndbm.h... no 2023-03-08T15:51:26.234 INFO:teuthology.orchestra.run.smithi182.stdout:checking gdbm/ndbm.h usability... no 2023-03-08T15:51:26.271 INFO:teuthology.orchestra.run.smithi182.stdout:checking gdbm/ndbm.h presence... no 2023-03-08T15:51:26.271 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gdbm/ndbm.h... no 2023-03-08T15:51:26.331 INFO:teuthology.orchestra.run.smithi182.stdout:checking ndbm.h usability... no 2023-03-08T15:51:26.370 INFO:teuthology.orchestra.run.smithi182.stdout:checking ndbm.h presence... no 2023-03-08T15:51:26.370 INFO:teuthology.orchestra.run.smithi182.stdout:checking for ndbm.h... no 2023-03-08T15:51:26.436 INFO:teuthology.orchestra.run.smithi182.stdout:checking libaio.h usability... yes 2023-03-08T15:51:26.468 INFO:teuthology.orchestra.run.smithi182.stdout:checking libaio.h presence... yes 2023-03-08T15:51:26.468 INFO:teuthology.orchestra.run.smithi182.stdout:checking for libaio.h... yes 2023-03-08T15:51:26.532 INFO:teuthology.orchestra.run.smithi182.stdout:checking liburing.h usability... no 2023-03-08T15:51:26.569 INFO:teuthology.orchestra.run.smithi182.stdout:checking liburing.h presence... no 2023-03-08T15:51:26.569 INFO:teuthology.orchestra.run.smithi182.stdout:checking for liburing.h... no 2023-03-08T15:51:26.629 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/capability.h usability... no 2023-03-08T15:51:26.666 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/capability.h presence... no 2023-03-08T15:51:26.667 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/capability.h... no 2023-03-08T15:51:26.729 INFO:teuthology.orchestra.run.smithi182.stdout:checking linux/fiemap.h usability... yes 2023-03-08T15:51:26.753 INFO:teuthology.orchestra.run.smithi182.stdout:checking linux/fiemap.h presence... yes 2023-03-08T15:51:26.754 INFO:teuthology.orchestra.run.smithi182.stdout:checking for linux/fiemap.h... yes 2023-03-08T15:51:26.839 INFO:teuthology.orchestra.run.smithi182.stdout:checking for fallocate... yes 2023-03-08T15:51:26.924 INFO:teuthology.orchestra.run.smithi182.stdout:checking for open_by_handle_at... yes 2023-03-08T15:51:26.989 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/prctl.h usability... yes 2023-03-08T15:51:27.016 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/prctl.h presence... yes 2023-03-08T15:51:27.016 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/prctl.h... yes 2023-03-08T15:51:27.083 INFO:teuthology.orchestra.run.smithi182.stdout:checking linux/fs.h usability... yes 2023-03-08T15:51:27.109 INFO:teuthology.orchestra.run.smithi182.stdout:checking linux/fs.h presence... yes 2023-03-08T15:51:27.110 INFO:teuthology.orchestra.run.smithi182.stdout:checking for linux/fs.h... yes 2023-03-08T15:51:27.170 INFO:teuthology.orchestra.run.smithi182.stdout:checking btrfsutil.h usability... no 2023-03-08T15:51:27.207 INFO:teuthology.orchestra.run.smithi182.stdout:checking btrfsutil.h presence... no 2023-03-08T15:51:27.207 INFO:teuthology.orchestra.run.smithi182.stdout:checking for btrfsutil.h... no 2023-03-08T15:51:27.294 INFO:teuthology.orchestra.run.smithi182.stdout:checking for copy_file_range... yes 2023-03-08T15:51:27.383 INFO:teuthology.orchestra.run.smithi182.stdout:checking for SEEK_DATA... yes 2023-03-08T15:51:27.493 INFO:teuthology.orchestra.run.smithi182.stdout:checking for BMV_OF_SHARED... yes 2023-03-08T15:51:27.585 INFO:teuthology.orchestra.run.smithi182.stdout:checking for nftw... yes 2023-03-08T15:51:27.673 INFO:teuthology.orchestra.run.smithi182.stdout:checking for RLIMIT_NOFILE... yes 2023-03-08T15:51:27.759 INFO:teuthology.orchestra.run.smithi182.stdout:checking for renameat2... yes 2023-03-08T15:51:27.846 INFO:teuthology.orchestra.run.smithi182.stdout:checking for reallocarray... yes 2023-03-08T15:51:27.896 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct mount_attr... no 2023-03-08T15:51:28.009 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct btrfs_qgroup_limit... yes 2023-03-08T15:51:28.117 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-03-08T15:51:28.225 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-03-08T15:51:28.334 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-03-08T15:51:28.442 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-03-08T15:51:28.551 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-03-08T15:51:28.660 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-03-08T15:51:28.737 INFO:teuthology.orchestra.run.smithi182.stdout:checking linux/btrfs.h usability... yes 2023-03-08T15:51:28.763 INFO:teuthology.orchestra.run.smithi182.stdout:checking linux/btrfs.h presence... yes 2023-03-08T15:51:28.763 INFO:teuthology.orchestra.run.smithi182.stdout:checking for linux/btrfs.h... yes 2023-03-08T15:51:28.849 INFO:teuthology.orchestra.run.smithi182.stdout:checking linux/btrfs_tree.h usability... yes 2023-03-08T15:51:28.875 INFO:teuthology.orchestra.run.smithi182.stdout:checking linux/btrfs_tree.h presence... yes 2023-03-08T15:51:28.876 INFO:teuthology.orchestra.run.smithi182.stdout:checking for linux/btrfs_tree.h... yes 2023-03-08T15:51:28.985 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-03-08T15:51:29.026 INFO:teuthology.orchestra.run.smithi182.stdout:configure: creating ./config.status 2023-03-08T15:51:30.445 INFO:teuthology.orchestra.run.smithi182.stdout:config.status: creating include/builddefs 2023-03-08T15:51:30.490 INFO:teuthology.orchestra.run.smithi182.stdout:config.status: creating include/config.h 2023-03-08T15:51:30.527 INFO:teuthology.orchestra.run.smithi182.stdout:config.status: executing libtool commands 2023-03-08T15:51:30.647 INFO:teuthology.orchestra.run.smithi182.stdout:Building include 2023-03-08T15:51:30.658 INFO:teuthology.orchestra.run.smithi182.stdout:Building lib 2023-03-08T15:51:30.667 INFO:teuthology.orchestra.run.smithi182.stdout: [LTDEP] 2023-03-08T15:51:30.955 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] dataascii.lo 2023-03-08T15:51:31.229 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] databin.lo 2023-03-08T15:51:31.539 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] datapid.lo 2023-03-08T15:51:31.802 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] file_lock.lo 2023-03-08T15:51:32.118 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] forker.lo 2023-03-08T15:51:32.410 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] pattern.lo 2023-03-08T15:51:32.684 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] open_flags.lo 2023-03-08T15:51:32.991 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] random_range.lo 2023-03-08T15:51:33.374 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] string_to_tokens.lo 2023-03-08T15:51:33.631 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] str_to_bytes.lo 2023-03-08T15:51:33.919 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] tlibio.lo 2023-03-08T15:51:34.320 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] write_log.lo 2023-03-08T15:51:34.725 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] random.lo 2023-03-08T15:51:35.000 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] 2023-03-08T15:51:35.189 INFO:teuthology.orchestra.run.smithi182.stdout:Building ltp 2023-03-08T15:51:35.197 INFO:teuthology.orchestra.run.smithi182.stdout: [DEP] 2023-03-08T15:51:35.463 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] doio 2023-03-08T15:51:36.364 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fsstress 2023-03-08T15:51:37.811 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fsx 2023-03-08T15:51:38.819 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] growfiles 2023-03-08T15:51:39.050 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:51:39.053 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:51:39.055 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:51:39.537 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] iogen 2023-03-08T15:51:40.093 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-stress 2023-03-08T15:51:40.709 INFO:teuthology.orchestra.run.smithi182.stdout:Building src 2023-03-08T15:51:40.721 INFO:teuthology.orchestra.run.smithi182.stdout: [DEP] 2023-03-08T15:51:44.151 INFO:teuthology.orchestra.run.smithi182.stdout: [DEP] 2023-03-08T15:51:44.224 INFO:teuthology.orchestra.run.smithi182.stdout: [DEP] 2023-03-08T15:51:44.247 INFO:teuthology.orchestra.run.smithi182.stdout: [DEP] 2023-03-08T15:51:44.727 INFO:teuthology.orchestra.run.smithi182.stdout: [DEP] 2023-03-08T15:51:44.784 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] dirstress 2023-03-08T15:51:45.231 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fill 2023-03-08T15:51:45.580 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fill2 2023-03-08T15:51:46.015 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] getpagesize 2023-03-08T15:51:46.345 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] holes 2023-03-08T15:51:46.745 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] lstat64 2023-03-08T15:51:47.126 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] nametest 2023-03-08T15:51:47.568 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] permname 2023-03-08T15:51:47.971 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] randholes 2023-03-08T15:51:48.423 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] runas 2023-03-08T15:51:48.805 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] truncfile 2023-03-08T15:51:49.190 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] usemem 2023-03-08T15:51:49.537 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] mmapcat 2023-03-08T15:51:49.881 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] append_reader 2023-03-08T15:51:50.230 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] append_writer 2023-03-08T15:51:50.580 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] dirperf 2023-03-08T15:51:51.005 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] metaperf 2023-03-08T15:51:51.458 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] devzero 2023-03-08T15:51:51.836 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] feature 2023-03-08T15:51:52.258 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] alloc 2023-03-08T15:51:52.675 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fault 2023-03-08T15:51:53.043 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fstest 2023-03-08T15:51:53.486 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_access_root 2023-03-08T15:51:53.838 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] godown 2023-03-08T15:51:54.210 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] resvtest 2023-03-08T15:51:54.601 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] writemod 2023-03-08T15:51:54.944 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] writev_on_pagefault 2023-03-08T15:51:55.303 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] makeextents 2023-03-08T15:51:55.685 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] itrash 2023-03-08T15:51:56.039 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] rename 2023-03-08T15:51:56.374 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] multi_open_unlink 2023-03-08T15:51:56.739 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] unwritten_sync 2023-03-08T15:51:57.123 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] genhashnames 2023-03-08T15:51:57.507 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_holes 2023-03-08T15:51:57.850 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_mmap_writev 2023-03-08T15:51:58.196 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_truncate_cmtime 2023-03-08T15:51:58.552 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] dirhash_collide 2023-03-08T15:51:58.933 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_rename_overwrite 2023-03-08T15:51:59.270 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] holetest 2023-03-08T15:51:59.690 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_truncate_self 2023-03-08T15:52:00.028 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] af_unix 2023-03-08T15:52:00.380 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_mmap_stale_pmd 2023-03-08T15:52:00.730 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_mmap_cow_race 2023-03-08T15:52:01.094 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_mmap_fallocate 2023-03-08T15:52:01.441 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fsync-err 2023-03-08T15:52:01.824 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_mmap_write_ro 2023-03-08T15:52:02.173 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_ext4_dax_journal_corruption 2023-03-08T15:52:02.532 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_ext4_dax_inline_corruption 2023-03-08T15:52:02.887 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_ofd_locks 2023-03-08T15:52:03.287 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_mmap_collision 2023-03-08T15:52:03.684 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] mmap-write-concurrent 2023-03-08T15:52:04.055 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_get_file_time 2023-03-08T15:52:04.398 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_create_short_dirs 2023-03-08T15:52:04.763 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_create_long_dirs 2023-03-08T15:52:05.125 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_enospc 2023-03-08T15:52:05.512 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_mmap_writev_overlap 2023-03-08T15:52:05.879 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] checkpoint_journal 2023-03-08T15:52:06.232 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] mmap-rw-fault 2023-03-08T15:52:06.608 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] allocstale 2023-03-08T15:52:06.982 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_mmap_cow_memory_failure 2023-03-08T15:52:07.352 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fake-dump-rootino 2023-03-08T15:52:07.701 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] dio-buf-fault 2023-03-08T15:52:08.052 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfsctl 2023-03-08T15:52:08.445 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] bstat 2023-03-08T15:52:08.855 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_mtab 2023-03-08T15:52:09.189 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:52:09.192 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:52:09.194 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:52:09.241 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] getdevicesize 2023-03-08T15:52:09.580 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] preallo_rw_pattern_reader 2023-03-08T15:52:09.941 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] preallo_rw_pattern_writer 2023-03-08T15:52:10.306 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] ftrunc 2023-03-08T15:52:10.654 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] trunc 2023-03-08T15:52:11.015 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fs_perms 2023-03-08T15:52:11.377 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] testx 2023-03-08T15:52:11.704 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] looptest 2023-03-08T15:52:12.095 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] locktest 2023-03-08T15:52:12.599 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] unwritten_mmap 2023-03-08T15:52:12.966 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] bulkstat_unlink_test 2023-03-08T15:52:13.372 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] deduperace 2023-03-08T15:52:13.766 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] bulkstat_unlink_test_modified 2023-03-08T15:52:14.171 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_dir_offset 2023-03-08T15:52:14.518 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_futimens 2023-03-08T15:52:14.856 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_immutable 2023-03-08T15:52:15.675 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] stale_handle 2023-03-08T15:52:16.050 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] pwrite_mmap_blocked 2023-03-08T15:52:16.405 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_dir_offset2 2023-03-08T15:52:16.796 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] seek_sanity_test 2023-03-08T15:52:17.412 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] seek_copy_test 2023-03-08T15:52:17.790 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_readdir_1 2023-03-08T15:52:18.138 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_readdir_2 2023-03-08T15:52:18.489 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fsync-tester 2023-03-08T15:52:18.938 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] nsexec 2023-03-08T15:52:19.313 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] cloner 2023-03-08T15:52:19.691 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] renameat2 2023-03-08T15:52:20.061 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_getcwd 2023-03-08T15:52:20.418 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] e4compact 2023-03-08T15:52:20.821 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] test-nextquota 2023-03-08T15:52:21.197 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] punch-alternating 2023-03-08T15:52:21.572 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] attr-list-by-handle-cursor-test 2023-03-08T15:52:21.945 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] listxattr 2023-03-08T15:52:22.289 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] dio-interleaved 2023-03-08T15:52:22.650 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_dir_type 2023-03-08T15:52:23.005 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] dio-invalidate-cache 2023-03-08T15:52:23.409 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] stat_test 2023-03-08T15:52:23.905 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_encrypted_d_revalidate 2023-03-08T15:52:24.274 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] attr_replace_test 2023-03-08T15:52:24.638 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] swapon 2023-03-08T15:52:25.005 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] mkswap 2023-03-08T15:52:25.358 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_attr_corruption 2023-03-08T15:52:25.707 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_open_tmpfiles 2023-03-08T15:52:26.092 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fscrypt-crypt-util 2023-03-08T15:52:26.927 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] bulkstat_null_ocount 2023-03-08T15:52:27.291 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] splice-test 2023-03-08T15:52:27.673 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] chprojid_fail 2023-03-08T15:52:28.041 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] detached_mounts_propagation 2023-03-08T15:52:28.433 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] ext4_resize 2023-03-08T15:52:28.780 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_readdir_3 2023-03-08T15:52:29.175 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] splice2pipe 2023-03-08T15:52:29.538 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] uuid_ioctl 2023-03-08T15:52:29.895 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fiemap-tester 2023-03-08T15:52:30.368 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_stripealign 2023-03-08T15:52:30.722 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] open_by_handle 2023-03-08T15:52:31.180 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] t_mmap_dio 2023-03-08T15:52:31.541 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfsfind 2023-03-08T15:52:31.942 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fssum 2023-03-08T15:52:32.575 INFO:teuthology.orchestra.run.smithi182.stdout:Building log-writes 2023-03-08T15:52:32.588 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] replay-log 2023-03-08T15:52:33.111 INFO:teuthology.orchestra.run.smithi182.stdout:Building perf 2023-03-08T15:52:33.122 INFO:teuthology.orchestra.run.smithi182.stdout:Building aio-dio-regress 2023-03-08T15:52:33.137 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-dio-append-write-fallocate-race 2023-03-08T15:52:33.516 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-dio-fcntl-race 2023-03-08T15:52:33.883 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-dio-subblock-eof-read 2023-03-08T15:52:34.229 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-dio-append-write-read-race 2023-03-08T15:52:34.612 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-dio-invalidate-readahead 2023-03-08T15:52:34.981 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-dio-write-verify 2023-03-08T15:52:35.375 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-03-08T15:52:35.711 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-dio-cycle-write 2023-03-08T15:52:36.100 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-dio-extend-stat 2023-03-08T15:52:36.470 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-03-08T15:52:36.806 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aiocp 2023-03-08T15:52:37.233 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-dio-hole-filling-race 2023-03-08T15:52:37.587 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-dio-invalidate-failure 2023-03-08T15:52:37.951 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aiodio_sparse2 2023-03-08T15:52:38.370 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-last-ref-held-by-io 2023-03-08T15:52:38.747 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-dio-eof-race 2023-03-08T15:52:39.135 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] aio-dio-cow-race 2023-03-08T15:52:39.331 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:52:39.333 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:52:39.335 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:52:39.502 INFO:teuthology.orchestra.run.smithi182.stdout:Building vfs 2023-03-08T15:52:39.516 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] vfstest 2023-03-08T15:52:41.600 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] mount-idmapped 2023-03-08T15:52:42.190 INFO:teuthology.orchestra.run.smithi182.stdout:Building m4 2023-03-08T15:52:42.200 INFO:teuthology.orchestra.run.smithi182.stdout:Building common 2023-03-08T15:52:42.211 INFO:teuthology.orchestra.run.smithi182.stdout:Building tests 2023-03-08T15:52:42.225 INFO:teuthology.orchestra.run.smithi182.stdout:Building perf 2023-03-08T15:52:42.239 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/perf/group.list 2023-03-08T15:52:42.283 INFO:teuthology.orchestra.run.smithi182.stdout:Building ext4 2023-03-08T15:52:42.298 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/ext4/group.list 2023-03-08T15:52:42.437 INFO:teuthology.orchestra.run.smithi182.stdout:Building ocfs2 2023-03-08T15:52:42.451 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/ocfs2/group.list 2023-03-08T15:52:42.502 INFO:teuthology.orchestra.run.smithi182.stdout:Building overlay 2023-03-08T15:52:42.516 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/overlay/group.list 2023-03-08T15:52:42.658 INFO:teuthology.orchestra.run.smithi182.stdout:Building cifs 2023-03-08T15:52:42.672 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/cifs/group.list 2023-03-08T15:52:42.719 INFO:teuthology.orchestra.run.smithi182.stdout:Building generic 2023-03-08T15:52:42.736 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/generic/group.list 2023-03-08T15:52:43.086 INFO:teuthology.orchestra.run.smithi182.stdout:Building shared 2023-03-08T15:52:43.100 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/shared/group.list 2023-03-08T15:52:43.166 INFO:teuthology.orchestra.run.smithi182.stdout:Building xfs 2023-03-08T15:52:43.182 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/xfs/group.list 2023-03-08T15:52:43.538 INFO:teuthology.orchestra.run.smithi182.stdout:Building f2fs 2023-03-08T15:52:43.552 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/f2fs/group.list 2023-03-08T15:52:43.617 INFO:teuthology.orchestra.run.smithi182.stdout:Building udf 2023-03-08T15:52:43.631 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/udf/group.list 2023-03-08T15:52:43.674 INFO:teuthology.orchestra.run.smithi182.stdout:Building ceph 2023-03-08T15:52:43.688 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/ceph/group.list 2023-03-08T15:52:43.743 INFO:teuthology.orchestra.run.smithi182.stdout:Building nfs 2023-03-08T15:52:43.756 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/nfs/group.list 2023-03-08T15:52:43.811 INFO:teuthology.orchestra.run.smithi182.stdout:Building btrfs 2023-03-08T15:52:43.826 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/btrfs/group.list 2023-03-08T15:52:44.039 INFO:teuthology.orchestra.run.smithi182.stdout:Building selftest 2023-03-08T15:52:44.052 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/selftest/group.list 2023-03-08T15:52:44.105 DEBUG:teuthology.orchestra.run.smithi182:> (cd /tmp/tmp.AsxONLoNsgxfstests-dev && exec sudo make install) 2023-03-08T15:52:44.278 INFO:teuthology.orchestra.run.smithi182.stdout:Building include 2023-03-08T15:52:44.288 INFO:teuthology.orchestra.run.smithi182.stdout:Building lib 2023-03-08T15:52:44.300 INFO:teuthology.orchestra.run.smithi182.stdout:Building ltp 2023-03-08T15:52:44.311 INFO:teuthology.orchestra.run.smithi182.stdout:Building src 2023-03-08T15:52:44.395 INFO:teuthology.orchestra.run.smithi182.stdout:Building log-writes 2023-03-08T15:52:44.406 INFO:teuthology.orchestra.run.smithi182.stdout:Building perf 2023-03-08T15:52:44.416 INFO:teuthology.orchestra.run.smithi182.stdout:Building aio-dio-regress 2023-03-08T15:52:44.428 INFO:teuthology.orchestra.run.smithi182.stdout:Building vfs 2023-03-08T15:52:44.439 INFO:teuthology.orchestra.run.smithi182.stdout:Building m4 2023-03-08T15:52:44.449 INFO:teuthology.orchestra.run.smithi182.stdout:Building common 2023-03-08T15:52:44.460 INFO:teuthology.orchestra.run.smithi182.stdout:Building tests 2023-03-08T15:52:44.474 INFO:teuthology.orchestra.run.smithi182.stdout:Building perf 2023-03-08T15:52:44.488 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/perf/group.list 2023-03-08T15:52:44.560 INFO:teuthology.orchestra.run.smithi182.stdout:Building ext4 2023-03-08T15:52:44.574 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/ext4/group.list 2023-03-08T15:52:44.714 INFO:teuthology.orchestra.run.smithi182.stdout:Building ocfs2 2023-03-08T15:52:44.728 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/ocfs2/group.list 2023-03-08T15:52:44.779 INFO:teuthology.orchestra.run.smithi182.stdout:Building overlay 2023-03-08T15:52:44.793 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/overlay/group.list 2023-03-08T15:52:44.934 INFO:teuthology.orchestra.run.smithi182.stdout:Building cifs 2023-03-08T15:52:44.948 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/cifs/group.list 2023-03-08T15:52:44.996 INFO:teuthology.orchestra.run.smithi182.stdout:Building generic 2023-03-08T15:52:45.012 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/generic/group.list 2023-03-08T15:52:45.354 INFO:teuthology.orchestra.run.smithi182.stdout:Building shared 2023-03-08T15:52:45.368 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/shared/group.list 2023-03-08T15:52:45.434 INFO:teuthology.orchestra.run.smithi182.stdout:Building xfs 2023-03-08T15:52:45.450 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/xfs/group.list 2023-03-08T15:52:45.799 INFO:teuthology.orchestra.run.smithi182.stdout:Building f2fs 2023-03-08T15:52:45.812 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/f2fs/group.list 2023-03-08T15:52:45.877 INFO:teuthology.orchestra.run.smithi182.stdout:Building udf 2023-03-08T15:52:45.891 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/udf/group.list 2023-03-08T15:52:45.934 INFO:teuthology.orchestra.run.smithi182.stdout:Building ceph 2023-03-08T15:52:45.948 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/ceph/group.list 2023-03-08T15:52:46.003 INFO:teuthology.orchestra.run.smithi182.stdout:Building nfs 2023-03-08T15:52:46.016 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/nfs/group.list 2023-03-08T15:52:46.071 INFO:teuthology.orchestra.run.smithi182.stdout:Building btrfs 2023-03-08T15:52:46.086 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/btrfs/group.list 2023-03-08T15:52:46.294 INFO:teuthology.orchestra.run.smithi182.stdout:Building selftest 2023-03-08T15:52:46.307 INFO:teuthology.orchestra.run.smithi182.stdout: [GROUP] /tmp/tmp.AsxONLoNsgxfstests-dev/tests/selftest/group.list 2023-03-08T15:52:46.354 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-03-08T15:52:46.357 INFO:teuthology.orchestra.run.smithi182.stdout:gmake[1]: Nothing to be done for 'install'. 2023-03-08T15:52:46.358 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-03-08T15:52:46.362 INFO:teuthology.orchestra.run.smithi182.stdout:gmake[1]: Nothing to be done for 'install'. 2023-03-08T15:52:46.362 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-03-08T15:52:46.366 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-03-08T15:52:46.401 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-03-08T15:52:46.662 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-03-08T15:52:46.698 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-03-08T15:52:46.739 INFO:teuthology.orchestra.run.smithi182.stdout:Building log-writes 2023-03-08T15:52:46.749 INFO:teuthology.orchestra.run.smithi182.stdout:Building perf 2023-03-08T15:52:46.759 INFO:teuthology.orchestra.run.smithi182.stdout:Building aio-dio-regress 2023-03-08T15:52:46.771 INFO:teuthology.orchestra.run.smithi182.stdout:Building vfs 2023-03-08T15:52:46.779 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake -C log-writes install 2023-03-08T15:52:46.782 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-03-08T15:52:46.817 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-03-08T15:52:46.853 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake -C perf install 2023-03-08T15:52:46.856 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-03-08T15:52:46.891 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-03-08T15:52:46.980 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-03-08T15:52:46.984 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-03-08T15:52:47.018 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aiocp aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aio-last-ref-held-by-io aio-dio-eof-race aio-dio-cow-race /var/lib/xfstests/src/aio-dio-regress 2023-03-08T15:52:47.227 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake -C vfs install 2023-03-08T15:52:47.230 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-03-08T15:52:47.265 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-03-08T15:52:47.314 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-03-08T15:52:47.348 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-03-08T15:52:51.901 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-03-08T15:52:52.229 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-03-08T15:52:52.305 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-03-08T15:52:52.309 INFO:teuthology.orchestra.run.smithi182.stdout:gmake[1]: Nothing to be done for 'install'. 2023-03-08T15:52:52.309 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-03-08T15:52:52.312 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-03-08T15:52:52.347 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-03-08T15:52:52.866 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-03-08T15:52:52.869 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AsxONLoNsgxfstests-dev/tests/btrfs/ install 2023-03-08T15:52:52.874 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-03-08T15:52:52.909 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 290 291 299 /var/lib/xfstests/tests/btrfs 2023-03-08T15:52:56.026 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-03-08T15:52:56.061 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 240.out 095.out 140.out 265.out 208.out 008.out 040.out 104.out 004.out 021.out 233.out 194.out 152.out 055.out 133.out 109.out 188.out 033.out 252.out 270.out 237.out 088.out 257.out 202.out 137.out 210.out 102.out 125.out 037.out 035.out 243.out 192.out 282.out 267.out 178.out 284.out 052.out 062.out 256.out 207.out 228.out 065.out 247.out 273.out 168.out 251.out 036.out 087.out 089.out 258.out 215.out 115.out 015.out 250.out 191.out 046.out 051.out 011.out 177.out 219.out 119.out 244.out 128.out 232.out 028.out 248.out 162.out 147.out 242.out 143.out 276.out 189.out 220.out 148.out 120.out 020.out 002.out 171.out 261.out 135.out 142.out 092.out 072.out 048.out 130.out 038.out 129.out 029.out 229.out 211.out 111.out 155.out 134.out 170.out 260.out 157.out 034.out 161.out 246.out 175.out 216.out 116.out 043.out 110.out 010.out 001.out 114.out 138.out 074.out 277.out 187.out 184.out 153.out 146.out 160.out 291.out 274.out 264.out 071.out 061.out 239.out 047.out 200.out 100.out 139.out 286.out 269.out 039.out 222.out 196.out 098.out 290.out 080.out 070.out 060.out 206.out 106.out 006.out 167.out 217.out 117.out 017.out 159.out 158.out 085.out 057.out 212.out 204.out 059.out 254.out 279.out 281.out 225.out 235.out 007.out 253.out 025.out 124.out 024.out 172.out 063.out 058.out 169.out 042.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 068.out 045.out 186.out 209.out 053.out 255.out 164.out 154.out 094.out 241.out 084.out 165.out 141.out 214.out 014.out 176.out 278.out 041.out 016.out 156.out 067.out 005.out 223.out 086.out 123.out 179.out 236.out 227.out 032.out 182.out 205.out 136.out 144.out 096.out 198.out 108.out 190.out 280.out 050.out 105.out 185.out 091.out 266.out 285.out 183.out 056.out 201.out 019.out 101.out 079.out 151.out 231.out 081.out 075.out 069.out 163.out 044.out 131.out 213.out 113.out 013.out 031.out 272.out 078.out 173.out 259.out 132.out 093.out 197.out 263.out 127.out 230.out 027.out 299.out 023.out 073.out 030.out 203.out 103.out 003.out 245.out 145.out 249.out 122.out 234.out 022.out 174.out 066.out 009.out 090.out 224.out 181.out 076.out 149.out 064.out 077.out 218.out 118.out 018.out 238.out 107.out 262.out 054.out 150.out 049.out 082.out 226.out 126.out 026.out 166.out 180.out 268.out 275.out 221.out 121.out 112.out 012.out 195.out /var/lib/xfstests/tests/btrfs 2023-03-08T15:52:59.180 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AsxONLoNsgxfstests-dev/tests/ceph/ install 2023-03-08T15:52:59.183 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-03-08T15:52:59.218 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-03-08T15:52:59.295 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-03-08T15:52:59.330 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 005.out 003.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-03-08T15:52:59.408 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AsxONLoNsgxfstests-dev/tests/cifs/ install 2023-03-08T15:52:59.411 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-03-08T15:52:59.446 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-03-08T15:52:59.481 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-03-08T15:52:59.516 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-03-08T15:52:59.551 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AsxONLoNsgxfstests-dev/tests/ext4/ install 2023-03-08T15:52:59.555 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-03-08T15:52:59.590 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-03-08T15:53:00.335 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-03-08T15:53:00.370 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 049.out 032.out 039.out 005.out 308.out 026.out 008.out 050.out 040.out 305.out 006.out 021.out 016.out 017.out 012.out 009.out 054.out 033.out 303.out 056.out 004.out 046.out 025.out 057.out 302.out 020.out 002.out 044.out 024.out 013.out 031.out 027.out 306.out 048.out 038.out 052.out 042.out 047.out 029.out 304.out 030.out 003.out 015.out 043.out 053.out 035.out 055.out 059.out 018.out 301.out 010.out 058.out 022.out 007.out 045.out 014.out 036.out 271.out 051.out 011.out 041.out 037.out 307.out 019.out 034.out 028.out 023.out /var/lib/xfstests/tests/ext4 2023-03-08T15:53:01.156 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AsxONLoNsgxfstests-dev/tests/f2fs/ install 2023-03-08T15:53:01.159 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-03-08T15:53:01.194 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-03-08T15:53:01.239 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-03-08T15:53:01.274 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-03-08T15:53:01.320 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AsxONLoNsgxfstests-dev/tests/generic/ install 2023-03-08T15:53:01.327 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-03-08T15:53:01.361 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 /var/lib/xfstests/tests/generic 2023-03-08T15:53:08.968 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-03-08T15:53:09.003 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 050.out.default 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 035.cfg 050.cfg 104.out 349.out 377.out 537.out 443.out 683.out 033.out 385.out 696.out 088.out 597.out 097.out 296.out 137.out 102.out 034.out 389.out 646.out 592.out 401.out 148.out 282.out 267.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 328.out 207.out 228.out 128.out 171.out 183.out 157.out 247.out 273.out 570.out 520.out 555.out 420.out 446.out 006.out 397.out 460.out 632.out 311.out 532.out 191.out 064.out 471.out 111.out 078.out 519.out 011.out 131.out 319.out 246.out 332.out 119.out 423.out 323.out 134.out 190.out 260.out 095.out 638.out 161.out 516.out 416.out 316.out 216.out 116.out 043.out 358.out 338.out 287.out 238.out 533.out 295.out 138.out 277.out 187.out 153.out 160.out 291.out 274.out 061.out 239.out 047.out 530.out 545.out 379.out 691.out 039.out 310.out 665.out 098.out 426.out 690.out 220.out 706.out 606.out 506.out 406.out 306.out 206.out 106.out 447.out 217.out 688.out 357.out 485.out 182.out 442.out 188.out 030.out 556.out 099.out 599.out 177.out 281.out 524.out 174.out 542.out 324.out 655.out 224.out 313.out 257.out 124.out 142.out 672.out 278.out 058.out 384.out 042.out 626.out 497.out 593.out 456.out 399.out 375.out 437.out 263.out 364.out 209.out 356.out 474.out 341.out 094.out 337.out 241.out 089.out 540.out 077.out 616.out 614.out 514.out 025.out 414.out 314.out 440.out 014.out 342.out 041.out 016.out 340.out 156.out 572.out 586.out 521.out 240.out 549.out 092.out 633.out 280.out 543.out 140.out 065.out 348.out 608.out 568.out 508.out 408.out 308.out 373.out 670.out 604.out 040.out 640.out 579.out 096.out 297.out 393.out 671.out 476.out 087.out 233.out 639.out 236.out 186.out 539.out 090.out 279.out 276.out 258.out 439.out 376.out 587.out 339.out 046.out 652.out 294.out 352.out 458.out 139.out 481.out 178.out 082.out 317.out 552.out 480.out 017.out 120.out 067.out 193.out 452.out 679.out 292.out 020.out 252.out 585.out 167.out 368.out 624.out 663.out 199.out 651.out 184.out 509.out 409.out 466.out 309.out 495.out 109.out 482.out 625.out 283.out 488.out 390.out 496.out 325.out 465.out 225.out 322.out 636.out 125.out 048.out 222.out 650.out 152.out 658.out 315.out 563.out 578.out 551.out 392.out 682.out 595.out 684.out 642.out 550.out 052.out 062.out 351.out 298.out 571.out 583.out 450.out 463.out 674.out 251.out 176.out 069.out 644.out 489.out 487.out 544.out 615.out 395.out 515.out 415.out 344.out 215.out 115.out 250.out 244.out 391.out 681.out 594.out 536.out 577.out 436.out 637.out 336.out 234.out 144.out 505.out 405.out 667.out 136.out 105.out 363.out 036.out 198.out 108.out 008.out 680.out 705.out 605.out 018.out 305.out 205.out 005.out 523.out 084.out 451.out 619.out 548.out 685.out 562.out 382.out 388.out 527.out 158.out 019.out 003.out 695.out 079.out 237.out 151.out 163.out 044.out 127.out 661.out 664.out 027.out 232.out 478.out 612.out 584.out 462.out 623.out 350.out 132.out 037.out 693.out 483.out 499.out 353.out 660.out 063.out 561.out 343.out 648.out 362.out 387.out 194.out 335.out 438.out 076.out 289.out 699.out 284.out 333.out 477.out 621.out 290.out 560.out 581.out 707.out 445.out 647.out 457.out 493.out 007.out 448.out 262.out 567.out 380.out 093.out 479.out 662.out 547.out 192.out 221.out 326.out 226.out 668.out 413.out 126.out 026.out 580.out 021.out 694.out 347.out 675.out 702.out 673.out 564.out 245.out 455.out 432.out 558.out 162.out 686.out 147.out 288.out 197.out 396.out 145.out 143.out 429.out 355.out 381.out 360.out 101.out 261.out 045.out 692.out 304.out 255.out 129.out 378.out 484.out 534.out 231.out 434.out 503.out 526.out 329.out 229.out 103.out 441.out 243.out 486.out 223.out 123.out 179.out 669.out 023.out 459.out 032.out 266.out 146.out 051.out 398.out 366.out 427.out 590.out 470.out 491.out 185.out 656.out 374.out 285.out 631.out 654.out 359.out 501.out 649.out 155.out 431.out 635.out 494.out 687.out 331.out 613.out 513.out 554.out 371.out 213.out 113.out 013.out 031.out 367.out 630.out 645.out 596.out 272.out 268.out 627.out 573.out 430.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 110.out 227.out 419.out 230.out 071.out 083.out 130.out 219.out 370.out 603.out 135.out 403.out 303.out 203.out 345.out 004.out 386.out 055.out 275.out 461.out 334.out 622.out 522.out 422.out 394.out 598.out 249.out 122.out 689.out 166.out 022.out 424.out 346.out 066.out 490.out 435.out 591.out 517.out 181.out 676.out 271.out 149.out 618.out 518.out 418.out 318.out 024.out 218.out 118.out 575.out 372.out 172.out 168.out 293.out 060.out 469.out 054.out 059.out 361.out 049.out 657.out 180.out 270.out 421.out 112.out 299.out 321.out 057.out 512.out 412.out 312.out 121.out 538.out 256.out 012.out 195.out 028.out 070.out 433.out 565.out 248.out 620.out 525.out 242.out 576.out 498.out 320.out 629.out 602.out 502.out 402.out 302.out 202.out 529.out 002.out 617.out 417.out 365.out 492.out 117.out 475.out 072.out 068.out 154.out 038.out 473.out 056.out 611.out 511.out 411.out 029.out 211.out 369.out 170.out 053.out 133.out 286.out 173.out 175.out 559.out 610.out 510.out 410.out 701.out 601.out 301.out 201.out 010.out 001.out 214.out 589.out 074.out 164.out 697.out 641.out 091.out 081.out 634.out 075.out 653.out 700.out 600.out 500.out 400.out 300.out 200.out 100.out 464.out 354.out 541.out 086.out 269.out 546.out 677.out 698.out 553.out 196.out 444.out 080.out 708.out 609.out 507.out 407.out 307.out 208.out 107.out 009.out 643.out 150.out 557.out 453.out 666.out 159.out 566.out 582.out 383.out 574.out 085.out 015.out 704.out 588.out 212.out 504.out 404.out 189.out 204.out 535.out 425.out 467.out 254.out 531.out 073.out 235.out 703.out 253.out 165.out 264.out 678.out 141.out 265.out 169.out 114.out /var/lib/xfstests/tests/generic 2023-03-08T15:53:09.482 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:53:09.485 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:53:09.487 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:53:16.698 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AsxONLoNsgxfstests-dev/tests/nfs/ install 2023-03-08T15:53:16.701 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-03-08T15:53:16.736 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-03-08T15:53:16.771 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-03-08T15:53:16.806 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-03-08T15:53:16.842 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AsxONLoNsgxfstests-dev/tests/ocfs2/ install 2023-03-08T15:53:16.845 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-03-08T15:53:16.879 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-03-08T15:53:16.914 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-03-08T15:53:16.949 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-03-08T15:53:16.985 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AsxONLoNsgxfstests-dev/tests/overlay/ install 2023-03-08T15:53:16.988 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-03-08T15:53:17.023 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-03-08T15:53:18.075 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-03-08T15:53:18.110 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 051.out 101.out 034.out 048.out 037.out 020.out 102.out 002.out 060.out 113.out 013.out 031.out 015.out 117.out 077.out 072.out 078.out 063.out 058.out 062.out 038.out 036.out 042.out 052.out 067.out 029.out 010.out 111.out 027.out 112.out 073.out 068.out 030.out 103.out 003.out 017.out 055.out 053.out 116.out 043.out 059.out 014.out 018.out 110.out 057.out 076.out 022.out 106.out 006.out 115.out 045.out 001.out 064.out 114.out 074.out 024.out 071.out 061.out 035.out 011.out 041.out 047.out 100.out 019.out 105.out 104.out 028.out 069.out 023.out 049.out 032.out 039.out 005.out 008.out 065.out 026.out 056.out 070.out 108.out 050.out 040.out 107.out 009.out 075.out 004.out 021.out 046.out 016.out 025.out 066.out 012.out 109.out 007.out 033.out 054.out 044.out /var/lib/xfstests/tests/overlay 2023-03-08T15:53:19.168 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AsxONLoNsgxfstests-dev/tests/perf/ install 2023-03-08T15:53:19.172 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-03-08T15:53:19.206 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-03-08T15:53:19.241 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-03-08T15:53:19.276 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-03-08T15:53:19.312 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AsxONLoNsgxfstests-dev/tests/selftest/ install 2023-03-08T15:53:19.315 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-03-08T15:53:19.350 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-03-08T15:53:19.438 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-03-08T15:53:19.472 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 006.out 005.out 003.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-03-08T15:53:19.561 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AsxONLoNsgxfstests-dev/tests/shared/ install 2023-03-08T15:53:19.564 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-03-08T15:53:19.599 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-03-08T15:53:19.656 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-03-08T15:53:19.690 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-03-08T15:53:19.747 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AsxONLoNsgxfstests-dev/tests/udf/ install 2023-03-08T15:53:19.750 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-03-08T15:53:19.785 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-03-08T15:53:19.820 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-03-08T15:53:19.855 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-03-08T15:53:19.890 INFO:teuthology.orchestra.run.smithi182.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AsxONLoNsgxfstests-dev/tests/xfs/ install 2023-03-08T15:53:19.897 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-03-08T15:53:19.931 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 /var/lib/xfstests/tests/xfs 2023-03-08T15:53:27.191 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-03-08T15:53:27.226 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 033.out.crc 096.out.external 096.out.internal 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 204.out 104.out 349.out 067.out 537.out 497.out 337.out 385.out 362.out 460.out 088.out 097.out 296.out 137.out 102.out 343.out 389.out 593.out 564.out 592.out 148.out 284.out 282.out 267.out 072.out 472.out 468.out 528.out 769.out 428.out 328.out 207.out 228.out 128.out 171.out 183.out 157.out 247.out 273.out 520.out 555.out 709.out 109.out 595.out 506.out 313.out 195.out 732.out 397.out 532.out 191.out 281.out 064.out 719.out 723.out 519.out 011.out 131.out 319.out 467.out 332.out 119.out 775.out 323.out 103.out 254.out 243.out 234.out 134.out 190.out 260.out 095.out 034.out 445.out 161.out 516.out 518.out 538.out 116.out 043.out 358.out 338.out 287.out 238.out 533.out 295.out 138.out 189.out 263.out 765.out 187.out 153.out 291.out 274.out 061.out 239.out 047.out 772.out 530.out 258.out 379.out 322.out 039.out 173.out 526.out 498.out 396.out 098.out 426.out 290.out 220.out 060.out 406.out 306.out 206.out 106.out 006.out 447.out 217.out 120.out 117.out 357.out 783.out 485.out 589.out 442.out 188.out 030.out 177.out 174.out 771.out 324.out 224.out 050.out 355.out 124.out 142.out 278.out 058.out 741.out 384.out 262.out 042.out 377.out 193.out 271.out 456.out 399.out 770.out 437.out 509.out 364.out 441.out 255.out 740.out 356.out 766.out 341.out 094.out 712.out 241.out 089.out 540.out 256.out 514.out 414.out 314.out 440.out 074.out 376.out 041.out 155.out 340.out 156.out 572.out 586.out 492.out 240.out 549.out 280.out 390.out 140.out 708.out 249.out 568.out 185.out 508.out 408.out 308.out 208.out 737.out 040.out 557.out 453.out 246.out 725.out 582.out 735.out 383.out 085.out 066.out 588.out 212.out 504.out 404.out 776.out 535.out 733.out 487.out 556.out 716.out 335.out 235.out 575.out 253.out 165.out 264.out 784.out 373.out 265.out 169.out 579.out 018.out 393.out 476.out 087.out 471.out 739.out 068.out 233.out 752.out 736.out 236.out 773.out 186.out 539.out 276.out 711.out 439.out 587.out 339.out 078.out 294.out 521.out 352.out 458.out 139.out 481.out 082.out 317.out 552.out 781.out 017.out 768.out 444.out 452.out 020.out 252.out 585.out 751.out 563.out 167.out 164.out 742.out 199.out 184.out 409.out 466.out 309.out 495.out 785.out 424.out 222.out 283.out 750.out 297.out 325.out 767.out 225.out 744.out 125.out 715.out 279.out 581.out 152.out 774.out 122.out 451.out 551.out 015.out 392.out 075.out 748.out 578.out 550.out 052.out 062.out 577.out 571.out 583.out 450.out 463.out 160.out 542.out 176.out 069.out 489.out 762.out 350.out 544.out 728.out 395.out 515.out 415.out 315.out 344.out 215.out 115.out 351.out 250.out 391.out 363.out 244.out 475.out 536.out 436.out 480.out 336.out 086.out 144.out 505.out 405.out 136.out 496.out 198.out 008.out 251.out 178.out 305.out 205.out 105.out 005.out 523.out 761.out 025.out 517.out 423.out 562.out 382.out 570.out 388.out 527.out 158.out 056.out 019.out 003.out 079.out 237.out 151.out 760.out 591.out 163.out 127.out 232.out 584.out 462.out 132.out 037.out 293.out 483.out 499.out 112.out 044.out 063.out 101.out 561.out 465.out 758.out 387.out 194.out 438.out 076.out 289.out 554.out 333.out 477.out 548.out 560.out 419.out 474.out 461.out 457.out 107.out 007.out 448.out 380.out 093.out 479.out 547.out 192.out 221.out 326.out 226.out 747.out 126.out 026.out 580.out 021.out 488.out 347.out 035.out 038.out 361.out 788.out 455.out 574.out 558.out 162.out 083.out 147.out 288.out 197.out 446.out 051.out 145.out 143.out 786.out 360.out 543.out 261.out 734.out 755.out 292.out 304.out 482.out 372.out 046.out 272.out 729.out 378.out 484.out 534.out 073.out 434.out 503.out 403.out 329.out 334.out 368.out 722.out 486.out 223.out 123.out 179.out 023.out 459.out 032.out 277.out 146.out 398.out 416.out 366.out 316.out 427.out 590.out 470.out 491.out 749.out 016.out 227.out 731.out 782.out 374.out 154.out 285.out 359.out 531.out 301.out 431.out 266.out 331.out 743.out 065.out 231.out 081.out 513.out 413.out 425.out 371.out 213.out 730.out 113.out 013.out 031.out 367.out 726.out 182.out 727.out 268.out 754.out 573.out 430.out 454.out 259.out 210.out 449.out 327.out 330.out 777.out 493.out 010.out 230.out 027.out 764.out 130.out 219.out 370.out 135.out 303.out 203.out 345.out 004.out 386.out 055.out 275.out 245.out 724.out 522.out 787.out 745.out 422.out 394.out 159.out 432.out 524.out 381.out 166.out 022.out 346.out 045.out 435.out 090.out 353.out 375.out 181.out 566.out 718.out 149.out 443.out 418.out 318.out 024.out 218.out 118.out 757.out 172.out 168.out 469.out 054.out 059.out 049.out 348.out 738.out 721.out 545.out 180.out 270.out 421.out 299.out 321.out 057.out 512.out 494.out 412.out 312.out 121.out 099.out 342.out 012.out 028.out 433.out 720.out 565.out 248.out 525.out 242.out 576.out 420.out 478.out 320.out 077.out 502.out 402.out 302.out 202.out 529.out 002.out 717.out 429.out 417.out 365.out 092.out 369.out 759.out 778.out 229.out 473.out 084.out 129.out 594.out 511.out 411.out 029.out 311.out 211.out 111.out 257.out 170.out 053.out 133.out 713.out 756.out 175.out 714.out 559.out 710.out 036.out 510.out 410.out 310.out 501.out 401.out 110.out 201.out 001.out 141.out 214.out 048.out 114.out 753.out 014.out 269.out 091.out 746.out 500.out 400.out 300.out 200.out 100.out 464.out 354.out 286.out 541.out 779.out 546.out 780.out 553.out 763.out 298.out 196.out 490.out 080.out 070.out 507.out 407.out 307.out 209.out 108.out 009.out 567.out 150.out /var/lib/xfstests/tests/xfs 2023-03-08T15:53:34.588 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-03-08T15:53:34.623 INFO:teuthology.orchestra.run.smithi182.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-03-08T15:53:34.658 INFO:teuthology.orchestra.run.smithi182.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-03-08T15:53:34.693 INFO:teuthology.orchestra.run.smithi182.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-03-08T15:53:34.733 DEBUG:teuthology.orchestra.run.smithi182:> (cd /tmp/tmp.P05QXIwErbxfsprogs-dev && exec sudo make) 2023-03-08T15:53:35.033 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize -c `libtoolize -n -i >/dev/null 2>/dev/null && echo -i` -f 2023-03-08T15:53:35.913 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2023-03-08T15:53:35.914 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file './config.guess' 2023-03-08T15:53:35.929 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file './config.sub' 2023-03-08T15:53:35.944 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file './install-sh' 2023-03-08T15:53:35.961 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file './ltmain.sh' 2023-03-08T15:53:36.055 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-03-08T15:53:36.056 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-03-08T15:53:36.075 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-03-08T15:53:36.095 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-03-08T15:53:36.115 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-03-08T15:53:36.135 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-03-08T15:53:36.160 INFO:teuthology.orchestra.run.smithi182.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-03-08T15:53:36.165 INFO:teuthology.orchestra.run.smithi182.stdout:cp include/install-sh . 2023-03-08T15:53:36.168 INFO:teuthology.orchestra.run.smithi182.stdout:aclocal -I m4 2023-03-08T15:53:37.503 INFO:teuthology.orchestra.run.smithi182.stdout:autoconf 2023-03-08T15:53:37.973 INFO:teuthology.orchestra.run.smithi182.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2023-03-08T15:53:38.185 INFO:teuthology.orchestra.run.smithi182.stdout:configure: loading site script /usr/share/config.site 2023-03-08T15:53:38.226 INFO:teuthology.orchestra.run.smithi182.stdout:checking for a BSD-compatible install... /bin/install -c 2023-03-08T15:53:38.372 INFO:teuthology.orchestra.run.smithi182.stdout:checking build system type... x86_64-pc-linux-gnu 2023-03-08T15:53:38.372 INFO:teuthology.orchestra.run.smithi182.stdout:checking host system type... x86_64-pc-linux-gnu 2023-03-08T15:53:38.378 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to print strings... printf 2023-03-08T15:53:38.378 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gcc... gcc 2023-03-08T15:53:38.513 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether the C compiler works... yes 2023-03-08T15:53:38.513 INFO:teuthology.orchestra.run.smithi182.stdout:checking for C compiler default output file name... a.out 2023-03-08T15:53:38.583 INFO:teuthology.orchestra.run.smithi182.stdout:checking for suffix of executables... 2023-03-08T15:53:38.662 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether we are cross compiling... no 2023-03-08T15:53:38.718 INFO:teuthology.orchestra.run.smithi182.stdout:checking for suffix of object files... o 2023-03-08T15:53:38.767 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether we are using the GNU C compiler... yes 2023-03-08T15:53:38.817 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether gcc accepts -g... yes 2023-03-08T15:53:38.882 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gcc option to accept ISO C89... none needed 2023-03-08T15:53:38.893 INFO:teuthology.orchestra.run.smithi182.stdout:checking for a sed that does not truncate output... /bin/sed 2023-03-08T15:53:38.901 INFO:teuthology.orchestra.run.smithi182.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-03-08T15:53:38.906 INFO:teuthology.orchestra.run.smithi182.stdout:checking for egrep... /bin/grep -E 2023-03-08T15:53:38.910 INFO:teuthology.orchestra.run.smithi182.stdout:checking for fgrep... /bin/grep -F 2023-03-08T15:53:38.923 INFO:teuthology.orchestra.run.smithi182.stdout:checking for ld used by gcc... /bin/ld 2023-03-08T15:53:38.929 INFO:teuthology.orchestra.run.smithi182.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-03-08T15:53:38.936 INFO:teuthology.orchestra.run.smithi182.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-03-08T15:53:38.997 INFO:teuthology.orchestra.run.smithi182.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-03-08T15:53:38.997 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether ln -s works... yes 2023-03-08T15:53:39.008 INFO:teuthology.orchestra.run.smithi182.stdout:checking the maximum length of command line arguments... 1572864 2023-03-08T15:53:39.018 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-03-08T15:53:39.018 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-03-08T15:53:39.018 INFO:teuthology.orchestra.run.smithi182.stdout:checking for /bin/ld option to reload object files... -r 2023-03-08T15:53:39.019 INFO:teuthology.orchestra.run.smithi182.stdout:checking for objdump... objdump 2023-03-08T15:53:39.019 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to recognize dependent libraries... pass_all 2023-03-08T15:53:39.019 INFO:teuthology.orchestra.run.smithi182.stdout:checking for dlltool... no 2023-03-08T15:53:39.020 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-03-08T15:53:39.020 INFO:teuthology.orchestra.run.smithi182.stdout:checking for ar... ar 2023-03-08T15:53:39.089 INFO:teuthology.orchestra.run.smithi182.stdout:checking for archiver @FILE support... @ 2023-03-08T15:53:39.089 INFO:teuthology.orchestra.run.smithi182.stdout:checking for strip... strip 2023-03-08T15:53:39.090 INFO:teuthology.orchestra.run.smithi182.stdout:checking for ranlib... ranlib 2023-03-08T15:53:39.090 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gawk... gawk 2023-03-08T15:53:39.249 INFO:teuthology.orchestra.run.smithi182.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-03-08T15:53:39.254 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sysroot... no 2023-03-08T15:53:39.265 INFO:teuthology.orchestra.run.smithi182.stdout:checking for a working dd... /bin/dd 2023-03-08T15:53:39.276 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-03-08T15:53:39.318 INFO:teuthology.orchestra.run.smithi182.stdout:checking for mt... no 2023-03-08T15:53:39.327 INFO:teuthology.orchestra.run.smithi182.stdout:checking if : is a manifest tool... no 2023-03-08T15:53:39.390 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to run the C preprocessor... gcc -E 2023-03-08T15:53:39.654 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:53:39.657 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:53:39.659 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:53:39.664 INFO:teuthology.orchestra.run.smithi182.stdout:checking for ANSI C header files... yes 2023-03-08T15:53:39.726 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/types.h... yes 2023-03-08T15:53:39.804 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/stat.h... yes 2023-03-08T15:53:39.881 INFO:teuthology.orchestra.run.smithi182.stdout:checking for stdlib.h... yes 2023-03-08T15:53:39.960 INFO:teuthology.orchestra.run.smithi182.stdout:checking for string.h... yes 2023-03-08T15:53:40.037 INFO:teuthology.orchestra.run.smithi182.stdout:checking for memory.h... yes 2023-03-08T15:53:40.114 INFO:teuthology.orchestra.run.smithi182.stdout:checking for strings.h... yes 2023-03-08T15:53:40.193 INFO:teuthology.orchestra.run.smithi182.stdout:checking for inttypes.h... yes 2023-03-08T15:53:40.270 INFO:teuthology.orchestra.run.smithi182.stdout:checking for stdint.h... yes 2023-03-08T15:53:40.351 INFO:teuthology.orchestra.run.smithi182.stdout:checking for unistd.h... yes 2023-03-08T15:53:40.423 INFO:teuthology.orchestra.run.smithi182.stdout:checking for dlfcn.h... yes 2023-03-08T15:53:40.436 INFO:teuthology.orchestra.run.smithi182.stdout:checking for objdir... .libs 2023-03-08T15:53:40.631 INFO:teuthology.orchestra.run.smithi182.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-03-08T15:53:40.632 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-03-08T15:53:40.690 INFO:teuthology.orchestra.run.smithi182.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-03-08T15:53:40.744 INFO:teuthology.orchestra.run.smithi182.stdout:checking if gcc static flag -static works... no 2023-03-08T15:53:40.826 INFO:teuthology.orchestra.run.smithi182.stdout:checking if gcc supports -c -o file.o... yes 2023-03-08T15:53:40.826 INFO:teuthology.orchestra.run.smithi182.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-03-08T15:53:40.852 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-03-08T15:53:40.922 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether -lc should be explicitly linked in... no 2023-03-08T15:53:41.056 INFO:teuthology.orchestra.run.smithi182.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-03-08T15:53:41.056 INFO:teuthology.orchestra.run.smithi182.stdout:checking how to hardcode library paths into programs... immediate 2023-03-08T15:53:41.062 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether stripping libraries is possible... yes 2023-03-08T15:53:41.064 INFO:teuthology.orchestra.run.smithi182.stdout:checking if libtool supports shared libraries... yes 2023-03-08T15:53:41.064 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether to build shared libraries... yes 2023-03-08T15:53:41.064 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether to build static libraries... yes 2023-03-08T15:53:41.064 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gcc... (cached) gcc 2023-03-08T15:53:41.121 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-03-08T15:53:41.122 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether gcc accepts -g... (cached) yes 2023-03-08T15:53:41.122 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-03-08T15:53:41.139 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gcc... (cached) gcc 2023-03-08T15:53:41.198 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-03-08T15:53:41.198 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether gcc accepts -g... (cached) yes 2023-03-08T15:53:41.198 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-03-08T15:53:41.211 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gcc... (cached) gcc 2023-03-08T15:53:41.271 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-03-08T15:53:41.271 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether gcc accepts -g... (cached) yes 2023-03-08T15:53:41.271 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-03-08T15:53:41.272 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gmake... /bin/gmake 2023-03-08T15:53:41.272 INFO:teuthology.orchestra.run.smithi182.stdout:checking for tar... /bin/tar 2023-03-08T15:53:41.272 INFO:teuthology.orchestra.run.smithi182.stdout:checking for gzip... /bin/gzip 2023-03-08T15:53:41.296 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether gcc -MM is supported... yes 2023-03-08T15:53:41.297 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sort... /bin/sort 2023-03-08T15:53:41.297 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether ln -s works... yes 2023-03-08T15:53:41.298 INFO:teuthology.orchestra.run.smithi182.stdout:checking for msgfmt... /bin/msgfmt 2023-03-08T15:53:41.298 INFO:teuthology.orchestra.run.smithi182.stdout:checking for msgmerge... /bin/msgmerge 2023-03-08T15:53:41.298 INFO:teuthology.orchestra.run.smithi182.stdout:checking for xgettext... /bin/xgettext 2023-03-08T15:53:41.298 INFO:teuthology.orchestra.run.smithi182.stdout:checking for rpm... /bin/rpm 2023-03-08T15:53:41.310 INFO:teuthology.orchestra.run.smithi182.stdout:checking for rpmbuild... no 2023-03-08T15:53:41.379 INFO:teuthology.orchestra.run.smithi182.stdout:checking ini.h usability... yes 2023-03-08T15:53:41.406 INFO:teuthology.orchestra.run.smithi182.stdout:checking ini.h presence... yes 2023-03-08T15:53:41.406 INFO:teuthology.orchestra.run.smithi182.stdout:checking for ini.h... yes 2023-03-08T15:53:41.490 INFO:teuthology.orchestra.run.smithi182.stdout:checking for ini_parse in -linih... yes 2023-03-08T15:53:41.563 INFO:teuthology.orchestra.run.smithi182.stdout:checking uuid.h usability... no 2023-03-08T15:53:41.601 INFO:teuthology.orchestra.run.smithi182.stdout:checking uuid.h presence... no 2023-03-08T15:53:41.601 INFO:teuthology.orchestra.run.smithi182.stdout:checking for uuid.h... no 2023-03-08T15:53:41.670 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/uuid.h usability... no 2023-03-08T15:53:41.707 INFO:teuthology.orchestra.run.smithi182.stdout:checking sys/uuid.h presence... no 2023-03-08T15:53:41.708 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sys/uuid.h... no 2023-03-08T15:53:41.779 INFO:teuthology.orchestra.run.smithi182.stdout:checking uuid/uuid.h usability... yes 2023-03-08T15:53:41.807 INFO:teuthology.orchestra.run.smithi182.stdout:checking uuid/uuid.h presence... yes 2023-03-08T15:53:41.807 INFO:teuthology.orchestra.run.smithi182.stdout:checking for uuid/uuid.h... yes 2023-03-08T15:53:41.917 INFO:teuthology.orchestra.run.smithi182.stdout:checking for uuid_compare... no 2023-03-08T15:53:41.998 INFO:teuthology.orchestra.run.smithi182.stdout:checking for uuid_compare in -luuid... yes 2023-03-08T15:53:42.066 INFO:teuthology.orchestra.run.smithi182.stdout:checking pthread.h usability... yes 2023-03-08T15:53:42.096 INFO:teuthology.orchestra.run.smithi182.stdout:checking pthread.h presence... yes 2023-03-08T15:53:42.097 INFO:teuthology.orchestra.run.smithi182.stdout:checking for pthread.h... yes 2023-03-08T15:53:42.183 INFO:teuthology.orchestra.run.smithi182.stdout:checking for pthread_mutex_init in -lpthread... yes 2023-03-08T15:53:42.257 INFO:teuthology.orchestra.run.smithi182.stdout:checking urcu.h usability... yes 2023-03-08T15:53:42.294 INFO:teuthology.orchestra.run.smithi182.stdout:checking urcu.h presence... yes 2023-03-08T15:53:42.294 INFO:teuthology.orchestra.run.smithi182.stdout:checking for urcu.h... yes 2023-03-08T15:53:42.365 INFO:teuthology.orchestra.run.smithi182.stdout:checking for liburcu... yes 2023-03-08T15:53:42.422 INFO:teuthology.orchestra.run.smithi182.stdout:checking for fadvise ... yes 2023-03-08T15:53:42.477 INFO:teuthology.orchestra.run.smithi182.stdout:checking for madvise ... yes 2023-03-08T15:53:42.533 INFO:teuthology.orchestra.run.smithi182.stdout:checking for mincore ... yes 2023-03-08T15:53:42.596 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sendfile ... yes 2023-03-08T15:53:42.654 INFO:teuthology.orchestra.run.smithi182.stdout:checking for getmntent ... yes 2023-03-08T15:53:42.739 INFO:teuthology.orchestra.run.smithi182.stdout:checking for fallocate... yes 2023-03-08T15:53:42.834 INFO:teuthology.orchestra.run.smithi182.stdout:checking for fiemap... yes 2023-03-08T15:53:42.931 INFO:teuthology.orchestra.run.smithi182.stdout:checking for pwritev2... yes 2023-03-08T15:53:43.018 INFO:teuthology.orchestra.run.smithi182.stdout:checking for preadv... yes 2023-03-08T15:53:43.106 INFO:teuthology.orchestra.run.smithi182.stdout:checking for copy_file_range... yes 2023-03-08T15:53:43.192 INFO:teuthology.orchestra.run.smithi182.stdout:checking for sync_file_range... yes 2023-03-08T15:53:43.278 INFO:teuthology.orchestra.run.smithi182.stdout:checking for syncfs... yes 2023-03-08T15:53:43.342 INFO:teuthology.orchestra.run.smithi182.stdout:checking mntent.h usability... yes 2023-03-08T15:53:43.368 INFO:teuthology.orchestra.run.smithi182.stdout:checking mntent.h presence... yes 2023-03-08T15:53:43.368 INFO:teuthology.orchestra.run.smithi182.stdout:checking for mntent.h... yes 2023-03-08T15:53:43.433 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether fls is declared... no 2023-03-08T15:53:43.516 INFO:teuthology.orchestra.run.smithi182.stdout:checking for readdir... yes 2023-03-08T15:53:43.590 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether fsetxattr is declared... yes 2023-03-08T15:53:43.659 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether mremap is declared... yes 2023-03-08T15:53:43.762 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct fsxattr... yes 2023-03-08T15:53:43.818 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2023-03-08T15:53:43.866 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct fscrypt_add_key_arg... no 2023-03-08T15:53:43.958 INFO:teuthology.orchestra.run.smithi182.stdout:checking for GETFSMAP... yes 2023-03-08T15:53:44.063 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct statfs... yes 2023-03-08T15:53:44.118 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct statfs.f_flags... yes 2023-03-08T15:53:44.171 INFO:teuthology.orchestra.run.smithi182.stdout:checking for MAP_SYNC... yes 2023-03-08T15:53:44.363 INFO:teuthology.orchestra.run.smithi182.stdout:checking for library containing dm_task_create... -ldevmapper 2023-03-08T15:53:44.418 INFO:teuthology.orchestra.run.smithi182.stdout:checking for mallinfo ... yes 2023-03-08T15:53:44.469 INFO:teuthology.orchestra.run.smithi182.stdout:checking for mallinfo2 ... no 2023-03-08T15:53:44.534 INFO:teuthology.orchestra.run.smithi182.stdout:checking attr/attributes.h usability... yes 2023-03-08T15:53:44.559 INFO:teuthology.orchestra.run.smithi182.stdout:checking attr/attributes.h presence... yes 2023-03-08T15:53:44.559 INFO:teuthology.orchestra.run.smithi182.stdout:checking for attr/attributes.h... yes 2023-03-08T15:53:44.618 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct attrlist_cursor... yes 2023-03-08T15:53:44.622 INFO:teuthology.orchestra.run.smithi182.stdout:checking for pkg-config... /bin/pkg-config 2023-03-08T15:53:44.638 INFO:teuthology.orchestra.run.smithi182.stdout:checking pkg-config is at least version 0.9.0... yes 2023-03-08T15:53:44.657 INFO:teuthology.orchestra.run.smithi182.stdout:checking for libicu... yes 2023-03-08T15:53:44.730 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether openat is declared... yes 2023-03-08T15:53:44.808 INFO:teuthology.orchestra.run.smithi182.stdout:checking whether fstatat is declared... yes 2023-03-08T15:53:44.886 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct sg_io_hdr ... yes 2023-03-08T15:53:44.954 INFO:teuthology.orchestra.run.smithi182.stdout:checking for struct hd_geometry ... yes 2023-03-08T15:53:44.976 INFO:teuthology.orchestra.run.smithi182.stdout:checking for systemd... yes 2023-03-08T15:53:44.980 INFO:teuthology.orchestra.run.smithi182.stdout:checking for systemd system unit dir... /usr/lib/systemd/system 2023-03-08T15:53:44.981 INFO:teuthology.orchestra.run.smithi182.stdout:checking for system crontab dir... /etc/cron.d 2023-03-08T15:53:45.172 INFO:teuthology.orchestra.run.smithi182.stdout:checking for library containing blkid_probe_all... -lblkid 2023-03-08T15:53:45.266 INFO:teuthology.orchestra.run.smithi182.stdout:checking for blkid_probe_get_topology... yes 2023-03-08T15:53:45.389 INFO:teuthology.orchestra.run.smithi182.stdout:checking size of long... 8 2023-03-08T15:53:45.511 INFO:teuthology.orchestra.run.smithi182.stdout:checking size of char *... 8 2023-03-08T15:53:45.558 INFO:teuthology.orchestra.run.smithi182.stdout:checking for umode_t... no 2023-03-08T15:53:45.668 INFO:teuthology.orchestra.run.smithi182.stdout:checking for atomic64_t support in liburcu... yes 2023-03-08T15:53:45.714 INFO:teuthology.orchestra.run.smithi182.stdout:configure: creating ./config.status 2023-03-08T15:53:47.151 INFO:teuthology.orchestra.run.smithi182.stdout:config.status: creating include/builddefs 2023-03-08T15:53:47.193 INFO:teuthology.orchestra.run.smithi182.stdout:config.status: creating include/platform_defs.h 2023-03-08T15:53:47.227 INFO:teuthology.orchestra.run.smithi182.stdout:config.status: executing libtool commands 2023-03-08T15:53:47.726 INFO:teuthology.orchestra.run.smithi182.stdout: [HEADERS] include 2023-03-08T15:53:47.748 INFO:teuthology.orchestra.run.smithi182.stdout: [HEADERS] libxfs 2023-03-08T15:53:47.973 INFO:teuthology.orchestra.run.smithi182.stdout:Building include 2023-03-08T15:53:47.987 INFO:teuthology.orchestra.run.smithi182.stdout: [LN] disk 2023-03-08T15:53:47.993 INFO:teuthology.orchestra.run.smithi182.stdout:Building libfrog 2023-03-08T15:53:48.002 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] gen_crc32table 2023-03-08T15:53:48.095 INFO:teuthology.orchestra.run.smithi182.stdout: [GENERATE] crc32table.h 2023-03-08T15:53:48.718 INFO:teuthology.orchestra.run.smithi182.stdout: [TEST] CRC32 2023-03-08T15:53:48.874 INFO:teuthology.orchestra.run.smithi182.stdout:CRC_LE_BITS = 64 2023-03-08T15:53:48.874 INFO:teuthology.orchestra.run.smithi182.stdout:crc32c: tests passed, 225944 bytes in 60 usec 2023-03-08T15:53:48.879 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] avl64.lo 2023-03-08T15:53:49.621 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] bitmap.lo 2023-03-08T15:53:50.228 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] bulkstat.lo 2023-03-08T15:53:50.890 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] convert.lo 2023-03-08T15:53:51.514 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] crc32.lo 2023-03-08T15:53:52.012 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fsgeom.lo 2023-03-08T15:53:52.610 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] list_sort.lo 2023-03-08T15:53:53.090 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] linux.lo 2023-03-08T15:53:53.695 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] logging.lo 2023-03-08T15:53:54.120 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] paths.lo 2023-03-08T15:53:54.826 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] projects.lo 2023-03-08T15:53:55.406 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] ptvar.lo 2023-03-08T15:53:55.936 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] radix-tree.lo 2023-03-08T15:53:56.730 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] scrub.lo 2023-03-08T15:53:57.214 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] util.lo 2023-03-08T15:53:57.711 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] workqueue.lo 2023-03-08T15:53:58.263 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] libfrog.la 2023-03-08T15:53:58.459 INFO:teuthology.orchestra.run.smithi182.stdout:Building libxfs 2023-03-08T15:54:00.757 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] cache.lo 2023-03-08T15:54:01.570 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] defer_item.lo 2023-03-08T15:54:02.275 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] init.lo 2023-03-08T15:54:03.246 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] kmem.lo 2023-03-08T15:54:03.819 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] logitem.lo 2023-03-08T15:54:04.404 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] rdwr.lo 2023-03-08T15:54:05.504 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] topology.lo 2023-03-08T15:54:06.166 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] trans.lo 2023-03-08T15:54:06.938 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] util.lo 2023-03-08T15:54:07.724 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_ag.lo 2023-03-08T15:54:08.730 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_ag_resv.lo 2023-03-08T15:54:09.375 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_alloc.lo 2023-03-08T15:54:09.810 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:54:09.813 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:54:09.815 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:54:11.025 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_alloc_btree.lo 2023-03-08T15:54:11.786 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_attr.lo 2023-03-08T15:54:12.680 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_attr_leaf.lo 2023-03-08T15:54:14.342 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_attr_remote.lo 2023-03-08T15:54:15.154 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_bit.lo 2023-03-08T15:54:15.726 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_bmap.lo 2023-03-08T15:54:18.719 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_bmap_btree.lo 2023-03-08T15:54:19.526 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_btree.lo 2023-03-08T15:54:21.891 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_btree_staging.lo 2023-03-08T15:54:22.631 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_da_btree.lo 2023-03-08T15:54:24.146 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_defer.lo 2023-03-08T15:54:24.941 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_dir2.lo 2023-03-08T15:54:25.724 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_dir2_block.lo 2023-03-08T15:54:26.859 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_dir2_data.lo 2023-03-08T15:54:27.939 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_dir2_leaf.lo 2023-03-08T15:54:29.140 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_dir2_node.lo 2023-03-08T15:54:30.464 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_dir2_sf.lo 2023-03-08T15:54:31.520 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_dquot_buf.lo 2023-03-08T15:54:32.193 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_ialloc.lo 2023-03-08T15:54:33.715 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_iext_tree.lo 2023-03-08T15:54:34.737 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_inode_buf.lo 2023-03-08T15:54:35.677 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_inode_fork.lo 2023-03-08T15:54:36.585 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_ialloc_btree.lo 2023-03-08T15:54:37.389 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_log_rlimit.lo 2023-03-08T15:54:37.987 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_refcount.lo 2023-03-08T15:54:39.059 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_refcount_btree.lo 2023-03-08T15:54:39.796 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_rmap.lo 2023-03-08T15:54:39.946 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:54:39.949 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:54:39.952 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:54:41.189 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_rmap_btree.lo 2023-03-08T15:54:41.987 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_rtbitmap.lo 2023-03-08T15:54:42.877 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_sb.lo 2023-03-08T15:54:43.950 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_symlink_remote.lo 2023-03-08T15:54:44.598 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_trans_inode.lo 2023-03-08T15:54:45.198 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_trans_resv.lo 2023-03-08T15:54:46.063 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_types.lo 2023-03-08T15:54:46.699 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] libxfs.la 2023-03-08T15:54:47.059 INFO:teuthology.orchestra.run.smithi182.stdout:Building libxlog 2023-03-08T15:54:47.192 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_log_recover.lo 2023-03-08T15:54:48.272 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] util.lo 2023-03-08T15:54:48.921 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] libxlog.la 2023-03-08T15:54:49.097 INFO:teuthology.orchestra.run.smithi182.stdout:Building libxcmd 2023-03-08T15:54:49.289 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] command.lo 2023-03-08T15:54:49.903 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] input.lo 2023-03-08T15:54:50.486 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] help.lo 2023-03-08T15:54:51.003 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] quit.lo 2023-03-08T15:54:51.499 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] libxcmd.la 2023-03-08T15:54:51.673 INFO:teuthology.orchestra.run.smithi182.stdout:Building libhandle 2023-03-08T15:54:51.790 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] handle.lo 2023-03-08T15:54:52.418 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] jdm.lo 2023-03-08T15:54:52.975 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] libhandle.la 2023-03-08T15:54:53.208 INFO:teuthology.orchestra.run.smithi182.stdout:Building copy 2023-03-08T15:54:53.289 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_copy.o 2023-03-08T15:54:53.760 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] xfs_copy 2023-03-08T15:54:54.065 INFO:teuthology.orchestra.run.smithi182.stdout:Building db 2023-03-08T15:54:56.819 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] addr.o 2023-03-08T15:54:56.968 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] agf.o 2023-03-08T15:54:57.112 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] agfl.o 2023-03-08T15:54:57.255 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] agi.o 2023-03-08T15:54:57.400 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] attr.o 2023-03-08T15:54:57.648 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] attrshort.o 2023-03-08T15:54:57.812 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] bit.o 2023-03-08T15:54:57.978 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] block.o 2023-03-08T15:54:58.163 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] bmap.o 2023-03-08T15:54:58.406 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] btblock.o 2023-03-08T15:54:58.581 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] bmroot.o 2023-03-08T15:54:58.788 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] check.o 2023-03-08T15:55:00.575 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] command.o 2023-03-08T15:55:00.729 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] crc.o 2023-03-08T15:55:00.891 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] debug.o 2023-03-08T15:55:01.027 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] dir2.o 2023-03-08T15:55:01.367 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] dir2sf.o 2023-03-08T15:55:01.550 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] dquot.o 2023-03-08T15:55:01.709 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] echo.o 2023-03-08T15:55:01.843 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] faddr.o 2023-03-08T15:55:02.063 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] field.o 2023-03-08T15:55:02.220 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] flist.o 2023-03-08T15:55:02.448 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fprint.o 2023-03-08T15:55:02.647 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] frag.o 2023-03-08T15:55:02.926 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] freesp.o 2023-03-08T15:55:03.163 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] hash.o 2023-03-08T15:55:03.300 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] help.o 2023-03-08T15:55:03.443 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] init.o 2023-03-08T15:55:03.616 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] inode.o 2023-03-08T15:55:03.936 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] input.o 2023-03-08T15:55:04.118 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] io.o 2023-03-08T15:55:04.364 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] logformat.o 2023-03-08T15:55:04.527 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] malloc.o 2023-03-08T15:55:04.668 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] metadump.o 2023-03-08T15:55:05.522 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] output.o 2023-03-08T15:55:05.672 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] print.o 2023-03-08T15:55:05.867 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] quit.o 2023-03-08T15:55:05.998 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] sb.o 2023-03-08T15:55:06.308 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] sig.o 2023-03-08T15:55:06.445 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] strvec.o 2023-03-08T15:55:06.594 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] text.o 2023-03-08T15:55:06.741 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] type.o 2023-03-08T15:55:06.905 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] write.o 2023-03-08T15:55:07.177 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] attrset.o 2023-03-08T15:55:07.346 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] symlink.o 2023-03-08T15:55:07.487 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fsmap.o 2023-03-08T15:55:07.651 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fuzz.o 2023-03-08T15:55:07.855 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] btdump.o 2023-03-08T15:55:08.073 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] btheight.o 2023-03-08T15:55:08.276 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] convert.o 2023-03-08T15:55:08.459 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] info.o 2023-03-08T15:55:08.617 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] namei.o 2023-03-08T15:55:08.711 INFO:teuthology.orchestra.run.smithi182.stderr:namei.c: In function ‘path_navigate’: 2023-03-08T15:55:08.712 INFO:teuthology.orchestra.run.smithi182.stderr:namei.c:101:12: warning: pointer targets in initialization of ‘const unsigned char *’ from ‘char *’ differ in signedness [-Wpointer-sign] 2023-03-08T15:55:08.712 INFO:teuthology.orchestra.run.smithi182.stderr: .name = dirpath->path[i], 2023-03-08T15:55:08.712 INFO:teuthology.orchestra.run.smithi182.stderr: ^~~~~~~ 2023-03-08T15:55:08.712 INFO:teuthology.orchestra.run.smithi182.stderr:namei.c:101:12: note: (near initialization for ‘xname.name’) 2023-03-08T15:55:08.713 INFO:teuthology.orchestra.run.smithi182.stderr:namei.c: In function ‘dir_emit’: 2023-03-08T15:55:08.713 INFO:teuthology.orchestra.run.smithi182.stderr:namei.c:253:37: warning: pointer targets in initialization of ‘const unsigned char *’ from ‘char *’ differ in signedness [-Wpointer-sign] 2023-03-08T15:55:08.713 INFO:teuthology.orchestra.run.smithi182.stderr: struct xfs_name xname = { .name = name }; 2023-03-08T15:55:08.713 INFO:teuthology.orchestra.run.smithi182.stderr: ^~~~ 2023-03-08T15:55:08.713 INFO:teuthology.orchestra.run.smithi182.stderr:namei.c:253:37: note: (near initialization for ‘xname.name’) 2023-03-08T15:55:08.823 INFO:teuthology.orchestra.run.smithi182.stderr:namei.c: At top level: 2023-03-08T15:55:08.823 INFO:teuthology.orchestra.run.smithi182.stderr:cc1: warning: unrecognized command line option ‘-Wno-address-of-packed-member’ 2023-03-08T15:55:08.864 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] timelimit.o 2023-03-08T15:55:09.016 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] xfs_db 2023-03-08T15:55:09.412 INFO:teuthology.orchestra.run.smithi182.stdout:Building estimate 2023-03-08T15:55:09.493 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_estimate.o 2023-03-08T15:55:09.669 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] xfs_estimate 2023-03-08T15:55:09.808 INFO:teuthology.orchestra.run.smithi182.stdout:Building fsck 2023-03-08T15:55:09.818 INFO:teuthology.orchestra.run.smithi182.stdout:Building fsr 2023-03-08T15:55:09.900 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_fsr.o 2023-03-08T15:55:10.078 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:55:10.081 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:55:10.083 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:55:10.360 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] xfs_fsr 2023-03-08T15:55:10.568 INFO:teuthology.orchestra.run.smithi182.stdout:Building growfs 2023-03-08T15:55:10.648 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_growfs.o 2023-03-08T15:55:10.866 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] xfs_growfs 2023-03-08T15:55:11.157 INFO:teuthology.orchestra.run.smithi182.stdout:Building io 2023-03-08T15:55:13.052 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] init.o 2023-03-08T15:55:13.192 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] attr.o 2023-03-08T15:55:13.363 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] bmap.o 2023-03-08T15:55:13.567 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] bulkstat.o 2023-03-08T15:55:13.749 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] crc32cselftest.o 2023-03-08T15:55:13.866 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] cowextsize.o 2023-03-08T15:55:14.002 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] encrypt.o 2023-03-08T15:55:14.232 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] file.o 2023-03-08T15:55:14.358 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] freeze.o 2023-03-08T15:55:14.471 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fsync.o 2023-03-08T15:55:14.577 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] getrusage.o 2023-03-08T15:55:14.696 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] imap.o 2023-03-08T15:55:14.811 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] inject.o 2023-03-08T15:55:14.936 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] label.o 2023-03-08T15:55:15.081 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] link.o 2023-03-08T15:55:15.189 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] mmap.o 2023-03-08T15:55:15.418 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] open.o 2023-03-08T15:55:15.714 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] parent.o 2023-03-08T15:55:15.897 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] pread.o 2023-03-08T15:55:16.095 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] prealloc.o 2023-03-08T15:55:16.261 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] pwrite.o 2023-03-08T15:55:16.441 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] reflink.o 2023-03-08T15:55:16.595 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] resblks.o 2023-03-08T15:55:16.705 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] scrub.o 2023-03-08T15:55:16.856 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] seek.o 2023-03-08T15:55:16.988 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] shutdown.o 2023-03-08T15:55:17.098 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] stat.o 2023-03-08T15:55:17.323 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] swapext.o 2023-03-08T15:55:17.436 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] sync.o 2023-03-08T15:55:17.542 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] truncate.o 2023-03-08T15:55:17.650 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] utimes.o 2023-03-08T15:55:17.759 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fadvise.o 2023-03-08T15:55:17.877 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] madvise.o 2023-03-08T15:55:17.995 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] mincore.o 2023-03-08T15:55:18.117 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] sendfile.o 2023-03-08T15:55:18.248 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fiemap.o 2023-03-08T15:55:18.425 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] copy_file_range.o 2023-03-08T15:55:18.556 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] sync_file_range.o 2023-03-08T15:55:18.672 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] readdir.o 2023-03-08T15:55:18.799 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] log_writes.o 2023-03-08T15:55:18.918 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fsmap.o 2023-03-08T15:55:19.173 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] xfs_io 2023-03-08T15:55:19.482 INFO:teuthology.orchestra.run.smithi182.stdout:Building logprint 2023-03-08T15:55:19.870 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] logprint.o 2023-03-08T15:55:20.041 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] log_copy.o 2023-03-08T15:55:20.183 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] log_dump.o 2023-03-08T15:55:20.339 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] log_misc.o 2023-03-08T15:55:20.853 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] log_print_all.o 2023-03-08T15:55:21.128 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] log_print_trans.o 2023-03-08T15:55:21.275 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] log_redo.o 2023-03-08T15:55:21.553 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] xfs_logprint 2023-03-08T15:55:21.854 INFO:teuthology.orchestra.run.smithi182.stdout:Building mkfs 2023-03-08T15:55:21.988 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] proto.o 2023-03-08T15:55:22.277 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_mkfs.o 2023-03-08T15:55:23.007 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] mkfs.xfs 2023-03-08T15:55:23.310 INFO:teuthology.orchestra.run.smithi182.stdout:Building quota 2023-03-08T15:55:23.844 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] init.o 2023-03-08T15:55:23.972 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] util.o 2023-03-08T15:55:24.151 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] edit.o 2023-03-08T15:55:24.373 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] free.o 2023-03-08T15:55:24.543 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] linux.o 2023-03-08T15:55:24.647 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] path.o 2023-03-08T15:55:24.781 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] project.o 2023-03-08T15:55:24.944 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] quot.o 2023-03-08T15:55:25.124 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] quota.o 2023-03-08T15:55:25.315 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] report.o 2023-03-08T15:55:25.563 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] state.o 2023-03-08T15:55:25.760 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] xfs_quota 2023-03-08T15:55:25.975 INFO:teuthology.orchestra.run.smithi182.stdout:Building mdrestore 2023-03-08T15:55:26.056 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_mdrestore.o 2023-03-08T15:55:26.248 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] xfs_mdrestore 2023-03-08T15:55:26.511 INFO:teuthology.orchestra.run.smithi182.stdout:Building repair 2023-03-08T15:55:28.351 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] agheader.o 2023-03-08T15:55:28.603 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] agbtree.o 2023-03-08T15:55:28.852 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] attr_repair.o 2023-03-08T15:55:29.240 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] avl.o 2023-03-08T15:55:29.487 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] bulkload.o 2023-03-08T15:55:29.639 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] bmap.o 2023-03-08T15:55:29.822 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] btree.o 2023-03-08T15:55:30.173 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] da_util.o 2023-03-08T15:55:30.424 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] dino_chunks.o 2023-03-08T15:55:30.840 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] dinode.o 2023-03-08T15:55:31.624 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] dir2.o 2023-03-08T15:55:32.062 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] globals.o 2023-03-08T15:55:32.189 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] incore_bmc.o 2023-03-08T15:55:32.326 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] incore.o 2023-03-08T15:55:32.505 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] incore_ext.o 2023-03-08T15:55:32.755 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] incore_ino.o 2023-03-08T15:55:33.048 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] init.o 2023-03-08T15:55:33.213 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] phase1.o 2023-03-08T15:55:33.367 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] phase2.o 2023-03-08T15:55:33.589 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] phase3.o 2023-03-08T15:55:33.758 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] phase4.o 2023-03-08T15:55:33.980 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] phase5.o 2023-03-08T15:55:34.266 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] phase6.o 2023-03-08T15:55:35.173 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] phase7.o 2023-03-08T15:55:35.340 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] prefetch.o 2023-03-08T15:55:35.713 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] progress.o 2023-03-08T15:55:35.938 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] quotacheck.o 2023-03-08T15:55:36.173 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] rmap.o 2023-03-08T15:55:36.580 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] rt.o 2023-03-08T15:55:36.772 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] sb.o 2023-03-08T15:55:37.024 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] scan.o 2023-03-08T15:55:37.821 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] slab.o 2023-03-08T15:55:38.014 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] threads.o 2023-03-08T15:55:38.157 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] versions.o 2023-03-08T15:55:38.317 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_repair.o 2023-03-08T15:55:38.651 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] xfs_repair 2023-03-08T15:55:39.054 INFO:teuthology.orchestra.run.smithi182.stdout:Building rtcp 2023-03-08T15:55:39.133 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_rtcp.o 2023-03-08T15:55:39.334 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] xfs_rtcp 2023-03-08T15:55:39.503 INFO:teuthology.orchestra.run.smithi182.stdout:Building m4 2023-03-08T15:55:39.513 INFO:teuthology.orchestra.run.smithi182.stdout:Building man 2023-03-08T15:55:39.527 INFO:teuthology.orchestra.run.smithi182.stdout:Building man2 2023-03-08T15:55:39.543 INFO:teuthology.orchestra.run.smithi182.stdout:Building man3 2023-03-08T15:55:39.557 INFO:teuthology.orchestra.run.smithi182.stdout:Building man5 2023-03-08T15:55:39.572 INFO:teuthology.orchestra.run.smithi182.stdout:Building man8 2023-03-08T15:55:39.597 INFO:teuthology.orchestra.run.smithi182.stdout: [SED] mkfs.xfs.8 2023-03-08T15:55:39.609 INFO:teuthology.orchestra.run.smithi182.stdout:Building doc 2023-03-08T15:55:39.623 INFO:teuthology.orchestra.run.smithi182.stdout: [ZIP] CHANGES.gz 2023-03-08T15:55:39.639 INFO:teuthology.orchestra.run.smithi182.stdout:Building debian 2023-03-08T15:55:39.650 INFO:teuthology.orchestra.run.smithi182.stdout:Building spaceman 2023-03-08T15:55:40.044 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] info.o 2023-03-08T15:55:40.184 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] init.o 2023-03-08T15:55:40.219 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:55:40.222 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:55:40.225 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:55:40.345 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] file.o 2023-03-08T15:55:40.503 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] health.o 2023-03-08T15:55:40.698 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] prealloc.o 2023-03-08T15:55:40.845 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] trim.o 2023-03-08T15:55:41.001 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] freesp.o 2023-03-08T15:55:41.214 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] xfs_spaceman 2023-03-08T15:55:41.425 INFO:teuthology.orchestra.run.smithi182.stdout:Building scrub 2023-03-08T15:55:42.443 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] common.o 2023-03-08T15:55:42.609 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] counter.o 2023-03-08T15:55:42.705 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] descr.o 2023-03-08T15:55:42.819 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] disk.o 2023-03-08T15:55:42.968 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] filemap.o 2023-03-08T15:55:43.088 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] fscounters.o 2023-03-08T15:55:43.214 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] inodes.o 2023-03-08T15:55:43.391 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] phase1.o 2023-03-08T15:55:43.531 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] phase2.o 2023-03-08T15:55:43.663 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] phase3.o 2023-03-08T15:55:43.809 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] phase4.o 2023-03-08T15:55:43.939 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] phase5.o 2023-03-08T15:55:44.108 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] phase6.o 2023-03-08T15:55:44.318 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] phase7.o 2023-03-08T15:55:44.466 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] progress.o 2023-03-08T15:55:44.601 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] read_verify.o 2023-03-08T15:55:44.753 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] repair.o 2023-03-08T15:55:44.905 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] scrub.o 2023-03-08T15:55:45.137 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] spacemap.o 2023-03-08T15:55:45.282 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] vfs.o 2023-03-08T15:55:45.432 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] xfs_scrub.o 2023-03-08T15:55:45.655 INFO:teuthology.orchestra.run.smithi182.stdout: [CC] unicrash.o 2023-03-08T15:55:45.866 INFO:teuthology.orchestra.run.smithi182.stdout: [LD] xfs_scrub 2023-03-08T15:55:46.261 INFO:teuthology.orchestra.run.smithi182.stdout: [SED] xfs_scrub_all 2023-03-08T15:55:46.274 INFO:teuthology.orchestra.run.smithi182.stdout: [SED] xfs_scrub@.service 2023-03-08T15:55:46.284 INFO:teuthology.orchestra.run.smithi182.stdout: [SED] xfs_scrub_all.service 2023-03-08T15:55:46.295 INFO:teuthology.orchestra.run.smithi182.stdout: [SED] xfs_scrub_fail@.service 2023-03-08T15:55:46.306 INFO:teuthology.orchestra.run.smithi182.stdout: [SED] xfs_scrub_all.cron 2023-03-08T15:55:46.317 INFO:teuthology.orchestra.run.smithi182.stdout:Building po 2023-03-08T15:55:46.351 INFO:teuthology.orchestra.run.smithi182.stdout: [GETTXT] xfsprogs.pot 2023-03-08T15:55:46.581 INFO:teuthology.orchestra.run.smithi182.stdout: [MSGFMT] pl.mo 2023-03-08T15:55:46.638 INFO:teuthology.orchestra.run.smithi182.stderr:3104 translated messages. 2023-03-08T15:55:46.643 INFO:teuthology.orchestra.run.smithi182.stdout: [MSGFMT] de.mo 2023-03-08T15:55:46.682 INFO:teuthology.orchestra.run.smithi182.stderr:2345 translated messages. 2023-03-08T15:55:46.685 INFO:teuthology.orchestra.run.smithi182.stdout:gmake[2]: Nothing to be done for 'include'. 2023-03-08T15:55:46.691 DEBUG:teuthology.orchestra.run.smithi182:> (cd /tmp/tmp.P05QXIwErbxfsprogs-dev && exec sudo make install) 2023-03-08T15:55:46.993 INFO:teuthology.orchestra.run.smithi182.stdout:Installing libfrog-install 2023-03-08T15:55:47.578 INFO:teuthology.orchestra.run.smithi182.stdout:Installing libxfs-install 2023-03-08T15:55:49.854 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-03-08T15:55:49.892 INFO:teuthology.orchestra.run.smithi182.stdout:Installing libxlog-install 2023-03-08T15:55:50.017 INFO:teuthology.orchestra.run.smithi182.stdout:Installing libxcmd-install 2023-03-08T15:55:50.203 INFO:teuthology.orchestra.run.smithi182.stdout:Installing libhandle-install 2023-03-08T15:55:50.309 INFO:teuthology.orchestra.run.smithi182.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib64; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib64; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib64 2023-03-08T15:55:50.508 INFO:teuthology.orchestra.run.smithi182.stdout:Installing copy-install 2023-03-08T15:55:50.578 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-03-08T15:55:50.612 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2023-03-08T15:55:50.705 INFO:teuthology.orchestra.run.smithi182.stdout:Installing db-install 2023-03-08T15:55:53.435 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-03-08T15:55:53.469 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2023-03-08T15:55:53.639 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2023-03-08T15:55:53.674 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2023-03-08T15:55:53.708 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2023-03-08T15:55:53.746 INFO:teuthology.orchestra.run.smithi182.stdout:Installing estimate-install 2023-03-08T15:55:53.816 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-03-08T15:55:53.850 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2023-03-08T15:55:53.930 INFO:teuthology.orchestra.run.smithi182.stdout:Installing fsck-install 2023-03-08T15:55:53.933 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-03-08T15:55:53.968 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2023-03-08T15:55:54.006 INFO:teuthology.orchestra.run.smithi182.stdout:Installing fsr-install 2023-03-08T15:55:54.078 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-03-08T15:55:54.112 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2023-03-08T15:55:54.193 INFO:teuthology.orchestra.run.smithi182.stdout:Installing growfs-install 2023-03-08T15:55:54.262 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-03-08T15:55:54.297 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2023-03-08T15:55:54.390 INFO:teuthology.orchestra.run.smithi182.stdout:Installing io-install 2023-03-08T15:55:56.269 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-03-08T15:55:56.303 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2023-03-08T15:55:56.383 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2023-03-08T15:55:56.459 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2023-03-08T15:55:56.535 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2023-03-08T15:55:56.615 INFO:teuthology.orchestra.run.smithi182.stdout:Installing logprint-install 2023-03-08T15:55:56.991 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-03-08T15:55:57.025 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2023-03-08T15:55:57.120 INFO:teuthology.orchestra.run.smithi182.stdout:Installing mkfs-install 2023-03-08T15:55:57.245 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-03-08T15:55:57.280 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2023-03-08T15:55:57.371 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2023-03-08T15:55:57.406 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf /usr/share/xfsprogs/mkfs 2023-03-08T15:55:57.498 INFO:teuthology.orchestra.run.smithi182.stdout:Installing quota-install 2023-03-08T15:55:58.008 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-03-08T15:55:58.042 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2023-03-08T15:55:58.123 INFO:teuthology.orchestra.run.smithi182.stdout:Installing mdrestore-install 2023-03-08T15:55:58.194 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-03-08T15:55:58.228 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2023-03-08T15:55:58.321 INFO:teuthology.orchestra.run.smithi182.stdout:Installing repair-install 2023-03-08T15:56:00.147 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-03-08T15:56:00.182 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2023-03-08T15:56:00.283 INFO:teuthology.orchestra.run.smithi182.stdout:Installing rtcp-install 2023-03-08T15:56:00.353 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-03-08T15:56:00.388 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2023-03-08T15:56:00.468 INFO:teuthology.orchestra.run.smithi182.stdout:Installing m4-install 2023-03-08T15:56:00.472 INFO:teuthology.orchestra.run.smithi182.stdout:gmake[1]: Nothing to be done for 'install'. 2023-03-08T15:56:00.475 INFO:teuthology.orchestra.run.smithi182.stdout:Installing man-install 2023-03-08T15:56:00.485 INFO:teuthology.orchestra.run.smithi182.stdout:gmake[2]: Nothing to be done for 'install'. 2023-03-08T15:56:00.492 INFO:teuthology.orchestra.run.smithi182.stdout:gmake[2]: Nothing to be done for 'install'. 2023-03-08T15:56:00.503 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2023-03-08T15:56:00.547 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2023-03-08T15:56:00.589 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2023-03-08T15:56:00.632 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2023-03-08T15:56:00.682 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2023-03-08T15:56:00.726 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2023-03-08T15:56:00.770 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-03-08T15:56:00.813 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2023-03-08T15:56:00.855 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2023-03-08T15:56:00.898 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2023-03-08T15:56:00.941 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2023-03-08T15:56:00.984 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2023-03-08T15:56:01.027 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2023-03-08T15:56:01.070 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2023-03-08T15:56:01.113 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2023-03-08T15:56:01.156 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2023-03-08T15:56:01.199 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2023-03-08T15:56:01.242 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2023-03-08T15:56:01.285 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2023-03-08T15:56:01.328 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2023-03-08T15:56:01.371 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2023-03-08T15:56:01.414 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2023-03-08T15:56:01.458 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2023-03-08T15:56:01.501 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2023-03-08T15:56:01.544 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2023-03-08T15:56:01.586 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2023-03-08T15:56:01.629 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2023-03-08T15:56:01.672 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2023-03-08T15:56:01.715 INFO:teuthology.orchestra.run.smithi182.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-03-08T15:56:01.756 INFO:teuthology.orchestra.run.smithi182.stdout:Installing doc-install 2023-03-08T15:56:01.759 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-03-08T15:56:01.794 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2023-03-08T15:56:01.850 INFO:teuthology.orchestra.run.smithi182.stdout:Installing debian-install 2023-03-08T15:56:01.854 INFO:teuthology.orchestra.run.smithi182.stdout:gmake[1]: Nothing to be done for 'install'. 2023-03-08T15:56:01.857 INFO:teuthology.orchestra.run.smithi182.stdout:Installing spaceman-install 2023-03-08T15:56:02.242 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-03-08T15:56:02.276 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2023-03-08T15:56:02.354 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2023-03-08T15:56:02.392 INFO:teuthology.orchestra.run.smithi182.stdout:Installing scrub-install 2023-03-08T15:56:03.401 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-03-08T15:56:03.436 INFO:teuthology.orchestra.run.smithi182.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2023-03-08T15:56:03.515 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2023-03-08T15:56:03.551 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/systemd/system 2023-03-08T15:56:03.586 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /usr/lib/systemd/system 2023-03-08T15:56:03.652 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-03-08T15:56:03.687 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib64/xfsprogs 2023-03-08T15:56:03.722 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-03-08T15:56:03.756 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib64/xfsprogs 2023-03-08T15:56:03.794 INFO:teuthology.orchestra.run.smithi182.stdout:Installing po-install 2023-03-08T15:56:03.960 INFO:teuthology.orchestra.run.smithi182.stdout:Installing include-install 2023-03-08T15:56:03.964 INFO:teuthology.orchestra.run.smithi182.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-03-08T15:56:03.999 INFO:teuthology.orchestra.run.smithi182.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-03-08T15:56:04.050 INFO:teuthology.orchestra.run.smithi182.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2023-03-08T15:56:04.074 INFO:tasks.cephfs.test_fscrypt:client is kernel mounted 2023-03-08T15:56:04.074 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-03-08T15:56:04.211 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.210+0000 7f6e4712e700 1 Processor -- start 2023-03-08T15:56:04.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.210+0000 7f6e4712e700 1 -- start start 2023-03-08T15:56:04.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e4712e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e400b4a70 0x7f6e40147b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:56:04.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e4712e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e40148070 0x7f6e40151e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:56:04.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e4712e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e400b4ec0 con 0x7f6e400baa70 2023-03-08T15:56:04.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e4712e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e400b6f60 con 0x7f6e40148070 2023-03-08T15:56:04.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e4712e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400b9ec0 con 0x7f6e400b4a70 2023-03-08T15:56:04.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e44eca700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6e400baa70 0x7f6e400b97b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33558/0 (socket says 172.21.15.123:33558) 2023-03-08T15:56:04.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e44eca700 1 -- 172.21.15.123:0/1777732795 learned_addr learned my addr 172.21.15.123:0/1777732795 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:56:04.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/1777732795 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598588938 0 0) 0x7f6e400b4ec0 con 0x7f6e400baa70 2023-03-08T15:56:04.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e456cb700 1 --2- 172.21.15.123:0/1777732795 >> v2:172.21.15.175:3300/0 conn(0x7f6e40148070 0x7f6e40151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:56:04.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3ffff700 1 --2- 172.21.15.123:0/1777732795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e400b4a70 0x7f6e40147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:56:04.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/1777732795 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e300057c0 con 0x7f6e400baa70 2023-03-08T15:56:04.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/1777732795 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 691511220 0 0) 0x7f6e300057c0 con 0x7f6e400baa70 2023-03-08T15:56:04.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/1777732795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e400b4a70 msgr2=0x7f6e40147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:56:04.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 --2- 172.21.15.123:0/1777732795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e400b4a70 0x7f6e40147b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/1777732795 >> v2:172.21.15.175:3300/0 conn(0x7f6e40148070 msgr2=0x7f6e40151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:56:04.216 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 --2- 172.21.15.123:0/1777732795 >> v2:172.21.15.175:3300/0 conn(0x7f6e40148070 0x7f6e40151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/1777732795 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e400b5650 con 0x7f6e400baa70 2023-03-08T15:56:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/1777732795 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 461700409 0 0) 0x7f6e34001670 con 0x7f6e400baa70 2023-03-08T15:56:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/1777732795 >> v1:172.21.15.123:6789/0 conn(0x7f6e400baa70 legacy=0x7f6e400b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:56:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 --2- 172.21.15.123:0/1777732795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e30005c10 0x7f6e30006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:56:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 --2- 172.21.15.123:0/1777732795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e30006640 0x7f6e30006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:56:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 --2- 172.21.15.123:0/1777732795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e400b4a70 0x7f6e30007270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:56:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/1777732795 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400b6f60 con 0x7f6e30005c10 2023-03-08T15:56:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/1777732795 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400b9ec0 con 0x7f6e30006640 2023-03-08T15:56:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/1777732795 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3000dc20 con 0x7f6e400b4a70 2023-03-08T15:56:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.211+0000 7f6e44eca700 1 --2- 172.21.15.123:0/1777732795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e30005c10 0x7f6e30006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:56:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.212+0000 7f6e3ffff700 1 --2- 172.21.15.123:0/1777732795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e30006640 0x7f6e30006b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:56:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.212+0000 7f6e456cb700 1 --2- 172.21.15.123:0/1777732795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e400b4a70 0x7f6e30007270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:56:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.212+0000 7f6e44eca700 1 -- 172.21.15.123:0/1777732795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e400b4a70 msgr2=0x7f6e30007270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:56:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.212+0000 7f6e44eca700 1 --2- 172.21.15.123:0/1777732795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e400b4a70 0x7f6e30007270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.212+0000 7f6e44eca700 1 -- 172.21.15.123:0/1777732795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e30006640 msgr2=0x7f6e30006b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:56:04.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.212+0000 7f6e44eca700 1 --2- 172.21.15.123:0/1777732795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e30006640 0x7f6e30006b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.212+0000 7f6e44eca700 1 -- 172.21.15.123:0/1777732795 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e300057c0 con 0x7f6e30005c10 2023-03-08T15:56:04.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.212+0000 7f6e44eca700 1 --2- 172.21.15.123:0/1777732795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e30005c10 0x7f6e30006020 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400c320 tx=0x7f6e30007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35d0b0bf590213c server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:56:04.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.212+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/1777732795 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34007c40 con 0x7f6e30005c10 2023-03-08T15:56:04.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.212+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/1777732795 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3400ce20 con 0x7f6e30005c10 2023-03-08T15:56:04.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.212+0000 7f6e3f7fe700 1 -- 172.21.15.123:0/1777732795 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34005ba0 con 0x7f6e30005c10 2023-03-08T15:56:04.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.212+0000 7f6e4712e700 1 -- 172.21.15.123:0/1777732795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e30005c10 msgr2=0x7f6e30006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:56:04.219 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.212+0000 7f6e4712e700 1 --2- 172.21.15.123:0/1777732795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e30005c10 0x7f6e30006020 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400c320 tx=0x7f6e30007a90 comp rx=0 tx=0).stop 2023-03-08T15:56:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.213+0000 7f6e456cb700 1 -- 172.21.15.123:0/1777732795 reap_dead start 2023-03-08T15:56:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.213+0000 7f6e4712e700 1 -- 172.21.15.123:0/1777732795 shutdown_connections 2023-03-08T15:56:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.213+0000 7f6e4712e700 1 -- 172.21.15.123:0/1777732795 >> 172.21.15.123:0/1777732795 conn(0x7f6e400be2d0 msgr2=0x7f6e400ba0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:56:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.213+0000 7f6e4712e700 1 -- 172.21.15.123:0/1777732795 shutdown_connections 2023-03-08T15:56:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.213+0000 7f6e4712e700 1 -- 172.21.15.123:0/1777732795 wait complete. 2023-03-08T15:56:04.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.214+0000 7f6e4712e700 1 Processor -- start 2023-03-08T15:56:04.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.214+0000 7f6e4712e700 1 -- start start 2023-03-08T15:56:04.222 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.214+0000 7f6e4712e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e30005c10 0x7f6e4014b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:56:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.214+0000 7f6e4712e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e40148730 0x7f6e400acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:56:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e4712e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e400ad020 0x7f6e401dfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:56:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e4712e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e401499b0 con 0x7f6e400ad020 2023-03-08T15:56:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e4712e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4014b780 con 0x7f6e30005c10 2023-03-08T15:56:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e4712e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4014a2b0 con 0x7f6e40148730 2023-03-08T15:56:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e456cb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e400ad020 0x7f6e401dfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:56:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e456cb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e400ad020 0x7f6e401dfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57452/0 (socket says 172.21.15.123:57452) 2023-03-08T15:56:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e456cb700 1 -- 172.21.15.123:0/3884840920 learned_addr learned my addr 172.21.15.123:0/3884840920 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:56:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e44eca700 1 --2- 172.21.15.123:0/3884840920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e30005c10 0x7f6e4014b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:56:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e3ffff700 1 --2- 172.21.15.123:0/3884840920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e40148730 0x7f6e400acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:56:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e456cb700 1 -- 172.21.15.123:0/3884840920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e40148730 msgr2=0x7f6e400acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:56:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e456cb700 1 --2- 172.21.15.123:0/3884840920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e40148730 0x7f6e400acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e456cb700 1 -- 172.21.15.123:0/3884840920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e30005c10 msgr2=0x7f6e4014b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:56:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e456cb700 1 --2- 172.21.15.123:0/3884840920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e30005c10 0x7f6e4014b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e456cb700 1 -- 172.21.15.123:0/3884840920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e400b5c10 con 0x7f6e400ad020 2023-03-08T15:56:04.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e456cb700 1 --2- 172.21.15.123:0/3884840920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e400ad020 0x7f6e401dfe20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6e38011bf0 tx=0x7f6e38011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:56:04.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e3d7fa700 1 -- 172.21.15.123:0/3884840920 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3800e040 con 0x7f6e400ad020 2023-03-08T15:56:04.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e3d7fa700 1 -- 172.21.15.123:0/3884840920 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3800f040 con 0x7f6e400ad020 2023-03-08T15:56:04.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e4712e700 1 -- 172.21.15.123:0/3884840920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e400b5930 con 0x7f6e400ad020 2023-03-08T15:56:04.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e3d7fa700 1 -- 172.21.15.123:0/3884840920 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3800fd20 con 0x7f6e400ad020 2023-03-08T15:56:04.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.215+0000 7f6e4712e700 1 -- 172.21.15.123:0/3884840920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e400b5ef0 con 0x7f6e400ad020 2023-03-08T15:56:04.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.216+0000 7f6e4712e700 1 -- 172.21.15.123:0/3884840920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e400744c0 con 0x7f6e400ad020 2023-03-08T15:56:04.225 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.217+0000 7f6e3d7fa700 1 -- 172.21.15.123:0/3884840920 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7f6e38022460 con 0x7f6e400ad020 2023-03-08T15:56:04.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.217+0000 7f6e3d7fa700 1 --2- 172.21.15.123:0/3884840920 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f6e240698d0 0x7f6e2406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:56:04.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.217+0000 7f6e44eca700 1 --2- 172.21.15.123:0/3884840920 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f6e240698d0 0x7f6e2406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:56:04.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.217+0000 7f6e3d7fa700 1 -- 172.21.15.123:0/3884840920 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f6e38087bf0 con 0x7f6e400ad020 2023-03-08T15:56:04.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.217+0000 7f6e44eca700 1 --2- 172.21.15.123:0/3884840920 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f6e240698d0 0x7f6e2406bd80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6e34008fd0 tx=0x7f6e3400a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:56:04.226 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.222+0000 7f6e3d7fa700 1 -- 172.21.15.123:0/3884840920 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7f6e380538b0 con 0x7f6e400ad020 2023-03-08T15:56:04.488 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.487+0000 7f6e4712e700 1 -- 172.21.15.123:0/3884840920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6e400b6c10 con 0x7f6e400ad020 2023-03-08T15:56:04.489 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.487+0000 7f6e3d7fa700 1 -- 172.21.15.123:0/3884840920 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7f6e38056ed0 con 0x7f6e400ad020 2023-03-08T15:56:04.489 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-03-08T15:56:04.489 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":1,"fsid":"1b15c317-0b05-4434-b72b-9beacb9cbd31","modified":"2023-03-08T15:48:40.160332Z","created":"2023-03-08T15:48:40.160332Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-03-08T15:56:04.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.489+0000 7f6e4712e700 1 -- 172.21.15.123:0/3884840920 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f6e240698d0 msgr2=0x7f6e2406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:56:04.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.489+0000 7f6e4712e700 1 --2- 172.21.15.123:0/3884840920 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f6e240698d0 0x7f6e2406bd80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6e34008fd0 tx=0x7f6e3400a000 comp rx=0 tx=0).stop 2023-03-08T15:56:04.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.489+0000 7f6e4712e700 1 -- 172.21.15.123:0/3884840920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e400ad020 msgr2=0x7f6e401dfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:56:04.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.489+0000 7f6e4712e700 1 --2- 172.21.15.123:0/3884840920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e400ad020 0x7f6e401dfe20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6e38011bf0 tx=0x7f6e38011f00 comp rx=0 tx=0).stop 2023-03-08T15:56:04.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.489+0000 7f6e4712e700 1 -- 172.21.15.123:0/3884840920 shutdown_connections 2023-03-08T15:56:04.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.489+0000 7f6e4712e700 1 --2- 172.21.15.123:0/3884840920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e400ad020 0x7f6e401dfe20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.491 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.489+0000 7f6e4712e700 1 --2- 172.21.15.123:0/3884840920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e30005c10 0x7f6e4014b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.489+0000 7f6e4712e700 1 --2- 172.21.15.123:0/3884840920 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7f6e240698d0 0x7f6e2406bd80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.489+0000 7f6e4712e700 1 --2- 172.21.15.123:0/3884840920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e40148730 0x7f6e400acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.489+0000 7f6e4712e700 1 -- 172.21.15.123:0/3884840920 >> 172.21.15.123:0/3884840920 conn(0x7f6e400be2d0 msgr2=0x7f6e400b8870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:56:04.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.489+0000 7f6e4712e700 1 -- 172.21.15.123:0/3884840920 shutdown_connections 2023-03-08T15:56:04.492 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.489+0000 7f6e4712e700 1 -- 172.21.15.123:0/3884840920 wait complete. 2023-03-08T15:56:04.493 INFO:teuthology.orchestra.run.smithi123.stderr:dumped monmap epoch 1 2023-03-08T15:56:04.502 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-03-08T15:56:04.622 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.621+0000 7fe0d286f700 1 Processor -- start 2023-03-08T15:56:04.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.621+0000 7fe0d286f700 1 -- start start 2023-03-08T15:56:04.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.622+0000 7fe0d286f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe0cc06f330 0x7fe0cc1446a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:56:04.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.622+0000 7fe0d286f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0cc144be0 0x7fe0cc154f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:56:04.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.622+0000 7fe0d286f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0cc06b8b0 con 0x7fe0cc0b3ce0 2023-03-08T15:56:04.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.622+0000 7fe0d286f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0cc0b8fe0 con 0x7fe0cc06f330 2023-03-08T15:56:04.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.622+0000 7fe0d286f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0b92c0 con 0x7fe0cc144be0 2023-03-08T15:56:04.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.623+0000 7fe0d0e0c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0cc144be0 0x7fe0cc154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:56:04.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.623+0000 7fe0cbfff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe0cc06f330 0x7fe0cc1446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:56:04.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.623+0000 7fe0cb7fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe0cc0b3ce0 0x7fe0cc14dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.123:59106/0 (socket says 172.21.15.123:59106) 2023-03-08T15:56:04.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.623+0000 7fe0cb7fe700 1 -- 172.21.15.123:0/1756210103 learned_addr learned my addr 172.21.15.123:0/1756210103 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-03-08T15:56:04.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.623+0000 7fe0caffd700 1 -- 172.21.15.123:0/1756210103 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422637859 0 0) 0x7fe0cc06b8b0 con 0x7fe0cc0b3ce0 2023-03-08T15:56:04.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.623+0000 7fe0d0e0c700 1 -- 172.21.15.123:0/1756210103 >> v2:172.21.15.175:3300/0 conn(0x7fe0cc06f330 msgr2=0x7fe0cc1446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-08T15:56:04.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.623+0000 7fe0d0e0c700 1 --2- 172.21.15.123:0/1756210103 >> v2:172.21.15.175:3300/0 conn(0x7fe0cc06f330 0x7fe0cc1446a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.623+0000 7fe0d0e0c700 1 -- 172.21.15.123:0/1756210103 >> v1:172.21.15.175:6789/0 conn(0x7fe0cc0b3ce0 legacy=0x7fe0cc14dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:56:04.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.623+0000 7fe0d0e0c700 1 -- 172.21.15.123:0/1756210103 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc06b260 con 0x7fe0cc144be0 2023-03-08T15:56:04.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.623+0000 7fe0cbfff700 1 --2- 172.21.15.123:0/1756210103 >> v2:172.21.15.175:3300/0 conn(0x7fe0cc06f330 0x7fe0cc1446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:56:04.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.623+0000 7fe0d0e0c700 1 --2- 172.21.15.123:0/1756210103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0cc144be0 0x7fe0cc154f50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009d90 tx=0x7fe0c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f63cf1fa5d9ae4a server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:56:04.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.623+0000 7fe0caffd700 1 -- 172.21.15.123:0/1756210103 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c400e070 con 0x7fe0cc144be0 2023-03-08T15:56:04.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.623+0000 7fe0caffd700 1 -- 172.21.15.123:0/1756210103 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c400bb20 con 0x7fe0cc144be0 2023-03-08T15:56:04.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.623+0000 7fe0caffd700 1 -- 172.21.15.123:0/1756210103 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4012430 con 0x7fe0cc144be0 2023-03-08T15:56:04.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.624+0000 7fe0d286f700 1 -- 172.21.15.123:0/1756210103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0cc144be0 msgr2=0x7fe0cc154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:56:04.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.624+0000 7fe0d286f700 1 --2- 172.21.15.123:0/1756210103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0cc144be0 0x7fe0cc154f50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009d90 tx=0x7fe0c400b330 comp rx=0 tx=0).stop 2023-03-08T15:56:04.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.624+0000 7fe0d286f700 1 -- 172.21.15.123:0/1756210103 shutdown_connections 2023-03-08T15:56:04.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.624+0000 7fe0d286f700 1 --2- 172.21.15.123:0/1756210103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0cc144be0 0x7fe0cc154f50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.624+0000 7fe0d286f700 1 --2- 172.21.15.123:0/1756210103 >> v2:172.21.15.175:3300/0 conn(0x7fe0cc06f330 0x7fe0cc1446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.624+0000 7fe0d286f700 1 -- 172.21.15.123:0/1756210103 >> 172.21.15.123:0/1756210103 conn(0x7fe0cc0ba3c0 msgr2=0x7fe0cc0bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:56:04.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.624+0000 7fe0d286f700 1 -- 172.21.15.123:0/1756210103 shutdown_connections 2023-03-08T15:56:04.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.624+0000 7fe0d286f700 1 -- 172.21.15.123:0/1756210103 wait complete. 2023-03-08T15:56:04.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.625+0000 7fe0d286f700 1 Processor -- start 2023-03-08T15:56:04.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.625+0000 7fe0d286f700 1 -- start start 2023-03-08T15:56:04.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.625+0000 7fe0d286f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0cc06f330 0x7fe0cc142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:56:04.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.625+0000 7fe0d286f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc0b3ce0 0x7fe0cc0b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:56:04.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0d286f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0cc144be0 0x7fe0cc0bc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:56:04.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0d286f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc142a90 con 0x7fe0cc0b3ce0 2023-03-08T15:56:04.631 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0d286f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0b5ff0 con 0x7fe0cc06f330 2023-03-08T15:56:04.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0d286f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc1d6010 con 0x7fe0cc144be0 2023-03-08T15:56:04.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0cb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc0b3ce0 0x7fe0cc0b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:56:04.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0cb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc0b3ce0 0x7fe0cc0b4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57466/0 (socket says 172.21.15.123:57466) 2023-03-08T15:56:04.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0cb7fe700 1 -- 172.21.15.123:0/3023289646 learned_addr learned my addr 172.21.15.123:0/3023289646 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-03-08T15:56:04.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0d0e0c700 1 --2- 172.21.15.123:0/3023289646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0cc144be0 0x7fe0cc0bc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:56:04.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0cbfff700 1 --2- 172.21.15.123:0/3023289646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0cc06f330 0x7fe0cc142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:56:04.632 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0cb7fe700 1 -- 172.21.15.123:0/3023289646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0cc144be0 msgr2=0x7fe0cc0bc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:56:04.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0cb7fe700 1 --2- 172.21.15.123:0/3023289646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0cc144be0 0x7fe0cc0bc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0cb7fe700 1 -- 172.21.15.123:0/3023289646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0cc06f330 msgr2=0x7fe0cc142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:56:04.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0cb7fe700 1 --2- 172.21.15.123:0/3023289646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0cc06f330 0x7fe0cc142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0cb7fe700 1 -- 172.21.15.123:0/3023289646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc0094a0 con 0x7fe0cc0b3ce0 2023-03-08T15:56:04.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0d0e0c700 1 --2- 172.21.15.123:0/3023289646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0cc144be0 0x7fe0cc0bc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-08T15:56:04.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0cb7fe700 1 --2- 172.21.15.123:0/3023289646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc0b3ce0 0x7fe0cc0b4630 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000c570 tx=0x7fe0c000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:56:04.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0c8ff9700 1 -- 172.21.15.123:0/3023289646 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0004c80 con 0x7fe0cc0b3ce0 2023-03-08T15:56:04.633 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0c8ff9700 1 -- 172.21.15.123:0/3023289646 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c0004de0 con 0x7fe0cc0b3ce0 2023-03-08T15:56:04.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0d286f700 1 -- 172.21.15.123:0/3023289646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c4009a70 con 0x7fe0cc0b3ce0 2023-03-08T15:56:04.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0c8ff9700 1 -- 172.21.15.123:0/3023289646 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0007310 con 0x7fe0cc0b3ce0 2023-03-08T15:56:04.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.626+0000 7fe0d286f700 1 -- 172.21.15.123:0/3023289646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0cc0bdb20 con 0x7fe0cc0b3ce0 2023-03-08T15:56:04.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.627+0000 7fe0d286f700 1 -- 172.21.15.123:0/3023289646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0cc06b540 con 0x7fe0cc0b3ce0 2023-03-08T15:56:04.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.628+0000 7fe0c8ff9700 1 -- 172.21.15.123:0/3023289646 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 87338+0+0 (secure 0 0 0) 0x7fe0c001a020 con 0x7fe0cc0b3ce0 2023-03-08T15:56:04.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.628+0000 7fe0c8ff9700 1 --2- 172.21.15.123:0/3023289646 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe0b80698d0 0x7fe0b806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-08T15:56:04.634 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.628+0000 7fe0c8ff9700 1 -- 172.21.15.123:0/3023289646 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fe0c0087190 con 0x7fe0cc0b3ce0 2023-03-08T15:56:04.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.628+0000 7fe0cbfff700 1 --2- 172.21.15.123:0/3023289646 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe0b80698d0 0x7fe0b806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-08T15:56:04.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.628+0000 7fe0cbfff700 1 --2- 172.21.15.123:0/3023289646 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe0b80698d0 0x7fe0b806bd80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009d70 tx=0x7fe0bc009210 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-08T15:56:04.635 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.632+0000 7fe0c8ff9700 1 -- 172.21.15.123:0/3023289646 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176440 (secure 0 0 0) 0x7fe0c0052f80 con 0x7fe0cc0b3ce0 2023-03-08T15:56:04.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.894+0000 7fe0d286f700 1 -- 172.21.15.123:0/3023289646 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fe0cc06f700 con 0x7fe0cc0b3ce0 2023-03-08T15:56:04.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.894+0000 7fe0c8ff9700 1 -- 172.21.15.123:0/3023289646 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7fe0c00565a0 con 0x7fe0cc0b3ce0 2023-03-08T15:56:04.896 INFO:teuthology.orchestra.run.smithi123.stdout:[client.admin] 2023-03-08T15:56:04.896 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBYrghkBXe4HRAAQ7OV7ftTtz+Ijw9yEcu/xg== 2023-03-08T15:56:04.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.896+0000 7fe0d286f700 1 -- 172.21.15.123:0/3023289646 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe0b80698d0 msgr2=0x7fe0b806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:56:04.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.896+0000 7fe0d286f700 1 --2- 172.21.15.123:0/3023289646 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe0b80698d0 0x7fe0b806bd80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009d70 tx=0x7fe0bc009210 comp rx=0 tx=0).stop 2023-03-08T15:56:04.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.896+0000 7fe0d286f700 1 -- 172.21.15.123:0/3023289646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc0b3ce0 msgr2=0x7fe0cc0b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-08T15:56:04.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.896+0000 7fe0d286f700 1 --2- 172.21.15.123:0/3023289646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc0b3ce0 0x7fe0cc0b4630 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000c570 tx=0x7fe0c000c880 comp rx=0 tx=0).stop 2023-03-08T15:56:04.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.896+0000 7fe0d286f700 1 -- 172.21.15.123:0/3023289646 shutdown_connections 2023-03-08T15:56:04.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.896+0000 7fe0d286f700 1 --2- 172.21.15.123:0/3023289646 >> [v2:172.21.15.123:6832/142884,v1:172.21.15.123:6833/142884] conn(0x7fe0b80698d0 0x7fe0b806bd80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.896+0000 7fe0d286f700 1 --2- 172.21.15.123:0/3023289646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0cc144be0 0x7fe0cc0bc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.896+0000 7fe0d286f700 1 --2- 172.21.15.123:0/3023289646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0cc06f330 0x7fe0cc142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.896+0000 7fe0d286f700 1 --2- 172.21.15.123:0/3023289646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0cc0b3ce0 0x7fe0cc0b4630 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-08T15:56:04.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.896+0000 7fe0d286f700 1 -- 172.21.15.123:0/3023289646 >> 172.21.15.123:0/3023289646 conn(0x7fe0cc0ba3c0 msgr2=0x7fe0cc13f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-08T15:56:04.899 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.896+0000 7fe0d286f700 1 -- 172.21.15.123:0/3023289646 shutdown_connections 2023-03-08T15:56:04.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-03-08T15:56:04.896+0000 7fe0d286f700 1 -- 172.21.15.123:0/3023289646 wait complete. 2023-03-08T15:56:04.910 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2023-03-08T15:56:04.910 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/tmp/tmp.AsxONLoNsgxfstests-dev/local.config 2023-03-08T15:56:05.013 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.123:6789:/test export TEST_DIR=/tmp/tmp.maEWJIuC5stest export SCRATCH_DEV=172.21.15.123:6789:/scratch export SCRATCH_MNT=/tmp/tmp.gBRMxQDUw9scratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBYrghkBXe4HRAAQ7OV7ftTtz+Ijw9yEcu/xg==,test_dummy_encryption" 2023-03-08T15:56:05.014 INFO:teuthology.orchestra.run:Running command with timeout 10800 2023-03-08T15:56:05.014 DEBUG:teuthology.orchestra.run.smithi182:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.AsxONLoNsgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2023-03-08T15:56:07.859 INFO:teuthology.orchestra.run.smithi182.stdout:FSTYP -- ceph 2023-03-08T15:56:07.881 INFO:teuthology.orchestra.run.smithi182.stdout:PLATFORM -- Linux/x86_64 smithi182 6.2.0-ceph-g75534f74ac3d #1 SMP PREEMPT_DYNAMIC Fri Mar 3 04:02:18 UTC 2023 2023-03-08T15:56:07.883 INFO:teuthology.orchestra.run.smithi182.stdout:MKFS_OPTIONS -- 172.21.15.123:6789:/scratch 2023-03-08T15:56:07.887 INFO:teuthology.orchestra.run.smithi182.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBYrghkBXe4HRAAQ7OV7ftTtz+Ijw9yEcu/xg==,test_dummy_encryption -o context=system_u:object_r:root_t:s0 172.21.15.123:6789:/scratch /tmp/tmp.gBRMxQDUw9scratch 2023-03-08T15:56:07.887 INFO:teuthology.orchestra.run.smithi182.stdout: 2023-03-08T15:56:08.157 INFO:teuthology.orchestra.run.smithi182.stdout:ceph/001 [expunged] 2023-03-08T15:56:08.712 INFO:teuthology.orchestra.run.smithi182.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-03-08T15:56:09.265 INFO:teuthology.orchestra.run.smithi182.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-03-08T15:56:09.935 INFO:teuthology.orchestra.run.smithi182.stdout:ceph/004 0s 2023-03-08T15:56:10.363 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:56:10.366 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:56:10.368 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:56:10.432 INFO:teuthology.orchestra.run.smithi182.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-03-08T15:56:20.668 INFO:teuthology.orchestra.run.smithi182.stdout:generic/001 10s 2023-03-08T15:56:21.683 INFO:teuthology.orchestra.run.smithi182.stdout:generic/002 1s 2023-03-08T15:56:21.717 INFO:teuthology.orchestra.run.smithi182.stdout:generic/003 [expunged] 2023-03-08T15:56:22.232 INFO:teuthology.orchestra.run.smithi182.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-03-08T15:56:23.135 INFO:teuthology.orchestra.run.smithi182.stdout:generic/005 1s 2023-03-08T15:56:40.505 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:56:40.508 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:56:40.511 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:56:47.869 INFO:teuthology.orchestra.run.smithi182.stdout:generic/006 24s 2023-03-08T15:57:10.945 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:57:10.948 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:57:10.950 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:57:37.669 INFO:teuthology.orchestra.run.smithi182.stdout:generic/007 50s 2023-03-08T15:57:40.075 INFO:teuthology.orchestra.run.smithi182.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-08T15:57:41.196 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:57:41.199 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:57:41.202 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:57:42.296 INFO:teuthology.orchestra.run.smithi182.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-08T15:58:11.337 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:58:11.340 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:58:11.342 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:58:12.315 INFO:teuthology.orchestra.run.smithi182.stdout:generic/011 30s 2023-03-08T15:58:14.608 INFO:teuthology.orchestra.run.smithi182.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-03-08T15:58:41.773 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:58:41.776 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:58:41.778 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:59:11.913 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:59:11.916 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:59:11.918 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:59:42.057 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:59:42.060 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:59:42.062 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T15:59:57.779 INFO:teuthology.orchestra.run.smithi182.stdout:generic/013 103s 2023-03-08T16:00:12.269 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:00:12.271 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:00:12.273 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:00:42.798 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:00:42.808 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:00:42.810 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:01:13.185 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:01:13.202 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:01:13.204 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:01:43.424 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:01:43.435 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:01:43.437 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:01:43.513 INFO:tasks.ceph.mds.a.smithi123.stderr:2023-03-08T16:01:43.510+0000 7f47e2f9f700 -1 Fail to open '/proc/156480/cmdline' error = (2) No such file or directory 2023-03-08T16:01:43.513 INFO:tasks.ceph.mds.a.smithi123.stderr:2023-03-08T16:01:43.510+0000 7f47e2f9f700 -1 received signal: Hangup from (PID: 156480) UID: 0 2023-03-08T16:01:43.515 INFO:tasks.ceph.mds.c.smithi123.stderr:2023-03-08T16:01:43.510+0000 7f2920488700 -1 Fail to open '/proc/156480/cmdline' error = (2) No such file or directory 2023-03-08T16:01:43.515 INFO:tasks.ceph.mds.c.smithi123.stderr:2023-03-08T16:01:43.510+0000 7f2920488700 -1 received signal: Hangup from (PID: 156480) UID: 0 2023-03-08T16:02:23.210 INFO:teuthology.orchestra.run.smithi182.stdout:generic/014 146s 2023-03-08T16:02:23.696 INFO:teuthology.orchestra.run.smithi182.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-08T16:02:29.141 INFO:teuthology.orchestra.run.smithi182.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-03-08T16:02:29.833 INFO:teuthology.orchestra.run.smithi182.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-03-08T16:02:29.893 INFO:teuthology.orchestra.run.smithi182.stdout:generic/020 [expunged] 2023-03-08T16:02:34.437 INFO:teuthology.orchestra.run.smithi182.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-03-08T16:02:38.612 INFO:teuthology.orchestra.run.smithi182.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-03-08T16:03:15.429 INFO:teuthology.orchestra.run.smithi182.stdout:generic/023 37s 2023-03-08T16:03:15.946 INFO:teuthology.orchestra.run.smithi182.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-03-08T16:03:16.473 INFO:teuthology.orchestra.run.smithi182.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-03-08T16:03:17.050 INFO:teuthology.orchestra.run.smithi182.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-03-08T16:03:22.592 INFO:teuthology.orchestra.run.smithi182.stdout:generic/028 5s 2023-03-08T16:03:24.148 INFO:teuthology.orchestra.run.smithi182.stdout:generic/029 2s 2023-03-08T16:03:31.989 INFO:teuthology.orchestra.run.smithi182.stdout:generic/030 7s 2023-03-08T16:03:37.455 INFO:teuthology.orchestra.run.smithi182.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-03-08T16:03:37.966 INFO:teuthology.orchestra.run.smithi182.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-08T16:03:48.742 INFO:teuthology.orchestra.run.smithi182.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-08T16:03:49.273 INFO:teuthology.orchestra.run.smithi182.stdout:generic/034 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:03:49.897 INFO:teuthology.orchestra.run.smithi182.stdout:generic/035 0s 2023-03-08T16:04:01.783 INFO:teuthology.orchestra.run.smithi182.stdout:generic/037 12s 2023-03-08T16:04:02.411 INFO:teuthology.orchestra.run.smithi182.stdout:generic/039 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:04:02.963 INFO:teuthology.orchestra.run.smithi182.stdout:generic/040 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:04:03.513 INFO:teuthology.orchestra.run.smithi182.stdout:generic/041 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:04:04.218 INFO:teuthology.orchestra.run.smithi182.stdout:generic/042 [not run] ceph does not support shutdown 2023-03-08T16:04:04.925 INFO:teuthology.orchestra.run.smithi182.stdout:generic/050 [not run] ceph does not support shutdown 2023-03-08T16:04:05.636 INFO:teuthology.orchestra.run.smithi182.stdout:generic/052 [not run] ceph does not support shutdown 2023-03-08T16:04:07.031 INFO:teuthology.orchestra.run.smithi182.stdout:generic/053 2s 2023-03-08T16:04:07.660 INFO:teuthology.orchestra.run.smithi182.stdout:generic/056 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:04:08.217 INFO:teuthology.orchestra.run.smithi182.stdout:generic/057 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:04:12.925 INFO:teuthology.orchestra.run.smithi182.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-03-08T16:04:13.464 INFO:teuthology.orchestra.run.smithi182.stdout:generic/059 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:04:18.445 INFO:teuthology.orchestra.run.smithi182.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-03-08T16:04:24.140 INFO:teuthology.orchestra.run.smithi182.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-03-08T16:04:26.607 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:04:26.610 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:04:26.614 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:04:27.607 INFO:teuthology.orchestra.run.smithi182.stdout:generic/062 3s 2023-03-08T16:04:34.758 INFO:teuthology.orchestra.run.smithi182.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-03-08T16:04:35.294 INFO:teuthology.orchestra.run.smithi182.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-08T16:04:35.850 INFO:teuthology.orchestra.run.smithi182.stdout:generic/065 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:04:36.393 INFO:teuthology.orchestra.run.smithi182.stdout:generic/066 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:04:36.995 INFO:teuthology.orchestra.run.smithi182.stdout:generic/067 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:04:56.836 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:04:56.839 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:04:56.842 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:05:10.618 INFO:teuthology.orchestra.run.smithi182.stdout:generic/069 33s 2023-03-08T16:05:27.019 INFO:teuthology.orchestra.run.smithi182.stdout:generic/070 17s 2023-03-08T16:05:27.039 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:05:27.042 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:05:27.044 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:05:27.537 INFO:teuthology.orchestra.run.smithi182.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-08T16:05:28.075 INFO:teuthology.orchestra.run.smithi182.stdout:generic/073 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:05:28.121 INFO:teuthology.orchestra.run.smithi182.stdout:generic/075 [expunged] 2023-03-08T16:05:28.610 INFO:teuthology.orchestra.run.smithi182.stdout:generic/076 [not run] require 172.21.15.123:6789:/scratch to be local device 2023-03-08T16:05:29.155 INFO:teuthology.orchestra.run.smithi182.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-03-08T16:05:29.662 INFO:teuthology.orchestra.run.smithi182.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-03-08T16:05:32.262 INFO:teuthology.orchestra.run.smithi182.stdout:generic/080 3s 2023-03-08T16:05:32.821 INFO:teuthology.orchestra.run.smithi182.stdout:generic/081 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:05:33.339 INFO:teuthology.orchestra.run.smithi182.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-08T16:05:57.238 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:05:57.241 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:05:57.244 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:06:27.368 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:06:27.370 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:06:27.373 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:06:39.926 INFO:teuthology.orchestra.run.smithi182.stdout:generic/084 66s 2023-03-08T16:06:46.316 INFO:teuthology.orchestra.run.smithi182.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-08T16:06:46.980 INFO:teuthology.orchestra.run.smithi182.stdout:generic/087 0s 2023-03-08T16:06:47.541 INFO:teuthology.orchestra.run.smithi182.stdout:generic/088 0s 2023-03-08T16:06:48.089 INFO:teuthology.orchestra.run.smithi182.stdout:generic/090 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:06:57.531 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:06:57.534 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:06:57.536 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:07:27.944 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:07:27.947 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:07:27.949 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:07:58.305 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:07:58.309 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:07:58.311 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:08:00.406 INFO:teuthology.orchestra.run.smithi182.stdout:generic/091 72s 2023-03-08T16:08:00.927 INFO:teuthology.orchestra.run.smithi182.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-08T16:08:01.476 INFO:teuthology.orchestra.run.smithi182.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-08T16:08:07.195 INFO:teuthology.orchestra.run.smithi182.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-08T16:08:08.136 INFO:teuthology.orchestra.run.smithi182.stdout:generic/097 1s 2023-03-08T16:08:09.571 INFO:teuthology.orchestra.run.smithi182.stdout:generic/098 1s 2023-03-08T16:08:11.291 INFO:teuthology.orchestra.run.smithi182.stdout:generic/099 2s 2023-03-08T16:08:11.822 INFO:teuthology.orchestra.run.smithi182.stdout:generic/101 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:08:12.355 INFO:teuthology.orchestra.run.smithi182.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-08T16:08:12.905 INFO:teuthology.orchestra.run.smithi182.stdout:generic/104 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:08:14.043 INFO:teuthology.orchestra.run.smithi182.stdout:generic/105 2s 2023-03-08T16:08:14.682 INFO:teuthology.orchestra.run.smithi182.stdout:generic/106 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:08:15.234 INFO:teuthology.orchestra.run.smithi182.stdout:generic/107 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:08:15.934 INFO:teuthology.orchestra.run.smithi182.stdout:generic/108 [not run] require 172.21.15.123:6789:/scratch to be valid block disk 2023-03-08T16:08:16.507 INFO:teuthology.orchestra.run.smithi182.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-03-08T16:08:17.071 INFO:teuthology.orchestra.run.smithi182.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-03-08T16:08:28.444 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:08:28.447 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:08:28.450 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:08:52.252 INFO:teuthology.orchestra.run.smithi182.stdout:generic/112 35s 2023-03-08T16:08:58.650 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:08:58.652 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:08:58.673 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:09:28.931 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:09:28.933 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:09:28.935 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:09:59.109 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:09:59.115 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:09:59.122 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:10:29.474 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:10:29.486 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:10:29.518 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:11:00.024 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:11:00.027 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:11:00.029 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:11:30.164 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:11:30.167 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:11:30.170 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:12:00.294 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:12:00.297 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:12:00.300 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:12:30.445 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:12:30.448 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:12:30.451 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:13:00.580 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:13:00.583 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:13:00.585 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:13:30.721 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:13:30.724 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:13:30.726 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:14:00.860 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:14:00.863 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:14:00.866 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:14:31.007 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:14:31.010 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:14:31.012 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:15:01.136 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:15:01.139 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:15:01.141 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:15:31.275 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:15:31.278 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:15:31.280 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:16:01.414 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:16:01.417 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:16:01.420 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:16:31.561 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:16:31.564 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:16:31.568 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:17:01.799 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:17:01.802 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:17:01.805 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:17:31.946 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:17:31.949 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:17:31.951 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:18:02.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:18:02.088 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:18:02.091 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:18:32.223 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:18:32.226 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:18:32.228 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:19:02.369 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:19:02.372 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:19:02.374 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:19:32.524 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:19:32.526 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:19:32.528 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:20:02.646 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:20:02.649 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:20:02.651 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:20:32.809 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:20:32.812 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:20:32.816 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:21:02.947 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:21:02.950 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:21:02.953 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:21:33.089 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:21:33.091 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:21:33.093 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:22:03.224 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:22:03.226 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:22:03.228 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:22:33.381 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:22:33.384 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:22:33.386 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:23:03.517 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:23:03.520 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:23:03.522 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:23:33.647 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:23:33.650 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:23:33.652 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:23:33.697 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T16:23:33.696+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122804) UID: 0 2023-03-08T16:23:33.697 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T16:23:33.696+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122804) UID: 0 2023-03-08T16:23:33.698 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T16:23:33.696+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122804) UID: 0 2023-03-08T16:23:33.698 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T16:23:33.696+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122804) UID: 0 2023-03-08T16:25:37.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:25:37.413 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:25:37.415 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:26:07.566 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:26:07.569 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:26:07.571 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:26:37.694 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:26:37.697 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:26:37.699 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:27:07.841 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:27:07.844 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:27:07.847 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:27:37.988 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:27:37.991 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:27:37.993 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:28:08.149 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:28:08.152 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:28:08.154 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:28:38.291 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:28:38.294 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:28:38.296 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:29:08.429 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:29:08.432 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:29:08.434 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:29:38.573 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:29:38.576 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:29:38.579 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:30:08.713 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:30:08.716 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:30:08.718 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:30:39.024 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:30:39.027 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:30:39.029 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:31:09.166 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:31:09.169 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:31:09.171 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:31:39.312 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:31:39.315 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:31:39.317 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:32:09.449 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:32:09.452 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:32:09.454 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:32:39.579 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:32:39.582 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:32:39.584 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:33:09.701 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:33:09.704 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:33:09.706 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:33:39.862 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:33:39.865 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:33:39.867 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:34:10.012 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:34:10.015 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:34:10.017 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:34:40.142 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:34:40.144 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:34:40.146 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:35:10.340 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:35:10.342 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:35:10.345 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:35:40.478 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:35:40.482 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:35:40.484 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:36:10.617 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:36:10.620 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:36:10.622 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:36:40.756 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:36:40.759 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:36:40.761 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:37:11.136 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:37:11.139 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:37:11.141 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:37:41.289 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:37:41.293 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:37:41.295 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:38:11.438 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:38:11.441 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:38:11.444 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:38:41.585 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:38:41.588 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:38:41.591 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:39:11.723 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:39:11.726 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:39:11.728 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:39:41.877 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:39:41.880 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:39:41.883 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:39:41.916 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T16:39:41.914+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123637) UID: 0 2023-03-08T16:39:41.916 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T16:39:41.914+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123637) UID: 0 2023-03-08T16:39:41.917 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T16:39:41.914+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123637) UID: 0 2023-03-08T16:39:41.917 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T16:39:41.914+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123637) UID: 0 2023-03-08T16:41:44.975 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:41:44.978 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:41:44.980 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:42:15.112 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:42:15.115 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:42:15.117 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:42:45.278 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:42:45.281 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:42:45.283 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:43:15.425 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:43:15.428 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:43:15.430 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:43:45.577 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:43:45.580 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:43:45.583 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:44:15.724 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:44:15.731 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:44:15.735 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:44:45.862 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:44:45.865 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:44:45.867 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:45:15.993 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:45:15.995 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:45:15.997 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:45:46.143 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:45:46.148 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:45:46.151 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:46:16.302 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:46:16.305 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:46:16.307 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:46:46.436 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:46:46.439 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:46:46.441 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:47:16.621 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:47:16.624 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:47:16.626 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:47:46.758 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:47:46.761 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:47:46.763 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:48:16.889 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:48:16.893 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:48:16.896 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:48:47.018 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:48:47.021 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:48:47.024 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:49:17.170 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:49:17.173 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:49:17.175 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:49:47.308 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:49:47.311 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:49:47.313 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:50:17.465 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:50:17.469 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:50:17.471 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:50:47.604 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:50:47.607 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:50:47.609 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:51:17.743 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:51:17.746 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:51:17.748 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:51:47.905 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:51:47.908 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:51:47.910 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:52:18.053 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:52:18.056 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:52:18.058 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:52:48.355 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:52:48.357 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:52:48.359 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:53:18.504 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:53:18.506 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:53:18.508 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:53:48.662 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:53:48.665 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:53:48.667 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:54:18.808 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:54:18.810 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:54:18.813 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:54:48.972 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:54:48.975 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:54:48.978 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:55:19.108 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:55:19.110 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:55:19.112 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:55:49.257 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:55:49.261 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:55:49.264 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:55:49.296 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T16:55:49.295+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124477) UID: 0 2023-03-08T16:55:49.297 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T16:55:49.295+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124477) UID: 0 2023-03-08T16:55:49.297 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T16:55:49.295+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124477) UID: 0 2023-03-08T16:55:49.298 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T16:55:49.295+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124477) UID: 0 2023-03-08T16:57:51.899 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:57:51.902 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:57:51.904 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:58:22.047 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:58:22.050 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:58:22.053 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:58:52.194 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:58:52.196 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:58:52.198 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:59:22.339 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:59:22.347 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:59:22.351 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:59:52.478 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:59:52.481 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T16:59:52.483 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:00:22.633 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:00:22.636 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:00:22.638 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:00:52.779 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:00:52.782 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:00:52.785 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:01:22.976 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:01:22.979 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:01:22.982 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:01:53.114 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:01:53.118 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:01:53.120 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:02:23.252 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:02:23.255 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:02:23.257 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:02:53.400 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:02:53.403 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:02:53.405 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:03:23.554 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:03:23.557 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:03:23.559 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:03:53.694 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:03:53.698 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:03:53.701 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:04:23.857 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:04:23.860 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:04:23.862 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:04:53.995 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:04:53.998 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:04:54.001 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:05:24.158 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:05:24.161 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:05:24.164 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:05:54.298 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:05:54.301 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:05:54.303 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:06:24.454 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:06:24.457 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:06:24.459 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:06:54.600 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:06:54.603 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:06:54.606 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:07:24.729 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:07:24.732 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:07:24.734 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:07:54.859 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:07:54.862 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:07:54.864 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:08:25.108 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:08:25.111 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:08:25.113 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:08:55.253 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:08:55.256 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:08:55.258 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:09:25.383 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:09:25.386 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:09:25.388 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:09:55.530 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:09:55.533 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:09:55.536 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:10:25.660 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:10:25.663 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:10:25.665 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:10:55.800 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:10:55.803 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:10:55.805 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:11:25.953 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:11:25.956 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:11:25.958 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:11:56.105 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:11:56.108 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:11:56.110 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:12:26.239 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:12:26.242 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:12:26.244 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:12:26.278 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T17:12:26.277+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125360) UID: 0 2023-03-08T17:12:26.279 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T17:12:26.277+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125360) UID: 0 2023-03-08T17:12:26.279 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T17:12:26.277+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125360) UID: 0 2023-03-08T17:12:26.280 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T17:12:26.277+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125360) UID: 0 2023-03-08T17:14:31.092 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:14:31.095 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:14:31.097 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:15:01.242 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:15:01.246 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:15:01.249 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:15:31.376 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:15:31.379 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:15:31.381 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:16:01.527 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:16:01.531 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:16:01.533 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:16:31.662 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:16:31.665 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:16:31.667 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:17:01.804 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:17:01.807 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:17:01.809 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:17:31.958 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:17:31.962 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:17:31.965 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:18:02.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:18:02.089 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:18:02.091 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:18:32.263 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:18:32.266 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:18:32.269 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:19:02.394 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:19:02.398 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:19:02.401 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:19:32.527 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:19:32.532 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:19:32.535 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:20:02.665 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:20:02.668 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:20:02.670 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:20:32.820 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:20:32.823 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:20:32.826 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:21:02.956 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:21:02.959 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:21:02.961 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:21:33.097 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:21:33.100 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:21:33.103 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:22:03.233 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:22:03.236 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:22:03.238 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:22:33.372 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:22:33.375 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:22:33.378 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:23:03.510 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:23:03.513 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:23:03.515 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:23:33.656 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:23:33.659 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:23:33.662 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:24:03.794 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:24:03.797 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:24:03.799 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:24:33.925 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:24:33.928 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:24:33.930 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:25:04.056 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:25:04.060 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:25:04.063 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:25:34.333 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:25:34.337 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:25:34.339 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:26:04.474 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:26:04.477 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:26:04.479 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:26:34.632 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:26:34.635 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:26:34.637 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:27:04.786 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:27:04.789 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:27:04.791 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:27:34.933 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:27:34.936 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:27:34.938 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:28:05.069 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:28:05.072 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:28:05.074 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:28:35.208 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:28:35.211 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:28:35.213 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:29:05.371 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:29:05.373 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:29:05.375 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:29:05.407 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T17:29:05.404+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126215) UID: 0 2023-03-08T17:29:05.407 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T17:29:05.405+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126215) UID: 0 2023-03-08T17:29:05.408 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T17:29:05.405+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126215) UID: 0 2023-03-08T17:29:05.408 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T17:29:05.405+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126215) UID: 0 2023-03-08T17:31:10.447 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:31:10.451 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:31:10.454 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:31:40.578 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:31:40.581 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:31:40.583 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:32:10.708 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:32:10.712 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:32:10.714 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:32:40.855 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:32:40.858 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:32:40.861 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:33:11.032 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:33:11.035 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:33:11.037 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:33:41.185 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:33:41.188 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:33:41.190 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:34:11.319 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:34:11.322 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:34:11.324 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:34:41.450 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:34:41.453 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:34:41.455 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:35:11.603 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:35:11.606 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:35:11.609 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:35:41.770 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:35:41.773 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:35:41.775 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:36:11.909 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:36:11.912 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:36:11.918 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:36:42.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:36:42.163 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:36:42.165 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:37:12.306 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:37:12.309 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:37:12.311 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:37:42.441 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:37:42.444 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:37:42.446 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:38:12.581 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:38:12.585 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:38:12.587 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:38:42.737 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:38:42.745 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:38:42.748 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:39:12.884 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:39:12.888 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:39:12.891 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:39:43.021 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:39:43.028 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:39:43.031 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:40:13.165 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:40:13.169 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:40:13.171 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:40:43.324 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:40:43.326 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:40:43.329 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:41:13.470 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:41:13.473 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:41:13.475 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:41:43.606 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:41:43.609 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:41:43.611 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:42:13.755 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:42:13.758 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:42:13.760 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:42:44.068 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:42:44.071 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:42:44.074 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:43:14.237 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:43:14.240 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:43:14.243 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:43:44.392 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:43:44.395 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:43:44.397 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:44:14.530 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:44:14.534 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:44:14.537 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:44:44.661 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:44:44.664 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:44:44.669 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:45:14.808 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:45:14.811 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:45:14.813 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:45:14.845 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T17:45:14.842+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127061) UID: 0 2023-03-08T17:45:14.845 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T17:45:14.842+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127061) UID: 0 2023-03-08T17:45:14.846 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T17:45:14.842+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127061) UID: 0 2023-03-08T17:45:14.846 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T17:45:14.842+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127061) UID: 0 2023-03-08T17:47:17.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:47:17.262 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:47:17.264 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:47:47.395 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:47:47.398 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:47:47.400 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:48:17.557 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:48:17.560 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:48:17.562 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:48:47.708 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:48:47.711 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:48:47.713 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:49:17.840 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:49:17.843 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:49:17.845 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:49:47.998 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:49:48.001 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:49:48.003 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:50:18.312 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:50:18.315 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:50:18.316 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:50:48.457 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:50:48.460 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:50:48.462 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:51:18.602 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:51:18.605 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:51:18.607 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:51:48.759 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:51:48.762 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:51:48.763 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:52:19.109 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:52:19.113 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:52:19.117 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:52:49.242 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:52:49.245 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:52:49.247 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:53:19.399 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:53:19.402 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:53:19.404 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:53:49.547 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:53:49.550 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:53:49.553 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:54:19.681 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:54:19.685 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:54:19.687 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:54:49.848 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:54:49.851 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:54:49.853 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:55:19.986 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:55:19.989 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:55:19.991 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:55:50.130 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:55:50.133 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:55:50.135 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:56:20.271 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:56:20.274 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:56:20.276 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:56:50.408 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:56:50.412 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:56:50.414 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:57:20.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:57:20.572 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:57:20.574 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:57:50.696 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:57:50.698 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:57:50.700 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:58:20.941 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:58:20.945 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:58:20.947 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:58:51.079 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:58:51.082 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:58:51.084 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:59:21.219 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:59:21.221 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:59:21.223 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:59:51.349 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:59:51.351 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T17:59:51.353 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:00:21.494 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:00:21.498 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:00:21.501 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:00:51.650 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:00:51.654 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:00:51.656 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:01:21.789 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:01:21.793 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:01:21.795 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:01:21.830 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T18:01:21.828+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127909) UID: 0 2023-03-08T18:01:21.830 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T18:01:21.828+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127909) UID: 0 2023-03-08T18:01:21.831 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T18:01:21.828+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127909) UID: 0 2023-03-08T18:01:21.831 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T18:01:21.828+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127909) UID: 0 2023-03-08T18:03:23.954 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:03:23.957 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:03:23.960 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:03:54.301 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:03:54.304 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:03:54.306 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:04:24.433 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:04:24.435 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:04:24.438 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:04:54.572 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:04:54.575 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:04:54.577 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:05:24.720 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:05:24.723 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:05:24.726 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:05:54.859 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:05:54.862 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:05:54.864 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:06:24.991 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:06:24.994 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:06:24.996 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:06:55.128 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:06:55.132 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:06:55.134 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:07:25.269 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:07:25.272 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:07:25.274 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:07:55.406 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:07:55.410 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:07:55.413 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:08:25.550 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:08:25.554 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:08:25.556 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:08:55.672 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:08:55.675 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:08:55.679 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:09:25.811 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:09:25.813 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:09:25.816 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:09:55.951 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:09:55.954 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:09:55.956 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:10:26.115 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:10:26.118 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:10:26.120 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:10:56.251 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:10:56.253 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:10:56.255 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:11:26.432 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:11:26.434 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:11:26.436 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:11:56.561 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:11:56.564 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:11:56.566 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:12:26.690 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:12:26.693 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:12:26.695 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:12:56.814 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:12:56.817 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:12:56.819 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:13:26.958 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:13:26.961 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:13:26.963 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:13:57.240 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:13:57.246 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:13:57.249 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:14:27.384 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:14:27.387 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:14:27.389 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:14:57.525 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:14:57.528 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:14:57.530 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:15:27.663 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:15:27.666 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:15:27.668 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:15:57.810 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:15:57.814 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:15:57.816 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:16:27.948 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:16:27.951 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:16:27.953 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:16:58.079 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:16:58.082 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:16:58.084 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:17:28.224 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:17:28.228 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:17:28.231 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:17:28.263 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T18:17:28.261+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128741) UID: 0 2023-03-08T18:17:28.264 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T18:17:28.261+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128741) UID: 0 2023-03-08T18:17:28.265 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T18:17:28.261+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128741) UID: 0 2023-03-08T18:17:28.265 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T18:17:28.261+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128741) UID: 0 2023-03-08T18:19:30.330 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:19:30.333 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:19:30.335 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:20:00.473 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:20:00.476 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:20:00.478 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:20:30.621 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:20:30.625 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:20:30.627 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:21:00.768 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:21:00.771 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:21:00.773 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:21:30.897 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:21:30.900 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:21:30.902 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:22:01.027 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:22:01.029 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:22:01.031 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:22:31.157 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:22:31.160 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:22:31.162 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:23:01.306 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:23:01.309 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:23:01.311 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:23:31.490 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:23:31.493 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:23:31.495 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:24:01.630 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:24:01.633 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:24:01.635 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:24:31.760 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:24:31.763 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:24:31.765 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:25:01.890 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:25:01.893 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:25:01.895 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:25:32.047 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:25:32.050 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:25:32.053 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:26:02.189 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:26:02.192 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:26:02.194 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:26:32.327 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:26:32.329 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:26:32.331 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:27:02.465 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:27:02.468 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:27:02.470 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:27:32.620 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:27:32.623 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:27:32.625 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:28:02.850 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:28:02.853 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:28:02.855 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:28:33.003 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:28:33.006 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:28:33.008 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:29:03.140 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:29:03.143 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:29:03.146 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:29:33.312 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:29:33.315 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:29:33.318 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:30:03.442 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:30:03.445 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:30:03.447 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:30:33.720 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:30:33.723 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:30:33.725 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:31:03.870 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:31:03.872 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:31:03.874 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:31:34.042 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:31:34.045 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:31:34.047 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:32:04.196 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:32:04.199 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:32:04.201 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:32:34.350 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:32:34.354 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:32:34.357 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:33:04.505 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:33:04.510 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:33:04.512 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:33:34.643 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:33:34.646 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:33:34.648 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:34:04.774 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:34:04.777 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:34:04.778 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:34:04.809 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T18:34:04.808+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129602) UID: 0 2023-03-08T18:34:04.810 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T18:34:04.808+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129602) UID: 0 2023-03-08T18:34:04.811 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T18:34:04.808+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129602) UID: 0 2023-03-08T18:34:04.811 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T18:34:04.808+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129602) UID: 0 2023-03-08T18:36:10.092 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:36:10.096 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:36:10.098 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:36:40.242 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:36:40.245 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:36:40.247 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:37:10.388 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:37:10.391 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:37:10.393 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:37:40.518 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:37:40.521 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:37:40.523 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:38:10.649 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:38:10.653 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:38:10.655 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:38:40.828 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:38:40.831 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:38:40.833 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:39:10.958 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:39:10.961 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:39:10.963 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:39:41.105 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:39:41.109 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:39:41.111 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:40:11.266 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:40:11.269 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:40:11.271 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:40:41.424 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:40:41.427 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:40:41.429 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:41:11.633 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:41:11.636 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:41:11.640 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:41:41.963 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:41:41.967 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:41:41.969 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:42:12.106 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:42:12.109 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:42:12.111 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:42:42.245 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:42:42.247 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:42:42.250 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:43:12.382 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:43:12.385 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:43:12.387 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:43:42.536 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:43:42.540 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:43:42.542 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:44:12.693 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:44:12.696 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:44:12.699 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:44:42.830 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:44:42.833 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:44:42.836 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:45:12.976 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:45:12.979 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:45:12.981 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:45:43.134 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:45:43.138 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:45:43.140 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:46:13.265 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:46:13.268 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:46:13.271 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:46:43.404 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:46:43.407 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:46:43.410 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:47:13.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:47:13.570 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:47:13.572 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:47:43.713 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:47:43.716 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:47:43.718 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:48:13.869 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:48:13.872 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:48:13.874 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:48:44.032 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:48:44.035 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:48:44.037 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:49:14.162 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:49:14.165 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:49:14.167 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:49:44.301 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:49:44.304 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:49:44.306 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:50:14.438 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:50:14.488 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:50:14.490 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:50:14.526 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T18:50:14.524+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130464) UID: 0 2023-03-08T18:50:14.526 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T18:50:14.524+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130464) UID: 0 2023-03-08T18:50:14.527 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T18:50:14.524+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130464) UID: 0 2023-03-08T18:50:14.527 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T18:50:14.524+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130464) UID: 0 2023-03-08T18:52:16.159 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:52:16.162 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:52:16.164 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:52:46.492 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:52:46.495 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:52:46.497 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:53:16.626 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:53:16.629 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:53:16.631 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:53:46.760 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:53:46.764 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:53:46.766 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:54:16.907 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:54:16.910 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:54:16.912 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:54:47.061 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:54:47.064 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:54:47.066 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:55:17.189 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:55:17.192 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:55:17.193 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:55:47.320 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:55:47.323 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:55:47.325 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:56:05.064 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-03-08T18:56:17.450 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:56:17.453 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:56:17.455 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:56:47.599 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:56:47.602 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:56:47.605 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:57:17.769 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:57:17.772 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:57:17.774 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:57:47.919 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:57:47.922 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:57:47.924 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:58:18.070 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:58:18.073 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:58:18.075 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:58:48.226 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:58:48.228 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:58:48.231 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:59:18.372 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:59:18.375 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:59:18.377 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:59:48.511 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:59:48.514 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T18:59:48.516 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:00:18.641 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:00:18.645 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:00:18.647 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:00:48.786 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:00:48.790 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:00:48.793 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:01:18.943 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:01:18.947 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:01:18.949 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:01:49.104 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:01:49.107 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:01:49.109 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:02:19.374 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:02:19.377 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:02:19.380 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:02:49.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:02:49.519 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:02:49.521 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:03:19.653 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:03:19.656 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:03:19.658 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:03:49.784 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:03:49.787 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:03:49.789 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:04:19.932 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:04:19.935 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:04:19.937 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:04:50.078 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:04:50.081 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:04:50.083 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:05:20.233 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:05:20.236 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:05:20.238 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:05:50.389 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:05:50.392 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:05:50.394 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:06:20.536 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:06:20.539 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:06:20.541 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:06:20.575 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T19:06:20.573+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131309) UID: 0 2023-03-08T19:06:20.575 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T19:06:20.573+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131309) UID: 0 2023-03-08T19:06:20.576 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T19:06:20.573+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131309) UID: 0 2023-03-08T19:06:20.576 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T19:06:20.573+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131309) UID: 0 2023-03-08T19:08:22.041 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:08:22.046 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:08:22.049 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:08:52.203 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:08:52.205 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:08:52.207 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:08:52.292 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-03-08T19:09:22.357 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:09:22.360 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:09:22.362 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:09:52.486 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:09:52.489 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:09:52.491 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:10:22.634 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:10:22.637 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:10:22.639 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:10:52.780 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:10:52.783 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:10:52.785 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:11:22.919 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:11:22.922 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:11:22.924 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:11:53.065 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:11:53.068 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:11:53.070 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:12:23.197 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:12:23.200 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:12:23.202 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:12:53.353 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:12:53.356 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:12:53.358 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:13:23.526 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:13:23.528 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:13:23.530 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:13:53.653 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:13:53.656 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:13:53.659 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:14:23.793 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:14:23.796 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:14:23.798 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:14:53.964 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:14:53.968 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:14:53.970 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:15:24.122 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:15:24.126 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:15:24.128 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:15:54.278 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:15:54.281 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:15:54.284 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:16:24.413 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:16:24.416 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:16:24.418 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:16:54.552 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:16:54.554 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:16:54.557 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:17:24.708 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:17:24.711 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:17:24.713 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:17:54.845 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:17:54.849 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:17:54.851 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:18:24.991 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:18:24.994 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:18:24.996 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:18:55.402 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:18:55.408 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:18:55.411 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:19:25.551 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:19:25.554 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:19:25.557 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:19:55.681 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:19:55.684 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:19:55.686 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:20:25.869 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:20:25.873 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:20:25.875 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:20:56.008 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:20:56.010 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:20:56.013 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:21:26.162 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:21:26.164 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:21:26.167 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:21:56.292 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:21:56.296 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:21:56.299 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:22:26.438 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:22:26.442 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:22:26.444 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:22:26.476 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T19:22:26.475+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132146) UID: 0 2023-03-08T19:22:26.477 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T19:22:26.475+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132146) UID: 0 2023-03-08T19:22:26.477 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T19:22:26.475+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132146) UID: 0 2023-03-08T19:22:26.478 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T19:22:26.475+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132146) UID: 0 2023-03-08T19:24:28.448 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:24:28.451 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:24:28.453 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:24:58.593 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:24:58.596 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:24:58.598 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:25:28.753 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:25:28.756 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:25:28.758 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:25:58.906 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:25:58.909 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:25:58.911 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:26:29.056 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:26:29.059 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:26:29.061 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:26:59.191 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:26:59.194 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:26:59.197 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:27:29.329 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:27:29.332 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:27:29.334 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:27:59.488 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:27:59.491 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:27:59.493 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:28:29.623 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:28:29.626 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:28:29.628 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:28:59.971 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:28:59.974 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:28:59.976 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:29:30.099 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:29:30.102 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:29:30.104 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:30:00.228 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:30:00.231 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:30:00.233 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:30:30.376 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:30:30.378 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:30:30.381 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:31:00.546 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:31:00.549 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:31:00.551 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:31:30.676 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:31:30.679 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:31:30.681 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:32:00.806 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:32:00.809 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:32:00.811 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:32:30.975 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:32:30.978 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:32:30.980 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:33:01.099 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:33:01.102 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:33:01.103 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:33:31.246 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:33:31.249 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:33:31.251 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:34:01.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:34:01.413 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:34:01.415 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:34:31.539 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:34:31.542 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:34:31.544 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:35:01.815 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:35:01.819 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:35:01.821 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:35:31.957 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:35:31.960 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:35:31.962 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:36:02.097 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:36:02.100 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:36:02.103 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:36:32.227 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:36:32.230 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:36:32.233 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:37:02.366 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:37:02.369 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:37:02.371 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:37:32.496 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:37:32.499 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:37:32.501 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:38:02.659 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:38:02.663 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:38:02.664 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:38:32.796 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:38:32.799 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:38:32.801 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:38:32.832 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T19:38:32.831+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132978) UID: 0 2023-03-08T19:38:32.833 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T19:38:32.832+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132978) UID: 0 2023-03-08T19:38:32.833 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T19:38:32.832+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132978) UID: 0 2023-03-08T19:38:32.834 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T19:38:32.832+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132978) UID: 0 2023-03-08T19:40:34.484 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:40:34.487 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:40:34.489 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:41:04.629 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:41:04.631 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:41:04.633 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:41:34.758 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:41:34.760 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:41:34.763 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:42:04.938 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:42:04.941 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:42:04.943 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:42:35.067 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:42:35.072 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:42:35.074 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:43:05.205 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:43:05.208 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:43:05.210 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:43:35.344 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:43:35.348 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:43:35.351 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:44:05.482 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:44:05.485 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:44:05.487 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:44:35.654 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:44:35.657 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:44:35.659 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:45:05.917 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:45:05.920 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:45:05.924 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:45:36.081 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:45:36.083 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:45:36.086 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:46:06.211 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:46:06.214 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:46:06.216 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:46:36.375 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:46:36.377 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:46:36.379 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:47:06.513 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:47:06.516 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:47:06.518 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:47:36.659 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:47:36.662 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:47:36.663 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:48:06.789 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:48:06.791 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:48:06.794 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:48:36.939 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:48:36.941 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:48:36.943 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:49:07.094 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:49:07.097 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:49:07.100 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:49:37.222 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:49:37.225 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:49:37.228 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:50:07.378 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:50:07.381 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:50:07.383 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:50:37.530 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:50:37.534 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:50:37.536 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:51:07.677 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:51:07.680 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:51:07.682 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:51:37.929 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:51:37.931 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:51:37.934 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:52:08.053 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:52:08.055 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:52:08.057 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:52:38.190 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:52:38.194 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:52:38.196 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:53:08.338 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:53:08.341 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:53:08.343 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:53:38.501 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:53:38.504 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:53:38.507 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:54:08.680 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:54:08.683 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:54:08.686 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:54:38.810 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:54:38.813 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:54:38.816 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:55:08.968 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:55:08.971 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:55:08.973 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:55:09.005 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T19:55:09.003+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133839) UID: 0 2023-03-08T19:55:09.005 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T19:55:09.003+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133839) UID: 0 2023-03-08T19:55:09.005 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T19:55:09.003+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133839) UID: 0 2023-03-08T19:55:09.006 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T19:55:09.003+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133839) UID: 0 2023-03-08T19:57:13.352 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:57:13.355 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:57:13.357 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:57:43.482 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:57:43.485 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:57:43.487 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:58:13.611 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:58:13.614 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:58:13.616 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:58:43.741 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:58:43.744 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:58:43.747 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:59:13.879 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:59:13.882 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:59:13.884 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:59:44.010 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:59:44.013 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T19:59:44.015 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:00:14.138 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:00:14.141 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:00:14.144 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:00:44.284 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:00:44.287 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:00:44.289 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:01:14.418 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:01:14.422 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:01:14.424 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:01:44.575 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:01:44.580 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:01:44.586 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:02:14.850 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:02:14.853 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:02:14.855 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:02:44.988 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:02:44.991 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:02:44.993 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:03:15.118 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:03:15.122 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:03:15.124 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:03:45.249 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:03:45.253 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:03:45.255 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:04:15.414 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:04:15.417 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:04:15.419 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:04:45.554 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:04:45.556 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:04:45.558 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:05:15.693 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:05:15.696 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:05:15.698 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:05:45.818 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:05:45.821 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:05:45.823 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:06:15.949 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:06:15.952 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:06:15.954 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:06:46.107 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:06:46.110 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:06:46.112 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:07:16.243 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:07:16.245 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:07:16.247 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:07:46.406 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:07:46.409 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:07:46.412 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:08:16.561 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:08:16.563 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:08:16.566 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:08:46.707 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:08:46.710 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:08:46.711 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:09:16.845 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:09:16.847 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:09:16.849 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:09:46.987 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:09:46.990 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:09:46.992 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:10:17.141 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:10:17.144 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:10:17.146 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:10:47.302 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:10:47.305 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:10:47.307 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:11:17.451 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:11:17.454 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:11:17.456 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:11:17.490 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T20:11:17.489+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134693) UID: 0 2023-03-08T20:11:17.491 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T20:11:17.489+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134693) UID: 0 2023-03-08T20:11:17.491 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T20:11:17.489+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134693) UID: 0 2023-03-08T20:11:17.492 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T20:11:17.489+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134693) UID: 0 2023-03-08T20:13:19.368 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:13:19.371 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:13:19.373 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:13:49.495 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:13:49.498 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:13:49.500 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:14:19.683 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:14:19.686 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:14:19.688 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:14:49.824 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:14:49.827 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:14:49.829 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:15:20.125 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:15:20.128 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:15:20.131 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:15:50.258 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:15:50.260 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:15:50.262 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:16:20.408 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:16:20.411 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:16:20.413 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:16:50.553 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:16:50.556 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:16:50.558 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:17:20.698 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:17:20.701 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:17:20.703 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:17:50.977 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:17:50.981 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:17:50.983 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:18:21.117 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:18:21.120 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:18:21.123 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:18:51.263 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:18:51.266 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:18:51.268 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:19:21.417 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:19:21.420 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:19:21.423 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:19:51.566 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:19:51.569 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:19:51.571 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:20:21.710 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:20:21.713 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:20:21.715 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:20:51.859 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:20:51.862 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:20:51.864 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:21:21.998 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:21:22.001 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:21:22.003 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:21:52.134 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:21:52.136 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:21:52.138 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:22:22.293 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:22:22.297 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:22:22.299 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:22:52.426 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:22:52.429 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:22:52.431 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:23:22.566 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:23:22.568 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:23:22.571 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:23:52.927 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:23:52.930 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:23:52.932 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:24:23.058 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:24:23.061 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:24:23.063 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:24:53.216 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:24:53.219 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:24:53.222 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:25:23.360 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:25:23.363 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:25:23.365 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:25:53.490 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:25:53.493 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:25:53.495 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:26:23.628 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:26:23.631 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:26:23.633 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:26:53.759 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:26:53.762 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:26:53.764 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:27:23.923 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:27:23.927 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:27:23.930 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:27:54.094 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:27:54.098 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:27:54.100 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:27:54.132 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T20:27:54.131+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135550) UID: 0 2023-03-08T20:27:54.132 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T20:27:54.131+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135550) UID: 0 2023-03-08T20:27:54.133 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T20:27:54.131+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135550) UID: 0 2023-03-08T20:27:54.133 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T20:27:54.131+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135550) UID: 0 2023-03-08T20:29:58.852 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:29:58.854 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:29:58.856 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:30:28.987 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:30:28.990 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:30:28.992 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:30:59.117 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:30:59.120 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:30:59.123 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:31:29.255 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:31:29.258 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:31:29.260 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:31:59.395 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:31:59.398 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:31:59.400 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:32:29.539 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:32:29.542 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:32:29.544 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:32:59.669 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:32:59.672 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:32:59.674 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:33:29.815 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:33:29.818 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:33:29.820 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:33:59.959 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:33:59.962 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:33:59.965 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:34:30.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:34:30.157 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:34:30.159 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:35:00.290 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:35:00.292 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:35:00.294 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:35:30.432 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:35:30.435 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:35:30.437 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:36:00.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:36:00.573 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:36:00.576 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:36:30.706 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:36:30.709 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:36:30.713 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:37:00.861 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:37:00.865 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:37:00.867 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:37:31.004 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:37:31.007 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:37:31.010 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:38:01.146 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:38:01.149 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:38:01.151 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:38:31.277 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:38:31.280 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:38:31.282 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:39:01.444 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:39:01.447 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:39:01.450 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:39:31.588 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:39:31.591 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:39:31.593 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:40:01.725 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:40:01.728 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:40:01.730 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:40:32.013 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:40:32.016 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:40:32.018 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:41:02.366 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:41:02.369 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:41:02.372 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:41:32.497 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:41:32.500 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:41:32.502 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:42:02.628 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:42:02.631 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:42:02.633 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:42:32.778 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:42:32.781 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:42:32.783 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:43:02.925 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:43:02.928 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:43:02.930 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:43:33.063 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:43:33.067 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:43:33.070 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:44:03.210 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:44:03.212 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:44:03.215 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:44:03.247 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T20:44:03.246+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136385) UID: 0 2023-03-08T20:44:03.247 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T20:44:03.246+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136385) UID: 0 2023-03-08T20:44:03.248 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T20:44:03.246+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136385) UID: 0 2023-03-08T20:44:03.248 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T20:44:03.246+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136385) UID: 0 2023-03-08T20:46:05.684 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:46:05.687 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:46:05.689 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:46:35.824 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:46:35.827 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:46:35.829 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:47:05.962 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:47:05.966 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:47:05.967 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:47:36.111 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:47:36.114 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:47:36.116 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:48:06.247 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:48:06.250 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:48:06.253 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:48:36.378 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:48:36.380 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:48:36.383 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:49:06.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:49:06.521 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:49:06.527 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:49:36.765 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:49:36.768 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:49:36.770 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:50:07.151 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:50:07.154 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:50:07.156 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:50:37.302 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:50:37.305 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:50:37.307 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:51:07.436 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:51:07.440 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:51:07.442 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:51:37.585 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:51:37.589 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:51:37.592 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:52:07.720 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:52:07.723 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:52:07.725 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:52:37.858 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:52:37.861 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:52:37.863 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:53:07.997 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:53:07.999 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:53:08.001 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:53:38.136 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:53:38.139 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:53:38.141 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:54:08.284 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:54:08.287 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:54:08.289 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:54:38.431 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:54:38.434 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:54:38.437 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:55:08.576 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:55:08.579 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:55:08.582 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:55:38.732 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:55:38.735 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:55:38.739 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:56:08.888 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:56:08.892 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:56:08.894 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:56:39.050 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:56:39.053 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:56:39.055 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:57:09.208 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:57:09.212 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:57:09.214 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:57:39.353 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:57:39.355 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:57:39.358 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:58:09.493 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:58:09.495 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:58:09.497 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:58:39.629 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:58:39.633 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:58:39.637 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:59:09.768 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:59:09.771 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:59:09.773 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:59:39.899 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:59:39.902 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T20:59:39.904 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:00:10.044 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:00:10.047 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:00:10.049 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:00:10.081 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T21:00:10.081+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137222) UID: 0 2023-03-08T21:00:10.082 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T21:00:10.081+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137222) UID: 0 2023-03-08T21:00:10.082 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T21:00:10.081+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137222) UID: 0 2023-03-08T21:00:10.083 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T21:00:10.081+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137222) UID: 0 2023-03-08T21:02:12.473 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:02:12.476 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:02:12.479 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:02:42.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:02:42.605 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:02:42.607 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:03:12.732 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:03:12.735 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:03:12.737 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:03:42.862 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:03:42.865 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:03:42.868 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:04:13.000 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:04:13.004 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:04:13.007 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:04:43.146 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:04:43.153 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:04:43.156 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:05:13.286 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:05:13.289 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:05:13.292 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:05:43.423 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:05:43.426 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:05:43.428 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:06:13.563 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:06:13.566 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:06:13.568 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:06:43.888 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:06:43.890 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:06:43.892 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:07:14.031 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:07:14.035 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:07:14.037 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:07:44.169 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:07:44.172 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:07:44.174 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:08:14.299 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:08:14.303 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:08:14.305 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:08:44.487 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:08:44.490 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:08:44.492 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:09:14.635 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:09:14.638 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:09:14.640 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:09:44.799 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:09:44.803 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:09:44.806 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:10:14.937 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:10:14.940 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:10:14.942 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:10:45.074 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:10:45.077 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:10:45.079 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:11:15.217 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:11:15.220 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:11:15.222 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:11:45.350 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:11:45.353 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:11:45.355 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:12:15.488 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:12:15.492 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:12:15.494 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:12:45.837 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:12:45.840 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:12:45.842 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:13:15.973 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:13:15.977 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:13:15.979 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:13:46.112 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:13:46.115 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:13:46.117 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:14:16.251 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:14:16.254 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:14:16.256 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:14:46.389 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:14:46.392 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:14:46.394 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:15:16.543 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:15:16.546 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:15:16.549 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:15:46.700 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:15:46.703 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:15:46.704 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:16:16.840 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:16:16.844 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:16:16.846 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:16:16.879 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T21:16:16.879+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138074) UID: 0 2023-03-08T21:16:16.880 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T21:16:16.879+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138074) UID: 0 2023-03-08T21:16:16.880 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T21:16:16.879+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138074) UID: 0 2023-03-08T21:16:16.881 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T21:16:16.879+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138074) UID: 0 2023-03-08T21:18:19.028 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:18:19.031 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:18:19.034 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:18:49.172 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:18:49.175 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:18:49.178 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:19:19.310 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:19:19.314 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:19:19.316 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:19:49.457 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:19:49.460 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:19:49.464 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:20:19.611 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:20:19.616 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:20:19.620 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:20:49.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:20:49.779 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:20:49.782 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:21:19.907 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:21:19.911 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:21:19.913 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:21:50.052 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:21:50.055 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:21:50.057 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:22:20.232 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:22:20.235 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:22:20.237 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:22:50.361 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:22:50.364 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:22:50.366 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:23:20.727 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:23:20.730 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:23:20.732 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:23:50.864 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:23:50.867 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:23:50.870 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:24:21.028 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:24:21.032 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:24:21.034 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:24:51.166 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:24:51.169 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:24:51.172 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:25:21.304 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:25:21.307 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:25:21.309 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:25:51.434 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:25:51.437 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:25:51.439 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:26:21.591 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:26:21.594 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:26:21.596 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:26:51.730 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:26:51.735 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:26:51.737 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:27:21.867 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:27:21.871 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:27:21.873 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:27:52.006 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:27:52.009 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:27:52.011 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:28:22.144 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:28:22.147 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:28:22.150 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:28:52.276 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:28:52.279 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:28:52.281 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:29:22.628 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:29:22.632 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:29:22.635 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:29:52.802 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:29:52.805 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:29:52.809 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:30:22.948 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:30:22.952 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:30:22.954 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:30:53.098 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:30:53.101 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:30:53.103 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:31:23.233 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:31:23.236 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:31:23.238 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:31:53.372 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:31:53.375 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:31:53.377 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:32:23.500 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:32:23.504 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:32:23.506 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:32:23.539 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T21:32:23.538+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138910) UID: 0 2023-03-08T21:32:23.539 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T21:32:23.538+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138910) UID: 0 2023-03-08T21:32:23.539 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T21:32:23.538+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138910) UID: 0 2023-03-08T21:32:23.540 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T21:32:23.538+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138910) UID: 0 2023-03-08T21:34:25.764 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:34:25.767 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:34:25.769 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:34:55.934 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:34:55.938 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:34:55.940 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:35:26.074 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:35:26.077 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:35:26.080 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:35:56.211 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:35:56.214 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:35:56.216 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:36:26.351 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:36:26.353 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:36:26.355 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:36:56.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:36:56.512 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:36:56.514 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:37:26.703 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:37:26.706 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:37:26.708 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:37:56.850 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:37:56.853 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:37:56.855 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:38:27.197 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:38:27.200 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:38:27.202 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:38:57.357 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:38:57.360 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:38:57.362 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:39:27.515 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:39:27.518 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:39:27.520 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:39:57.661 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:39:57.664 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:39:57.667 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:40:27.800 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:40:27.804 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:40:27.805 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:40:57.939 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:40:57.942 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:40:57.944 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:41:28.084 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:41:28.087 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:41:28.089 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:41:58.216 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:41:58.219 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:41:58.221 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:42:28.345 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:42:28.348 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:42:28.350 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:42:58.499 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:42:58.502 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:42:58.504 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:43:28.688 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:43:28.690 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:43:28.693 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:43:58.844 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:43:58.847 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:43:58.850 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:44:28.982 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:44:28.986 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:44:28.988 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:44:59.127 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:44:59.130 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:44:59.132 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:45:29.282 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:45:29.285 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:45:29.287 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:45:59.415 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:45:59.418 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:45:59.421 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:46:29.560 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:46:29.563 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:46:29.565 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:46:59.706 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:46:59.708 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:46:59.711 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:47:29.846 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:47:29.850 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:47:29.853 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:48:00.000 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:48:00.004 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:48:00.006 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:48:30.155 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:48:30.159 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:48:30.161 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:48:30.193 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T21:48:30.191+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139744) UID: 0 2023-03-08T21:48:30.193 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T21:48:30.191+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139744) UID: 0 2023-03-08T21:48:30.194 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T21:48:30.192+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139744) UID: 0 2023-03-08T21:48:30.194 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T21:48:30.192+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139744) UID: 0 2023-03-08T21:50:32.266 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:50:32.269 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:50:32.273 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:51:02.411 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:51:02.414 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:51:02.416 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:51:32.553 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:51:32.556 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:51:32.558 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:52:02.692 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:52:02.695 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:52:02.697 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:52:32.842 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:52:32.845 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:52:32.847 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:53:02.998 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:53:03.002 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:53:03.003 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:53:33.132 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:53:33.135 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:53:33.137 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:54:03.262 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:54:03.265 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:54:03.267 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:54:33.409 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:54:33.411 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:54:33.414 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:55:03.556 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:55:03.559 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:55:03.561 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:55:33.711 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:55:33.714 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:55:33.716 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:56:03.863 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:56:03.866 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:56:03.869 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:56:34.005 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:56:34.009 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:56:34.011 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:57:04.138 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:57:04.141 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:57:04.144 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:57:34.468 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:57:34.476 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:57:34.480 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:58:04.629 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:58:04.632 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:58:04.634 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:58:34.803 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:58:34.806 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:58:34.808 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:59:04.947 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:59:04.950 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:59:04.952 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:59:35.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:59:35.089 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T21:59:35.092 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:00:05.217 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:00:05.226 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:00:05.228 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:00:35.380 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:00:35.384 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:00:35.386 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:01:05.679 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:01:05.683 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:01:05.685 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:01:35.844 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:01:35.848 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:01:35.850 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:02:05.986 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:02:05.989 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:02:05.992 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:02:36.116 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:02:36.128 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:02:36.131 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:03:06.272 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:03:06.275 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:03:06.277 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:03:36.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:03:36.413 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:03:36.415 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:04:06.548 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:04:06.552 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:04:06.555 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:04:36.686 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:04:36.689 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:04:36.691 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:04:36.724 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T22:04:36.723+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140590) UID: 0 2023-03-08T22:04:36.724 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T22:04:36.723+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140590) UID: 0 2023-03-08T22:04:36.725 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T22:04:36.723+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140590) UID: 0 2023-03-08T22:04:36.725 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T22:04:36.723+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 140590) UID: 0 2023-03-08T22:06:38.943 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:06:38.946 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:06:38.948 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:07:09.075 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:07:09.080 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:07:09.083 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:07:39.209 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:07:39.212 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:07:39.215 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:08:09.347 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:08:09.350 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:08:09.352 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:08:39.497 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:08:39.500 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:08:39.502 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:09:09.650 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:09:09.653 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:09:09.655 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:09:39.780 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:09:39.783 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:09:39.785 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:10:09.917 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:10:09.920 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:10:09.922 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:10:40.064 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:10:40.067 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:10:40.069 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:11:10.272 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:11:10.276 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:11:10.279 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:11:40.407 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:11:40.410 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:11:40.413 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:12:10.563 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:12:10.566 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:12:10.568 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:12:40.701 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:12:40.704 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:12:40.706 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:13:10.830 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:13:10.833 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:13:10.836 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:13:40.970 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:13:40.973 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:13:40.975 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:14:11.103 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:14:11.106 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:14:11.109 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:14:41.263 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:14:41.265 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:14:41.267 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:15:11.409 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:15:11.413 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:15:11.415 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:15:41.560 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:15:41.563 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:15:41.565 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:16:11.714 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:16:11.717 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:16:11.719 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:16:41.862 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:16:41.865 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:16:41.867 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:17:12.088 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:17:12.091 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:17:12.093 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:17:42.609 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:17:42.612 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:17:42.615 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:18:12.784 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:18:12.788 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:18:12.791 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:18:42.923 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:18:42.926 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:18:42.928 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:19:13.062 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:19:13.095 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:19:13.097 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:19:43.224 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:19:43.227 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:19:43.229 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:20:13.354 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:20:13.357 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:20:13.359 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:20:43.502 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:20:43.505 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:20:43.508 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:20:43.540 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T22:20:43.540+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 141427) UID: 0 2023-03-08T22:20:43.541 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T22:20:43.540+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 141427) UID: 0 2023-03-08T22:20:43.541 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T22:20:43.540+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 141427) UID: 0 2023-03-08T22:20:43.542 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T22:20:43.540+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 141427) UID: 0 2023-03-08T22:22:46.395 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:22:46.398 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:22:46.399 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:23:16.541 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:23:16.544 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:23:16.546 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:23:46.672 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:23:46.674 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:23:46.677 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:24:16.810 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:24:16.813 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:24:16.815 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:24:46.956 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:24:46.959 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:24:46.961 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:25:17.087 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:25:17.090 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:25:17.092 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:25:47.217 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:25:47.220 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:25:47.222 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:26:17.356 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:26:17.359 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:26:17.362 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:26:47.594 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:26:47.597 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:26:47.599 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:27:17.742 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:27:17.745 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:27:17.747 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:27:47.895 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:27:47.898 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:27:47.900 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:28:18.035 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:28:18.038 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:28:18.041 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:28:48.190 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:28:48.193 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:28:48.195 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:29:18.321 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:29:18.324 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:29:18.326 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:29:48.459 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:29:48.462 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:29:48.464 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:30:18.605 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:30:18.608 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:30:18.610 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:30:48.769 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:30:48.772 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:30:48.774 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:31:18.899 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:31:18.903 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:31:18.906 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:31:49.038 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:31:49.041 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:31:49.043 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:32:19.166 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:32:19.170 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:32:19.177 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:32:49.312 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:32:49.315 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:32:49.318 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:33:19.682 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:33:19.685 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:33:19.687 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:33:49.815 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:33:49.820 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:33:49.822 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:34:19.961 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:34:19.964 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:34:19.966 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:34:50.117 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:34:50.120 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:34:50.122 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:35:20.265 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:35:20.268 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:35:20.272 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:35:50.421 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:35:50.425 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:35:50.427 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:36:20.556 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:36:20.561 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:36:20.563 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:36:50.690 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:36:50.693 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:36:50.695 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:36:50.726 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T22:36:50.726+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142259) UID: 0 2023-03-08T22:36:50.727 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T22:36:50.726+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142259) UID: 0 2023-03-08T22:36:50.727 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T22:36:50.726+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142259) UID: 0 2023-03-08T22:36:50.728 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T22:36:50.726+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142259) UID: 0 2023-03-08T22:38:54.702 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:38:54.705 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:38:54.707 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:39:24.875 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:39:24.878 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:39:24.880 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:39:55.028 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:39:55.031 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:39:55.033 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:40:25.165 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:40:25.168 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:40:25.170 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:40:55.305 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:40:55.309 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:40:55.311 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:41:25.467 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:41:25.470 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:41:25.472 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:41:55.598 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:41:55.601 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:41:55.603 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:42:25.752 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:42:25.755 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:42:25.758 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:42:55.897 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:42:55.900 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:42:55.903 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:43:26.038 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:43:26.040 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:43:26.043 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:43:56.185 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:43:56.188 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:43:56.191 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:44:26.331 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:44:26.334 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:44:26.337 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:44:56.469 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:44:56.473 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:44:56.475 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:45:26.616 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:45:26.619 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:45:26.621 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:45:56.755 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:45:56.758 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:45:56.761 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:46:26.908 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:46:26.912 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:46:26.914 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:46:57.054 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:46:57.057 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:46:57.059 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:47:27.188 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:47:27.191 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:47:27.193 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:47:57.326 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:47:57.329 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:47:57.331 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:48:27.486 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:48:27.489 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:48:27.491 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:48:57.646 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:48:57.648 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:48:57.651 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:49:27.774 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:49:27.777 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:49:27.779 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:49:58.091 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:49:58.096 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:49:58.098 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:50:28.242 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:50:28.249 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:50:28.251 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:50:58.388 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:50:58.392 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:50:58.395 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:51:28.527 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:51:28.530 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:51:28.533 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:51:58.698 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:51:58.702 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:51:58.705 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:52:28.837 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:52:28.840 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:52:28.843 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:52:58.976 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:52:58.979 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:52:58.981 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:52:59.012 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T22:52:59.011+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143095) UID: 0 2023-03-08T22:52:59.013 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T22:52:59.011+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143095) UID: 0 2023-03-08T22:52:59.013 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T22:52:59.011+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143095) UID: 0 2023-03-08T22:52:59.013 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T22:52:59.011+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143095) UID: 0 2023-03-08T22:55:01.076 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:55:01.079 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:55:01.082 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:55:31.208 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:55:31.212 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:55:31.215 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:56:01.372 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:56:01.375 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:56:01.377 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:56:31.519 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:56:31.522 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:56:31.524 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:57:01.658 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:57:01.661 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:57:01.663 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:57:31.797 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:57:31.801 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:57:31.803 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:58:01.935 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:58:01.937 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:58:01.941 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:58:32.080 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:58:32.083 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:58:32.086 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:59:02.219 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:59:02.222 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:59:02.224 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:59:32.374 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:59:32.377 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T22:59:32.379 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:00:02.513 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:00:02.516 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:00:02.518 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:00:32.677 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:00:32.680 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:00:32.682 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:01:02.814 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:01:02.818 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:01:02.820 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:01:32.953 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:01:32.957 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:01:32.960 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:02:03.094 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:02:03.098 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:02:03.100 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:02:33.237 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:02:33.261 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:02:33.264 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:03:03.392 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:03:03.395 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:03:03.397 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:03:33.654 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:03:33.657 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:03:33.659 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:04:03.797 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:04:03.801 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:04:03.803 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:04:33.956 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:04:33.960 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:04:33.963 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:05:04.307 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:05:04.310 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:05:04.314 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:05:34.470 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:05:34.473 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:05:34.475 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:06:04.624 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:06:04.627 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:06:04.629 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:06:34.789 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:06:34.792 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:06:34.794 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:07:04.970 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:07:04.973 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:07:04.975 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:07:35.099 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:07:35.102 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:07:35.104 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:08:05.255 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:08:05.258 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:08:05.260 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:08:35.393 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:08:35.396 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:08:35.398 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:09:05.540 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:09:05.543 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:09:05.546 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:09:05.594 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T23:09:05.594+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143937) UID: 0 2023-03-08T23:09:05.595 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T23:09:05.594+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143937) UID: 0 2023-03-08T23:09:05.595 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T23:09:05.594+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143937) UID: 0 2023-03-08T23:09:05.596 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T23:09:05.594+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143937) UID: 0 2023-03-08T23:11:07.348 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:11:07.351 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:11:07.353 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:11:37.512 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:11:37.515 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:11:37.517 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:12:07.651 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:12:07.653 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:12:07.656 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:12:37.813 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:12:37.815 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:12:37.818 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:13:08.035 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:13:08.038 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:13:08.041 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:13:38.163 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:13:38.166 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:13:38.169 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:14:08.302 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:14:08.306 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:14:08.308 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:14:38.452 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:14:38.455 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:14:38.457 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:15:08.706 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:15:08.710 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:15:08.713 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:15:38.849 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:15:38.852 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:15:38.854 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:16:08.996 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:16:08.999 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:16:09.001 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:16:39.144 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:16:39.146 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:16:39.149 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:17:09.281 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:17:09.285 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:17:09.287 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:17:39.419 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:17:39.422 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:17:39.424 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:18:09.558 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:18:09.562 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:18:09.564 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:18:39.707 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:18:39.711 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:18:39.713 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:19:09.856 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:19:09.859 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:19:09.861 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:19:40.008 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:19:40.011 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:19:40.014 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:20:10.143 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:20:10.146 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:20:10.148 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:20:40.275 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:20:40.294 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:20:40.297 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:21:10.589 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:21:10.592 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:21:10.594 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:21:40.716 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:21:40.719 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:21:40.722 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:22:10.846 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:22:10.849 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:22:10.851 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:22:40.992 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:22:40.995 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:22:40.998 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:23:11.135 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:23:11.139 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:23:11.142 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:23:41.276 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:23:41.280 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:23:41.282 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:24:11.406 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:24:11.409 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:24:11.412 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:24:41.535 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:24:41.538 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:24:41.540 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:25:11.680 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:25:11.683 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:25:11.685 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:25:11.718 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T23:25:11.717+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144775) UID: 0 2023-03-08T23:25:11.718 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T23:25:11.717+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144775) UID: 0 2023-03-08T23:25:11.719 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T23:25:11.717+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144775) UID: 0 2023-03-08T23:25:11.719 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T23:25:11.717+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 144775) UID: 0 2023-03-08T23:27:13.872 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:27:13.876 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:27:13.877 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:27:44.016 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:27:44.019 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:27:44.021 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:28:14.162 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:28:14.165 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:28:14.167 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:28:44.301 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:28:44.304 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:28:44.306 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:29:14.439 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:29:14.442 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:29:14.445 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:29:44.586 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:29:44.588 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:29:44.590 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:30:14.715 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:30:14.718 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:30:14.720 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:30:44.870 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:30:44.873 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:30:44.875 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:31:15.007 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:31:15.011 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:31:15.013 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:31:45.359 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:31:45.362 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:31:45.364 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:32:15.501 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:32:15.504 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:32:15.506 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:32:45.656 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:32:45.659 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:32:45.661 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:33:15.794 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:33:15.797 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:33:15.799 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:33:45.942 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:33:45.945 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:33:45.947 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:34:16.078 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:34:16.081 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:34:16.084 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:34:46.234 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:34:46.237 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:34:46.239 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:35:16.373 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:35:16.377 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:35:16.379 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:35:46.510 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:35:46.513 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:35:46.515 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:36:16.657 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:36:16.660 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:36:16.663 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:36:46.820 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:36:46.824 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:36:46.827 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:37:16.961 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:37:16.964 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:37:16.967 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:37:47.241 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:37:47.249 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:37:47.253 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:38:17.402 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:38:17.406 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:38:17.408 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:38:47.558 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:38:47.561 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:38:47.564 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:39:17.695 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:39:17.698 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:39:17.700 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:39:47.833 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:39:47.836 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:39:47.838 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:40:17.971 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:40:17.974 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:40:17.978 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:40:48.135 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:40:48.139 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:40:48.141 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:41:18.273 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:41:18.276 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:41:18.277 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:41:18.310 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T23:41:18.310+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145620) UID: 0 2023-03-08T23:41:18.310 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T23:41:18.310+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145620) UID: 0 2023-03-08T23:41:18.311 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T23:41:18.310+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145620) UID: 0 2023-03-08T23:41:18.311 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T23:41:18.310+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 145620) UID: 0 2023-03-08T23:43:20.429 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:43:20.432 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:43:20.434 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:43:50.571 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:43:50.575 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:43:50.577 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:44:20.733 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:44:20.736 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:44:20.738 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:44:50.862 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:44:50.865 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:44:50.868 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:45:21.001 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:45:21.004 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:45:21.006 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:45:51.148 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:45:51.150 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:45:51.153 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:46:21.286 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:46:21.290 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:46:21.292 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:46:51.424 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:46:51.427 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:46:51.429 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:47:21.572 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:47:21.576 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:47:21.578 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:47:51.710 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:47:51.713 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:47:51.715 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:48:21.847 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:48:21.850 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:48:21.852 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:48:51.978 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:48:51.981 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:48:51.983 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:49:22.115 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:49:22.117 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:49:22.121 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:49:52.252 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:49:52.255 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:49:52.257 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:50:22.390 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:50:22.393 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:50:22.395 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:50:52.539 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:50:52.542 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:50:52.544 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:51:22.675 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:51:22.678 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:51:22.680 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:51:52.805 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:51:52.808 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:51:52.810 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:52:22.935 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:52:22.938 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:52:22.940 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:52:53.064 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:52:53.068 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:52:53.071 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:53:23.202 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:53:23.205 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:53:23.207 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:53:53.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:53:53.512 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:53:53.514 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:54:23.913 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:54:23.916 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:54:23.918 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:54:54.050 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:54:54.054 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:54:54.056 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:55:24.198 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:55:24.201 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:55:24.204 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:55:54.336 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:55:54.339 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:55:54.342 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:56:24.474 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:56:24.477 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:56:24.479 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:56:54.631 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:56:54.634 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:56:54.637 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:57:24.777 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:57:24.780 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:57:24.783 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:57:54.914 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:57:54.917 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:57:54.919 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:57:54.950 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-08T23:57:54.949+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146478) UID: 0 2023-03-08T23:57:54.951 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-08T23:57:54.949+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146478) UID: 0 2023-03-08T23:57:54.951 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-08T23:57:54.949+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146478) UID: 0 2023-03-08T23:57:54.952 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-08T23:57:54.949+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 146478) UID: 0 2023-03-08T23:59:59.774 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:59:59.777 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-08T23:59:59.779 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:00:29.904 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:00:29.908 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:00:29.911 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:01:00.052 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:01:00.055 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:01:00.057 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:01:30.190 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:01:30.194 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:01:30.197 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:02:00.327 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:02:00.331 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:02:00.333 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:02:30.488 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:02:30.491 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:02:30.493 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:03:00.630 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:03:00.634 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:03:00.636 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:03:30.775 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:03:30.778 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:03:30.781 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:04:00.956 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:04:00.964 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:04:00.966 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:04:31.119 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:04:31.125 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:04:31.127 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:05:01.367 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:05:01.370 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:05:01.372 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:05:31.496 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:05:31.499 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:05:31.501 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:06:01.634 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:06:01.638 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:06:01.640 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:06:31.790 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:06:31.793 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:06:31.796 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:07:01.928 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:07:01.931 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:07:01.933 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:07:32.110 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:07:32.114 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:07:32.116 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:08:02.247 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:08:02.251 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:08:02.254 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:08:32.385 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:08:32.388 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:08:32.391 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:09:02.515 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:09:02.518 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:09:02.521 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:09:32.644 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:09:32.647 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:09:32.649 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:10:02.783 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:10:02.786 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:10:02.788 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:10:32.930 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:10:32.933 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:10:32.935 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:11:03.059 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:11:03.062 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:11:03.064 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:11:33.206 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:11:33.209 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:11:33.210 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:12:03.335 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:12:03.337 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:12:03.340 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:12:33.464 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:12:33.468 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:12:33.471 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:13:03.603 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:13:03.606 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:13:03.609 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:13:33.783 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:13:33.786 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:13:33.788 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:14:03.921 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:14:03.924 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:14:03.926 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:14:03.960 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-09T00:14:03.959+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147394) UID: 0 2023-03-09T00:14:03.961 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-09T00:14:03.959+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147394) UID: 0 2023-03-09T00:14:03.961 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-09T00:14:03.959+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147394) UID: 0 2023-03-09T00:14:03.962 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-09T00:14:03.959+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147394) UID: 0 2023-03-09T00:16:06.485 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:16:06.488 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:16:06.490 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:16:36.620 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:16:36.623 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:16:36.626 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:17:06.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:17:06.779 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:17:06.781 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:17:36.924 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:17:36.927 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:17:36.929 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:18:07.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:18:07.088 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:18:07.090 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:18:37.221 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:18:37.224 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:18:37.227 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:19:07.362 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:19:07.366 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:19:07.371 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:19:37.689 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:19:37.692 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:19:37.694 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:20:07.838 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:20:07.841 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:20:07.844 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:20:38.170 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:20:38.174 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:20:38.176 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:21:08.323 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:21:08.326 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:21:08.328 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:21:38.477 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:21:38.480 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:21:38.482 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:22:08.626 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:22:08.629 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:22:08.632 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:22:38.770 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:22:38.772 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:22:38.774 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:23:08.925 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:23:08.929 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:23:08.936 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:23:39.072 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:23:39.075 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:23:39.077 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:24:09.227 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:24:09.231 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:24:09.233 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:24:39.363 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:24:39.367 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:24:39.369 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:25:09.521 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:25:09.525 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:25:09.527 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:25:39.660 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:25:39.663 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:25:39.665 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:26:09.795 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:26:09.797 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:26:09.800 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:26:40.153 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:26:40.156 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:26:40.158 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:27:10.290 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:27:10.293 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:27:10.295 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:27:40.454 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:27:40.457 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:27:40.459 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:28:10.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:28:10.603 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:28:10.605 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:28:40.731 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:28:40.734 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:28:40.736 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:29:10.860 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:29:10.863 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:29:10.865 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:29:40.998 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:29:41.001 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:29:41.004 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:30:11.145 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:30:11.148 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:30:11.150 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:30:11.182 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-09T00:30:11.181+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148229) UID: 0 2023-03-09T00:30:11.183 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-09T00:30:11.181+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148229) UID: 0 2023-03-09T00:30:11.183 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-09T00:30:11.181+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148229) UID: 0 2023-03-09T00:30:11.184 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-09T00:30:11.181+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 148229) UID: 0 2023-03-09T00:32:13.292 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:32:13.295 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:32:13.297 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:32:43.427 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:32:43.430 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:32:43.432 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:33:13.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:33:13.569 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:33:13.572 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:33:43.719 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:33:43.722 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:33:43.724 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:34:13.859 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:34:13.862 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:34:13.865 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:34:43.997 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:34:43.999 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:34:44.002 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:35:14.170 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:35:14.172 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:35:14.174 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:35:44.307 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:35:44.310 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:35:44.312 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:36:14.454 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:36:14.457 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:36:14.460 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:36:44.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:36:44.604 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:36:44.606 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:37:14.772 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:37:14.776 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:37:14.778 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:37:44.929 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:37:44.932 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:37:44.934 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:38:15.066 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:38:15.069 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:38:15.071 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:38:45.237 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:38:45.240 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:38:45.241 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:39:15.375 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:39:15.378 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:39:15.380 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:39:45.522 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:39:45.525 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:39:45.527 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:40:15.669 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:40:15.672 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:40:15.675 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:40:45.824 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:40:45.827 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:40:45.829 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:41:15.953 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:41:15.956 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:41:15.958 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:41:46.083 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:41:46.086 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:41:46.088 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:42:16.213 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:42:16.352 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:42:16.354 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:42:46.619 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:42:46.621 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:42:46.624 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:43:16.756 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:43:16.759 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:43:16.761 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:43:46.886 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:43:46.889 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:43:46.892 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:44:17.016 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:44:17.019 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:44:17.021 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:44:47.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:44:47.158 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:44:47.160 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:45:17.293 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:45:17.297 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:45:17.299 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:45:47.450 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:45:47.453 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:45:47.456 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:46:17.586 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:46:17.589 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:46:17.592 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:46:17.622 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-09T00:46:17.621+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149071) UID: 0 2023-03-09T00:46:17.623 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-09T00:46:17.621+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149071) UID: 0 2023-03-09T00:46:17.623 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-09T00:46:17.621+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149071) UID: 0 2023-03-09T00:46:17.624 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-09T00:46:17.621+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149071) UID: 0 2023-03-09T00:48:19.308 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:48:19.311 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:48:19.314 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:48:49.443 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:48:49.446 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:48:49.448 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:49:19.598 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:49:19.601 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:49:19.603 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:49:49.740 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:49:49.744 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:49:49.748 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:50:20.073 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:50:20.077 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:50:20.079 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:50:50.243 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:50:50.246 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:50:50.249 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:51:20.389 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:51:20.392 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:51:20.394 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:51:50.528 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:51:50.531 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:51:50.533 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:52:20.682 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:52:20.686 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:52:20.690 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:52:50.823 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:52:50.827 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:52:50.830 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:53:20.969 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:53:20.972 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:53:20.974 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:53:51.100 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:53:51.103 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:53:51.105 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:54:21.237 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:54:21.240 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:54:21.242 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:54:51.377 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:54:51.380 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:54:51.383 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:55:21.533 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:55:21.536 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:55:21.538 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:55:51.671 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:55:51.674 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:55:51.676 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:56:21.808 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:56:21.813 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:56:21.816 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:56:51.947 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:56:51.951 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:56:51.954 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:57:22.101 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:57:22.104 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:57:22.106 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:57:52.240 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:57:52.243 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:57:52.246 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:58:22.388 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:58:22.391 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:58:22.394 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:58:52.534 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:58:52.537 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:58:52.539 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:59:22.687 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:59:22.691 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:59:22.694 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:59:52.835 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:59:52.839 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T00:59:52.842 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:00:22.980 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:00:22.983 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:00:22.985 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:00:53.127 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:00:53.131 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:00:53.133 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:01:23.266 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:01:23.269 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:01:23.272 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:01:53.404 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:01:53.408 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:01:53.411 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:02:23.558 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:02:23.562 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:02:23.564 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:02:23.597 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-09T01:02:23.596+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149922) UID: 0 2023-03-09T01:02:23.598 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-09T01:02:23.596+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149922) UID: 0 2023-03-09T01:02:23.599 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-09T01:02:23.596+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149922) UID: 0 2023-03-09T01:02:23.599 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-09T01:02:23.596+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 149922) UID: 0 2023-03-09T01:04:26.148 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:04:26.151 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:04:26.153 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:04:56.298 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:04:56.301 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:04:56.303 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:05:26.428 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:05:26.431 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:05:26.433 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:05:56.558 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:05:56.561 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:05:56.563 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:06:26.713 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:06:26.716 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:06:26.718 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:06:56.853 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:06:56.856 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:06:56.858 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:07:26.985 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:07:26.988 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:07:26.991 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:07:57.130 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:07:57.133 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:07:57.135 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:08:27.262 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:08:27.265 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:08:27.267 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:08:57.610 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:08:57.613 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:08:57.615 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:09:27.761 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:09:27.765 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:09:27.767 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:09:57.891 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:09:57.895 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:09:57.897 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:10:28.035 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:10:28.038 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:10:28.040 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:10:58.192 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:10:58.195 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:10:58.197 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:11:28.322 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:11:28.325 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:11:28.327 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:11:58.469 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:11:58.473 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:11:58.478 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:12:28.624 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:12:28.627 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:12:28.629 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:12:58.760 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:12:58.763 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:12:58.765 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:13:28.884 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:13:28.887 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:13:28.889 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:13:59.021 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:13:59.024 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:13:59.026 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:14:29.159 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:14:29.162 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:14:29.164 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:14:59.307 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:14:59.310 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:14:59.312 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:15:29.487 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:15:29.490 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:15:29.493 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:15:59.617 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:15:59.620 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:15:59.622 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:16:29.748 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:16:29.751 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:16:29.753 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:16:59.878 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:16:59.881 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:16:59.883 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:17:30.033 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:17:30.037 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:17:30.039 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:18:00.164 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:18:00.167 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:18:00.169 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:18:30.293 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:18:30.296 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:18:30.298 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:18:30.330 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-09T01:18:30.328+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 150753) UID: 0 2023-03-09T01:18:30.330 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-09T01:18:30.328+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 150753) UID: 0 2023-03-09T01:18:30.331 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-09T01:18:30.329+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 150753) UID: 0 2023-03-09T01:18:30.331 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-09T01:18:30.329+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 150753) UID: 0 2023-03-09T01:20:32.524 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:20:32.528 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:20:32.530 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:21:02.649 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:21:02.652 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:21:02.655 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:21:32.795 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:21:32.798 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:21:32.800 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:22:02.932 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:22:02.935 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:22:02.937 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:22:33.065 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:22:33.068 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:22:33.071 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:23:03.203 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:23:03.206 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:23:03.208 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:23:33.423 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:23:33.426 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:23:33.428 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:24:03.556 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:24:03.559 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:24:03.561 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:24:33.692 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:24:33.695 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:24:33.697 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:25:03.823 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:25:03.826 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:25:03.829 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:25:33.961 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:25:33.964 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:25:33.966 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:26:04.091 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:26:04.094 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:26:04.096 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:26:34.245 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:26:34.248 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:26:34.251 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:27:04.377 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:27:04.380 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:27:04.382 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:27:34.508 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:27:34.510 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:27:34.512 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:28:04.651 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:28:04.654 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:28:04.657 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:28:34.790 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:28:34.794 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:28:34.796 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:29:04.931 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:29:04.934 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:29:04.936 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:29:35.078 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:29:35.080 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:29:35.082 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:30:05.216 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:30:05.219 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:30:05.221 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:30:35.354 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:30:35.357 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:30:35.359 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:31:05.484 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:31:05.487 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:31:05.489 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:31:35.774 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:31:35.776 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:31:35.778 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:32:05.910 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:32:05.913 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:32:05.915 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:32:36.057 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:32:36.060 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:32:36.062 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:33:06.204 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:33:06.208 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:33:06.210 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:33:36.342 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:33:36.344 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:33:36.347 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:34:06.479 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:34:06.483 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:34:06.485 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:34:36.609 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:34:36.612 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:34:36.615 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:34:36.647 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-09T01:34:36.645+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 151590) UID: 0 2023-03-09T01:34:36.647 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-09T01:34:36.645+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 151590) UID: 0 2023-03-09T01:34:36.648 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-09T01:34:36.645+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 151590) UID: 0 2023-03-09T01:34:36.648 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-09T01:34:36.645+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 151590) UID: 0 2023-03-09T01:36:38.726 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:36:38.730 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:36:38.733 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:37:08.877 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:37:08.881 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:37:08.884 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:37:39.016 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:37:39.019 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:37:39.021 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:38:09.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:38:09.157 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:38:09.159 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:38:39.291 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:38:39.295 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:38:39.297 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:39:09.422 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:39:09.425 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:39:09.427 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:39:39.552 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:39:39.555 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:39:39.557 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:40:09.854 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:40:09.857 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:40:09.860 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:40:40.301 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:40:40.303 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:40:40.305 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:41:10.450 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:41:10.453 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:41:10.456 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:41:40.580 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:41:40.582 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:41:40.585 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:42:10.710 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:42:10.713 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:42:10.715 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:42:40.847 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:42:40.850 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:42:40.852 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:43:11.019 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:43:11.022 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:43:11.024 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:43:41.174 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:43:41.177 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:43:41.179 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:44:11.329 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:44:11.331 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:44:11.333 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:44:41.467 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:44:41.470 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:44:41.473 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:45:11.610 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:45:11.613 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:45:11.615 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:45:41.752 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:45:41.755 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:45:41.757 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:46:11.891 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:46:11.894 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:46:11.896 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:46:42.276 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:46:42.279 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:46:42.281 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:47:12.404 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:47:12.407 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:47:12.409 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:47:42.543 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:47:42.546 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:47:42.548 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:48:12.681 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:48:12.686 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:48:12.689 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:48:42.820 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:48:42.823 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:48:42.825 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:49:12.949 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:49:12.952 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:49:12.954 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:49:43.104 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:49:43.107 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:49:43.109 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:50:13.251 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:50:13.255 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:50:13.258 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:50:43.397 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:50:43.400 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:50:43.402 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:50:43.433 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-09T01:50:43.432+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152427) UID: 0 2023-03-09T01:50:43.433 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-09T01:50:43.432+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152427) UID: 0 2023-03-09T01:50:43.434 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-09T01:50:43.432+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152427) UID: 0 2023-03-09T01:50:43.434 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-09T01:50:43.432+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152427) UID: 0 2023-03-09T01:52:45.036 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:52:45.039 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:52:45.041 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:53:15.183 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:53:15.186 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:53:15.188 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:53:45.330 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:53:45.333 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:53:45.335 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:54:15.476 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:54:15.485 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:54:15.487 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:54:45.640 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:54:45.643 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:54:45.645 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:55:15.773 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:55:15.776 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:55:15.777 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:55:45.913 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:55:45.916 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:55:45.918 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:56:16.042 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:56:16.045 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:56:16.047 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:56:46.173 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:56:46.176 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:56:46.178 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:57:16.474 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:57:16.477 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:57:16.479 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:57:46.600 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:57:46.603 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:57:46.606 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:58:16.730 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:58:16.734 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:58:16.736 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:58:46.862 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:58:46.865 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:58:46.866 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:59:17.040 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:59:17.043 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:59:17.045 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:59:47.178 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:59:47.181 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T01:59:47.183 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:00:17.308 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:00:17.311 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:00:17.313 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:00:47.441 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:00:47.483 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:00:47.488 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:01:17.618 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:01:17.621 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:01:17.624 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:01:47.747 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:01:47.751 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:01:47.753 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:02:17.886 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:02:17.889 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:02:17.891 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:02:48.026 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:02:48.029 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:02:48.031 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:03:18.420 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:03:18.423 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:03:18.425 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:03:48.551 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:03:48.554 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:03:48.556 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:04:18.781 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:04:18.783 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:04:18.785 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:04:48.918 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:04:48.921 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:04:48.923 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:05:19.049 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:05:19.052 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:05:19.054 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:05:49.179 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:05:49.182 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:05:49.184 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:06:19.309 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:06:19.312 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:06:19.314 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:06:49.440 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:06:49.443 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:06:49.445 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:06:49.478 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-09T02:06:49.477+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 153271) UID: 0 2023-03-09T02:06:49.479 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-09T02:06:49.477+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 153271) UID: 0 2023-03-09T02:06:49.479 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-09T02:06:49.477+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 153271) UID: 0 2023-03-09T02:06:49.479 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-09T02:06:49.477+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 153271) UID: 0 2023-03-09T02:08:51.355 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:08:51.358 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:08:51.360 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:09:21.489 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:09:21.493 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:09:21.496 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:09:51.644 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:09:51.647 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:09:51.649 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:10:21.782 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:10:21.785 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:10:21.787 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:10:51.939 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:10:51.942 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:10:51.945 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:11:22.100 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:11:22.104 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:11:22.106 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:11:52.231 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:11:52.234 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:11:52.237 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:12:22.369 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:12:22.372 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:12:22.374 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:12:52.498 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:12:52.501 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:12:52.503 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:13:22.858 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:13:22.865 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:13:22.871 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:13:53.000 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:13:53.003 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:13:53.005 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:14:23.148 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:14:23.152 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:14:23.154 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:14:53.286 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:14:53.289 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:14:53.291 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:15:23.424 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:15:23.427 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:15:23.429 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:15:53.562 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:15:53.565 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:15:53.567 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:16:23.700 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:16:23.704 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:16:23.706 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:16:53.833 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:16:54.266 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:16:54.269 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:17:24.429 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:17:24.432 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:17:24.434 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:17:54.576 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:17:54.579 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:17:54.581 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:18:24.712 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:18:24.716 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:18:24.718 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:18:54.851 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:18:54.854 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:18:54.856 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:19:24.980 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:19:24.984 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:19:24.987 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:19:55.271 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:19:55.275 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:19:55.277 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:20:25.398 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:20:25.401 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:20:25.403 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:20:55.541 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:20:55.544 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:20:55.546 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:21:25.675 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:21:25.678 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:21:25.680 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:21:55.804 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:21:55.807 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:21:55.809 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:22:25.943 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:22:25.945 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:22:25.948 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:22:56.072 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:22:56.075 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:22:56.077 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:22:56.109 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-09T02:22:56.108+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154108) UID: 0 2023-03-09T02:22:56.110 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-09T02:22:56.108+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154108) UID: 0 2023-03-09T02:22:56.110 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-09T02:22:56.108+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154108) UID: 0 2023-03-09T02:22:56.110 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-09T02:22:56.108+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154108) UID: 0 2023-03-09T02:24:58.790 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:24:58.794 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:24:58.797 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:25:28.930 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:25:28.938 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:25:28.940 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:25:59.078 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:25:59.082 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:25:59.084 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:26:29.215 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:26:29.219 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:26:29.221 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:26:59.354 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:26:59.363 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:26:59.370 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:27:29.508 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:27:29.512 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:27:29.514 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:27:59.640 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:27:59.643 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:27:59.646 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:28:29.777 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:28:29.780 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:28:29.783 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:29:00.115 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:29:00.117 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:29:00.119 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:29:30.254 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:29:30.257 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:29:30.259 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:30:00.392 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:30:00.396 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:30:00.401 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:30:30.540 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:30:30.544 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:30:30.546 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:31:00.680 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:31:00.683 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:31:00.685 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:31:30.834 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:31:30.837 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:31:30.839 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:32:00.961 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:32:00.965 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:32:00.967 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:32:31.099 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:32:31.102 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:32:31.104 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:33:01.229 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:33:01.232 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:33:01.235 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:33:31.384 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:33:31.387 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:33:31.389 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:34:01.514 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:34:01.517 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:34:01.519 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:34:31.660 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:34:31.663 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:34:31.666 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:35:01.947 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:35:01.950 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:35:01.952 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:35:32.078 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:35:32.081 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:35:32.084 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:36:02.209 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:36:02.214 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:36:02.216 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:36:32.339 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:36:32.342 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:36:32.344 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:37:02.479 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:37:02.481 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:37:02.483 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:37:32.626 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:37:32.628 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:37:32.631 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:38:02.764 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:38:02.768 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:38:02.770 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:38:32.902 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:38:32.905 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:38:32.907 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:39:03.032 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:39:03.035 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:39:03.037 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:39:03.069 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-09T02:39:03.068+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154939) UID: 0 2023-03-09T02:39:03.070 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-09T02:39:03.068+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154939) UID: 0 2023-03-09T02:39:03.070 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-09T02:39:03.068+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154939) UID: 0 2023-03-09T02:39:03.070 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-09T02:39:03.068+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 154939) UID: 0 2023-03-09T02:41:04.860 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:41:04.863 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:41:04.866 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:41:35.213 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:41:35.221 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:41:35.223 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:42:05.369 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:42:05.372 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:42:05.376 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:42:35.508 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:42:35.511 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:42:35.514 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:43:05.654 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:43:05.657 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:43:05.659 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:43:35.783 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:43:35.788 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:43:35.792 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:44:05.923 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:44:05.929 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:44:05.932 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:44:36.060 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:44:36.063 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:44:36.066 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:45:06.198 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:45:06.200 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:45:06.202 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:45:36.337 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:45:36.341 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:45:36.344 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:46:06.476 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:46:06.479 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:46:06.481 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:46:36.607 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:46:36.613 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:46:36.619 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:47:06.794 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:47:06.797 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:47:06.799 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:47:36.925 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:47:36.928 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:47:36.930 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:48:07.275 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:48:07.278 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:48:07.280 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:48:37.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:48:37.413 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:48:37.415 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:49:07.548 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:49:07.551 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:49:07.553 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:49:37.678 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:49:37.681 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:49:37.683 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:50:07.818 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:50:07.821 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:50:07.823 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:50:37.971 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:50:37.975 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:50:37.978 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:51:08.110 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:51:08.114 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:51:08.116 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:51:38.239 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:51:38.243 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:51:38.245 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:52:08.369 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:52:08.372 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:52:08.375 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:52:38.500 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:52:38.502 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:52:38.504 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:53:08.630 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:53:08.633 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:53:08.635 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:53:38.936 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:53:38.939 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:53:38.941 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:54:09.063 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:54:09.066 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:54:09.068 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:54:39.213 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:54:39.216 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:54:39.218 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:55:09.339 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:55:09.342 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:55:09.344 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:55:09.376 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-09T02:55:09.375+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 155775) UID: 0 2023-03-09T02:55:09.376 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-09T02:55:09.375+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 155775) UID: 0 2023-03-09T02:55:09.377 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-09T02:55:09.375+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 155775) UID: 0 2023-03-09T02:55:09.377 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-09T02:55:09.375+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 155775) UID: 0 2023-03-09T02:57:11.783 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:57:11.787 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:57:11.789 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:57:41.916 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:57:41.920 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:57:41.922 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:58:12.055 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:58:12.058 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:58:12.060 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:58:42.193 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:58:42.196 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:58:42.198 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:59:12.340 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:59:12.343 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:59:12.345 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:59:42.468 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:59:42.471 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T02:59:42.473 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:00:12.599 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:00:12.602 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:00:12.605 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:00:42.745 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:00:42.749 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:00:42.751 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:01:12.883 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:01:12.886 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:01:12.888 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:01:43.236 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:01:43.239 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:01:43.241 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:02:13.385 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:02:13.388 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:02:13.389 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:02:43.522 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:02:43.525 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:02:43.527 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:03:13.653 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:03:13.656 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:03:13.658 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:03:43.783 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:03:43.786 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:03:43.788 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:04:13.913 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:04:13.916 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:04:13.918 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:04:44.042 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:04:44.045 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:04:44.047 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:05:14.189 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:05:14.192 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:05:14.194 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:05:44.361 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:05:44.365 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:05:44.366 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:06:14.501 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:06:14.506 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:06:14.509 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:06:44.640 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:06:44.643 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:06:44.645 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:07:14.779 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:07:14.782 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:07:14.784 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:07:45.126 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:07:45.129 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:07:45.131 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:08:15.271 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:08:15.274 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:08:15.276 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:08:45.657 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:08:45.659 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:08:45.661 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:09:15.789 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:09:15.792 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:09:15.794 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:09:45.934 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:09:45.937 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:09:45.939 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:10:16.074 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:10:16.076 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:10:16.079 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:10:46.229 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:10:46.233 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:10:46.235 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:11:16.359 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:11:16.363 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:11:16.367 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:11:16.401 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-09T03:11:16.400+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 156640) UID: 0 2023-03-09T03:11:16.402 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-09T03:11:16.400+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 156640) UID: 0 2023-03-09T03:11:16.403 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-09T03:11:16.400+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 156640) UID: 0 2023-03-09T03:11:16.403 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-09T03:11:16.400+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 156640) UID: 0 2023-03-09T03:13:18.657 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:13:18.661 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:13:18.663 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:13:48.802 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:13:48.805 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:13:48.807 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:14:18.936 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:14:18.939 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:14:18.941 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:14:49.080 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:14:49.084 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:14:49.086 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:15:19.222 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:15:19.225 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:15:19.226 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:15:49.352 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:15:49.355 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:15:49.357 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:16:19.499 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:16:19.502 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:16:19.504 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:16:49.638 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:16:49.641 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:16:49.643 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:17:19.989 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:17:19.992 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:17:19.994 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:17:50.123 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:17:50.125 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:17:50.128 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:18:20.261 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:18:20.264 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:18:20.266 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:18:50.390 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:18:50.393 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:18:50.395 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:19:20.537 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:19:20.539 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:19:20.541 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:19:50.675 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:19:50.678 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:19:50.681 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:20:20.821 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:20:20.825 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:20:20.828 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:20:50.968 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:20:50.971 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:20:50.974 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:21:21.098 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:21:21.101 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:21:21.103 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:21:51.235 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:21:51.238 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:21:51.240 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:22:21.383 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:22:21.387 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:22:21.391 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:22:51.521 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:22:51.524 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:22:51.527 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:23:21.771 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:23:21.774 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:23:21.776 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:23:51.906 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:23:51.909 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:23:51.911 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:24:22.042 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:24:22.045 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:24:22.047 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:24:52.181 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:24:52.184 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:24:52.187 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:25:22.320 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:25:22.323 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:25:22.325 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:25:52.449 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:25:52.452 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:25:52.454 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:26:22.584 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:26:22.587 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:26:22.590 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:26:52.719 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:26:52.722 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:26:52.724 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:27:22.858 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:27:22.861 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:27:22.863 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:27:22.896 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-03-09T03:27:22.894+0000 7f3e1bd56700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157472) UID: 0 2023-03-09T03:27:22.896 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-03-09T03:27:22.894+0000 7f24e86f7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157472) UID: 0 2023-03-09T03:27:22.897 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-03-09T03:27:22.894+0000 7f756cc69700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157472) UID: 0 2023-03-09T03:27:22.897 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-03-09T03:27:22.894+0000 7f9067ee4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157472) UID: 0 2023-03-09T03:29:24.931 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:29:24.934 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:29:24.936 DEBUG:teuthology.orchestra.run.smithi182:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-09T03:29:53.761 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-03-09T03:29:53.762 DEBUG:teuthology.task.console_log:Killing console logger for smithi123 2023-03-09T03:29:53.762 DEBUG:teuthology.task.console_log:Killing console logger for smithi175 2023-03-09T03:29:53.763 DEBUG:teuthology.task.console_log:Killing console logger for smithi182 2023-03-09T03:29:53.763 DEBUG:teuthology.exit:Finished running handlers